Boriana Koleva

Understanding and constructing shared spaces with mixed-reality boundaries

We propose an approach to creating shared mixed realities based on the construction of transparent boundaries between real and virtual spaces. First, we introduce a taxonomy that classifies current approaches to shared spaces according to the three dimensions of transportation, artificiality, and spatiality. Second, we discuss our experience of staging a poetry performance simultaneously within real and virtual theaters. This demonstrates the complexities involved in establishing social interaction between real and virtual spaces and motivates the development of a systematic approach to mixing realities. Third, we introduce and demonstrate the technique of mixed-reality boundaries as a way of joining real and virtual spaces together in order to address some of these problems.

From interaction to trajectories: designing coherent journeys through user experiences

The idea of interactional trajectories through interfaces has emerged as a sensitizing concept from recent studies of tangible interfaces and interaction in museums and galleries. We put this concept to work as a lens to reflect on published studies of complex user experiences that extend over space and time and involve multiple roles and interfaces. We develop a conceptual framework in which trajectories explain these user experiences as journeys through hybrid structures, punctuated by transitions, and in which interactivity and collaboration are orchestrated. Our framework is intended to sensitize future studies, help distill craft knowledge into design guidelines and patterns, identify technology requirements, and provide a boundary object to connect HCI with Performance Studies.

“Playing with the Bits” User-Configuration of Ubiquitous Domestic Environments

This paper presents the development of a user-oriented framework to support the user reconfiguration of ubiquitous domestic environments. We present a lightweight component model that allows a range of devices to be readily interconnected and an editor to support users in doing this. The editor discovers available ubiquitous components and presents these to users as jigsaw pieces that can be dynamically recombined. The developed editor allows users to assemble lightweight sensors, devices such as displays and larger applications in order to meet their particular needs.

Expected, sensed, and desired: A framework for designing sensing-based interaction

Movements of interfaces can be analyzed in terms of whether they are expected, sensed, and desired. Expected movements are those that users naturally perform; sensed are those that can be measured by a computer; and desired movements are those that are required by a given application. We show how a systematic comparison of expected, sensed, and desired movements, especially with regard to how they do not precisely overlap, can reveal potential problems with an interface and also inspire new features. We describe how this approach has been applied to the design of three interfaces: pointing flashlights at walls and posters in order to play sounds; the Augurscope II, a mobile augmented reality interface for outdoors; and the Drift Table, an item of furniture that uses load sensing to control the display of aerial photographs. We propose that this approach can help to build a bridge between the analytic and inspirational approaches to design and can help designers meet the challenges raised by a diversification of sensing technologies and interface forms, increased mobility, and an emerging focus on technologies for everyday life.

The augurscope: a mixed reality interface for outdoors

The augurscope is a portable mixed reality interface for outdoors. A tripod-mounted display is wheeled to different locations and rotated and tilted to view a virtual environment that is aligned with the physical background. Video from an onboard camera is embedded into this virtual environment. Our design encompasses physical form, interaction and the combination of a GPS receiver, electronic compass, accelerometer and rotary encoder for tracking. An initial application involves the public exploring a medieval castle from the site of its modern replacement. Analysis of use reveals problems with lighting, movement and relating virtual and physical viewpoints, and shows how environmental factors and physical form affect interaction. We suggest that problems might be accommodated by carefully constructing virtual and physical content

Camping in the digital wilderness: tents and flashlights as interfaces to virtual worlds

A projection screen in the shape of a tent provides children with a shared immersive experience of a virtual world based on the metaphor of camping. RFID aerials at its entrances sense tagged children and objects as they enter and leave. Video tracking allows multiple flashlights to be used as pointing devices. The tent is an example of a traversable interface, designed for deployment in public spaces such as museums, galleries and classrooms.

Traversable interfaces between real and virtual worlds

Traversable interfaces establish the illusion that virtual and physical worlds are joined together and that users can physically cross from one to the other. Our design for a traversable interface combines work on tele-embodiment, mixed reality boundaries and virtual environments. It also exploits non-solid projection surfaces, of which we describe four examples. Our design accommodates the perspectives of users who traverse the interface and also observers who are present in the connected physical and virtual worlds, an important consideration for performance and entertainment applications. A demonstrator supports encounters between members of our laboratory and remote visitors.

Performance-Led Research in the Wild

We explore the approach of performance-led research in the wild in which artists drive the creation of novel performances with the support of HCI researchers that are then deployed and studied at public performance in cultural settings such as galleries, festivals and on the city streets. We motivate the approach and then describe how it consists of three distinct activities -- practice, studies and theory -- that are interleaved in complex ways through nine different relationships. We present a historical account of how the approach has evolved over a fifteen-year period, charting the evolution of a complex web of projects, papers, and relationships between them. We articulate the challenges of pursuing each activity as well as overarching challenges of balancing artistic and research interests, flexible management of relationships, and finally ethics.

Staging and evaluating public performances as an approach to CVE research

Staging public performances can be a fruitful approach to CVE research. We describe four experiences: Out of This World, a gameshow; Avatar Farm, a participatory drama; Desert Rain, a mixed reality performance; and Can You See Me Now?, a game that mixed on-line players with players on the streets. For each, we describe how a combination of ethnography, audience feedback and analysis of system logs led to new design insights, especially in the areas of orchestration and making activity available to viewers. We propose enhancing this approach with new tools for manipulating, analysing and sharing 3D recordings of CVEs.

Creating the spectacle: Designing interactional trajectories through spectator interfaces

An ethnographic study reveals how professional artists created a spectator interface for the interactive game Day of the Figurines, designing the size, shape, height and materials of two tabletop interfaces before carefully arranging them in a local setting. We also show how participants experienced this interface. We consider how the artists worked with a multi-scale notion of interactional trajectory that combined trajectories through individual displays, trajectories through a local ecology of displays, and trajectories through an entire experience. Our findings shed light on discussions within HCI concerning interaction with tangible and tabletop displays, spectator interfaces, ecologies of displays, and trajectories through cultural experiences.