Martin Flintham

Can you see me now

We present a study of a mobile mixed reality game called Can You See Me Now? in which online players are chased through a virtual model of a city by ‘runners’ (professional performers equipped with GPS and WiFi technologies) who have to run through the actual city streets in order to catch the players. We present an ethnographic study of the game as it toured through two different cities and draws upon video recordings of online players, runners, technical support crew, and also on system logs of text communication. Our study reveals the diverse ways in which online players experienced the uncertainties inherent in GPS and WiFi, including being mostly unaware of them, but sometimes seeing them as problems, or treating the as a designed feature of the game, and even occasionally exploiting them within gameplay. In contrast, the runners and technical crew were fully aware of these uncertainties and continually battled against them through an ongoing and distributed process of orchestration. As a result, we encourage designers to deal with such uncertainties as a fundamental characteristic of location-based experiences rather than treating them as exceptions or bugs that might be ironed out in the future. We argue that designers should explicitly consider four potential states of being of a mobile participant: connected and tracked, connected but not tracked, tracked but not connected, and neither connected nor tracked. We then introduce five strategies that might be used to deal with uncertainty in these different states for different kinds of participant: remove it, hide it, manage it, reveal it, and exploit it. Finally, we present proposals for new orchestration interfaces that reveal the ‘seams’ in the underlying technical infrastructure by visualizing the recent performance of GPS and WiFi and predicting the likely future performance of GPS.

Where on-line meets on the streets: experiences with mobile mixed reality games

We describe two games in which online participants collaborated with mobile participants on the city streets. In the first, the players were online and professional performers were on the streets. The second reversed this relationship. Analysis of these experiences yields new insights into the nature of context. We show how context is more socially than technically constructed. We show how players exploited (and resolved conflicts between) multiple indications of context including GPS, GPS error, audio talk, ambient audio, timing, local knowledge and trust. We recommend not overly relying on GPS, extensively using audio, and extending interfaces to represent GPS error.

Coping with uncertainty in a location-based game

With location-based games, how you manage uncertainty can make the difference between fun and fiasco. Game designers should know what uncertainties to hide and what to reveal to create an engaging experience. This article describes our experiences, focusing on uncertainty, in publicly deploying an experimental, mobile mixed-reality game called Can You See Me Now?.

The Frame of the Game: Blurring the Boundary between Fiction and Reality in Mobile Experiences

Mobile experiences that take place in public settings such as on city streets create new opportunities for interweaving the fictional world of a performance or game with the everyday physical world. A study of a touring performance reveals how designers generated excitement and dramatic tension by implicating bystanders and encouraging the (apparent) crossing of normal boundaries of behaviour. The study also shows how designers dealt with associated risks through a process of careful orchestration. Consequently, we extend an existing framework for designing spectator interfaces with the concept of performance frames, enabling us to distinguish audience from bystanders. We conclude that using ambiguity to blur the frame can be a powerful design tactic, empowering players to willingly suspend disbelief, so long as a safety-net of orchestration ensures that they do not stray into genuine difficulty.Mobile experiences that take place in public settings such as on city streets create new opportunities for interweaving the fictional world of a performance or game with the everyday physical world. A study of a touring performance reveals how designers generated excitement and dramatic tension by implicating bystanders and encouraging the (apparent) crossing of normal boundaries of behaviour. The study also shows how designers dealt with associated risks through a process of careful orchestration. Consequently, we extend an existing framework for designing spectator interfaces with the concept of performance frames, enabling us to distinguish audience from bystanders. We conclude that using ambiguity to blur the frame can be a powerful design tactic, empowering players to willingly suspend disbelief, so long as a safety-net of orchestration ensures that they do not stray into genuine difficulty.

The error of our ways: The experience of self-reported position in a location-based game

We present a study of people’s use of positional information as part of a collaborative location-based game. The game exploits self-reported positioning in which mobile players manually reveal their positions to remote players by manipulating electronic maps. Analysis of players’ movements, position reports and communications, drawing on video data, system logs and player feedback, highlights some of the ways in which humans generate, communicate and interpret position reports. It appears that remote participants are largely untroubled by the relatively high positional error associated with self reports. Our analysis suggests that this may because mobile players declare themselves to be in plausible locations such as at common landmarks, ahead of themselves on their current trajectory (stating their intent) or behind themselves (confirming previously visited locations). These observations raise new requirements for the future development of automated positioning systems and also suggest that self-reported positioning may be a useful fallback when automated systems are unavailable or too unreliable.

The augurscope: a mixed reality interface for outdoors

The augurscope is a portable mixed reality interface for outdoors. A tripod-mounted display is wheeled to different locations and rotated and tilted to view a virtual environment that is aligned with the physical background. Video from an onboard camera is embedded into this virtual environment. Our design encompasses physical form, interaction and the combination of a GPS receiver, electronic compass, accelerometer and rotary encoder for tracking. An initial application involves the public exploring a medieval castle from the site of its modern replacement. Analysis of use reveals problems with lighting, movement and relating virtual and physical viewpoints, and shows how environmental factors and physical form affect interaction. We suggest that problems might be accommodated by carefully constructing virtual and physical content

The multimedia challenges raised by pervasive games

Pervasive gaming is a new form of multimedia entertainment that extends the traditional computer gaming experience out into the real world. Through a combination of personal devices, positioning systems and other multimedia sensors, combined with wireless networking, a pervasive game can respond to a players movements and context and enable them to communicate with a game server and other players. We review recent examples of pervasive games in order to explain their distinctive characteristics as multimedia applications. We then consider the challenge of scaling pervasive games to include potentially very large numbers of players. We propose a new approach based upon a campaign model in which individuals, local groups and experts draw on a combination of pervasive games, online services and broadcasting to take part in national or even global events. We discuss the challenges that this raises for further research.

Performance-Led Research in the Wild

We explore the approach of performance-led research in the wild in which artists drive the creation of novel performances with the support of HCI researchers that are then deployed and studied at public performance in cultural settings such as galleries, festivals and on the city streets. We motivate the approach and then describe how it consists of three distinct activities -- practice, studies and theory -- that are interleaved in complex ways through nine different relationships. We present a historical account of how the approach has evolved over a fifteen-year period, charting the evolution of a complex web of projects, papers, and relationships between them. We articulate the challenges of pursuing each activity as well as overarching challenges of balancing artistic and research interests, flexible management of relationships, and finally ethics.

Applications of temporal links: recording and replaying virtual environments

Temporal links allow recordings of multi-user sessions to be dynamically inserted into current virtual worlds in a flexible and principled way. We explore key applications of temporal links, showing how they can add new content to virtual worlds, support usability and system evaluation, and link VR to other media such as film and television. These applications illustrate just some of the possibilities of a ubiquitous and flexible record and replay facility such as temporal links. Building on our experience of implementing temporal links in the MASSIVE-3 system, we identify key requirements for system architectures that wish to support an equivalent mechanism.

The Cooperative Work of Gaming: Orchestrating a Mobile SMS Game

This paper focuses on orchestration work in the first iteration of a mobile game called Day Of The Figurines, which explores the potential to exploit text messaging as a means of creating an engaging gaming experience. By focusing on orchestration we are especially concerned with the ‘cooperative work that makes the game work’. While the assemblage or family of orchestration practices uncovered by our ethnographic study are specific to the game – including the ways in which behind the scenes staff make sense of messages, craft appropriate responses, and manage and track the production of gameplay narratives as the game unfolds – orchestration work is of general significance to our understanding of new gaming experiences. The focus on orchestration work reveals that behind the scenes staff are co-producers of the game and that the playing of games is, therefore, inseparably intertwined with their orchestration. Furthermore, orchestration work is ‘ordinary’ work that relies upon the taken for granted skills and competences of behind the scenes staff; ‘operators’ and ‘authors’ in this case. While we remain focused on the specifics of this game, explication of the ordinary work of orchestration highlights challenges and opportunities for the continued development of gaming experiences more generally. Indeed, understanding the specificities of orchestration work might be said to be a key ingredient of future development.