Moira McGregor

100 days of iPhone use: understanding the details of mobile device use

Internet connected mobile devices are an increasingly ubiquitous part of our everyday lives and we present here the results from unobtrusive audio-video recordings of iPhone use -- over 100 days of device use collected from 15 users. The data reveals for analysis the everyday, moment-by-moment use of contemporary mobile phones. Through video analysis of usage we observed how messages, social media and internet use are integrated and threaded into daily life, interaction with others, and everyday events such as transport, delays, establishment choice and entertainment. We document various aspects of end-user mobile device usage, starting with understanding how it is occasioned by context. We then characterise the temporal and sequential nature of use. Lastly, we discuss the social nature of mobile phone usage. Beyond this analysis, we reflect on how to draw these points into ideas for design.

100 days of iPhone use: mobile recording in the wild

This report presents preliminary results from an unobtrusive video study of iPhone use -- totalling over 100 days of everyday device usage. The data gives us a uniquely detailed view on how messages, social media and internet use are integrated and threaded into daily life, our interaction with others, and everyday events such as transport, communication and entertainment. These initial results seek to address the when, who and what of situated mobile phone use -- beginning with understanding the impact of context. We then characterise three key modes of use found in the data: micro-breaks, digital knitting and reading. Finally we consider the multi-party and shared nature of phone use and who is involved. We reflect on analysis to date, designing from understanding use and future work -- our data provides the resource and scope for further analysis of the moment-by-moment use of contemporary mobile phones.

From in the wild to in vivo: Video Analysis of Mobile Device Use

The explosion of mobile applications and services presents challenges for evaluation and user study. One successful approach has been to deploy instrumented applications, logging their use over long periods of time. We present an expansion of this by remotely recording video and audio of use, while also capturing device and app context. In vivo combines five data collection techniques -- screen recording, ambient audio recording, wearable cameras, data logging and distributed remote uploads. This data provides a range of insights and we discuss examples from previous work which reveal interaction design issues where interface confusions or task mismatches occur. We see how apps are integrated into ongoing activity and environment (such as how maps are used in situ), and how recorded conversations around and about apps may be used for evaluation purposes. We conclude by arguing that this combinative method helps us to move from considering app use in isolation, to studying app use in interaction.

Situating Wearables: Smartwatch Use in Context

Drawing on 168 hours of video recordings of smartwatch use, this paper studies how context influences smartwatch use. We explore the effects of the presence of others, activity, location and time of day on 1,009 instances of use. Watch interaction is significantly shorter when in conversation than when alone. Activity also influences watch use with significantly longer use while eating than when socialising or performing domestic tasks. One surprising finding is that length of use is similar at home and work. We note that usage peaks around lunchtime, with an average of 5.3 watch uses per hour throughout a day. We supplement these findings with qualitative analysis of the videos, focusing on how use is modified by the presence of others, and the lack of impact of watch glances on conversation. Watch use is clearly a context-sensitive activity and in discussion we explore how smartwatches could be designed taking this into consideration.

Caring for Batteries: Maintaining Infrastructures and Mobile Social Contexts

This paper advances the study of batteries in everyday life. We provide a situated understanding of smartphone battery care based on a qualitative user study involving device logging and behavioral tracking to support our inquiry. Our findings depict how caring for batteries fits into everyday routines, the work that is done to prepare and maintain an infrastructure that supports mobile energy needs, and the ways in which batteries are monitored and preserved. Moreover, they illustrate what happens when everyday routines are disrupted and when planning or infrastructure fails, causing flat batteries and the need to apply mechanisms for coping. We build on these insights to propose shifting the research focus from user and device centric approaches towards more contextualized understandings of situated practices. We conclude by discussing the implications of our findings for two increasingly important topics within HCI, personal informatics and the Internet of Things (IoT).

Talking with Conversational Agents in Collaborative Action

This one-day workshop intends to bring together both academics and industry practitioners to explore collaborative challenges in speech interaction. Recent improvements in speech recognition and computing power has led to conversational interfaces being introduced to many of the devices we use every day, such as smartphones, watches, and even televisions. These interfaces allow us to get things done, often by just speaking commands, relying on a reasonably well understood single-user model. While research on speech recognition is well established, the social implications of these interfaces remain underexplored, such as how we socialise, work, and play around such technologies, and how these might be better designed to support collaborative collocated talk-in-action. Moreover, the advent of new products such as the Amazon Echo and Google Home, which are positioned as supporting multi-user interaction in collocated environments such as the home, makes exploring the social and collaborative challenges around these products, a timely topic. In the workshop, we will review current practices and reflect upon prior work on studying talk-in-action and collocated interaction. We wish to begin a dialogue that takes on the renewed interest in research on spoken interaction with devices, grounded in the existing practices of the CSCW community.

Text in Talk: Lightweight Messages in Co-Present Interaction

While lightweight text messaging applications have been researched extensively, new messaging applications such as iMessage, WhatsApp, and Snapchat offer some new functionality and potential uses. Moreover, the role messaging plays in interaction and talk with those who are co-present has been neglected. In this article, we draw upon a corpus of naturalistic recordings of text message reading and composition to document the face-to-face life of text messages. Messages, both sent and received, share similarities with reported speech in conversation; they can become topical resource for local conversation–supporting verbatim reading aloud or adaptive summaries. Yet with text messages, their verifiability creates a distinctive resource. Similarly, in message composition, what to write may be discussed with collocated others. We conclude with discussion of designs for messaging in both face-to-face, and remote, communication.