Gavin Smyth

SenseCam: a retrospective memory aid

This paper presents a novel ubiquitous computing device, the SenseCam, a sensor augmented wearable stills camera. SenseCam is designed to capture a digital record of the wearers day, by recording a series of images and capturing a log of sensor data. We believe that reviewing this information will help the wearer recollect aspects of earlier experiences that have subsequently been forgotten, and thereby form a powerful retrospective memory aid. In this paper we review existing work on memory aids and conclude that there is scope for an improved device. We then report on the design of SenseCam in some detail for the first time. We explain the details of a first in-depth user study of this device, a 12-month clinical trial with a patient suffering from amnesia. The results of this initial evaluation are extremely promising; periodic review of images of events recorded by SenseCam results in significant recall of those events by the patient, which was previously impossible. We end the paper with a discussion of future work, including the application of SenseCam to a wider audience, such as those with neurodegenerative conditions such as Alzheimers disease.

The use of a wearable camera, SenseCam, as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: A preliminary report

This case study describes the use of a wearable camera, SenseCam, which automatically captures several hundred images per day, to aid autobiographical memory in a patient, Mrs B, with severe memory impairment following limbic encephalitis. By using SenseCam to record personally experienced events we intended that SenseCam pictures would form a pictorial diary to cue and consolidate autobiographical memories. After wearing SenseCam, Mrs B plugged the camera into a PC which uploaded the recorded images and allowed them to be viewed at speed, like watching a movie. In the control condition, a written diary was used to record and remind her of autobiographical events. After viewing SenseCam images, Mrs B was able to recall approximately 80% of recent, personally experienced events. Retention of events was maintained in the long-term, 11 months afterwards, and without viewing SenseCam images for three months. After using the written diary, Mrs B was able to remember around 49% of an event; after one month with no diary readings she had no recall of the same events. We suggest that factors relating to rehearsal/re-consolidation may have enabled SenseCam images to improve Mrs Bs autobiographical recollection.

Smartback: supporting users in back navigation

This paper presents the design and user evaluation of SmartBack, a feature that complements the standard Back button by enabling users to jump directly to key pages in their navigation session, making common navigation activities more efficient. Defining key pages was informed by the findings of a user study that involved detailed monitoring of Web usage and analysis of Web browsing in terms of navigation trails. The pages accessible through SmartBack are determined automatically based on the structure of the users navigation trails or page association with specific users activities, such as search or browsing bookmarked sites. We discuss implementation decisions and present results of a usability study in which we deployed the SmartBack prototype and monitored usage for a month in both corporate and home settings. The results show that the feature brings qualitative improvement to the browsing experience of individuals who use it.

SenseCam improves memory for recent events and quality of life in a patient with memory retrieval difficulties.

A wearable camera that takes pictures automatically, SenseCam, was used to generate images for rehearsal, promoting consolidation and retrieval of memories for significant events in a patient with memory retrieval deficits. SenseCam images of recent events were systematically reviewed over a 2-week period. Memory for these events was assessed throughout and longer-term recall was tested up to 6 months later. A written diary control condition followed the same procedure. The SenseCam review procedure resulted in significantly more details of an event being recalled, with twice as many details recalled at 6 months follow up compared to the written diary method. Self-report measures suggested autobiographical recollection was triggered by the SenseCam condition but not by reviewing the written diary. Emotional and social wellbeing questionnaires indicated improved confidence and decreased anxiety as a result of memory rehearsal using SenseCam images. We propose that SenseCam images provide a powerful boost to autobiographical recall, with secondary benefits for quality of life.

The neural basis of effective memory therapy in a patient with limbic encephalitis

Background: An fMRI study is described in which a postencephalitic woman with amnesia used a wearable camera which takes photographs passively, without user intervention, to record and review recent autobiographical events. “SenseCam” generates hundreds of images which can subsequently be reviewed quickly or one by one. Results: Memory for a significant event was improved substantially when tested after 4.5 weeks, if the patient viewed SenseCam images of the event every 2 days for 3 weeks. In contrast, after only 3.5 weeks, her memory was at chance levels for a similarly significant event which was reviewed equally often, but using a written diary. During the fMRI scan, the patient viewed images of these two events, plus images of an unrehearsed event and images from a novel “control” event that she had never experienced. There was no difference in behavioural responses or in activation when the unrehearsed and novel conditions were compared. Relative to the written-rehearsed condition, successful recognition of the images in the SenseCam-rehearsed condition was associated with activation of frontal and posterior cortical regions associated with normal episodic memory. Conclusion: SenseCam images may provide powerful cues that trigger the recall and consolidation of stored but inaccessible memories.

An exploratory case study of the impact of ambient biographical displays on identity in a patient with Alzheimer's disease

One of the most troubling symptoms of Alzheimers disease is the loss of the patients sense of identity. This loss complicates relationships, increases apathy, and generally impedes quality of life for the patient. We describe a novel in-home ambient display called Biography Theatre that cycles through music, photographs, movies, and narratives drawn from the patients past and current life. We conducted an exploratory case study with an 84-year-old male with moderate-stage Alzheimers disease (Mr H). The study consisted of three phases: a baseline phase, a phase wherein autobiographical materials were collected and discussed, and a phase wherein the display was deployed in the home. The patient demonstrated improvement on standardised tests of apathy and positive self-identity, but did not improve on tests of autobiographical memory, anxiety, depression, and general cognition. We also report on caregiver reactions to the intervention and how the display helped them cope with and reinterpret their loved ones condition. This work suggests that interdisciplinary work involving “off the desktop” computing technologies may be a fruitful way to provide rehabilitative benefit for individuals with Alzheimers disease.

Predictive Algorithms for Browser Support of Habitual User Activities on the Web

Routine user activities on the Web result in the revisitation of Web sites and pages. Standard browser applications provide limited support for this type of habitual behaviour. They typically expose lists of visited URLs that are automatically recorded by the system or manually created by the user, such as bookmarks. Studies have shown that these approaches are not successful in supporting routine user activities. Informed by our user research, we designed a browser feature that automatically exposes candidate URLs for revisitation by the user. In this paper, we describe and evaluate the algorithms that we use to model the users habitual behaviour. We demonstrate how a structured navigation history model facilitates the discovery of relevant usage patterns and supports predictive algorithms that are applicable to relatively short personal navigation histories.

Finding Email in a Multi-Account, Multi-Device World

Email is far from dead; in fact the volume of messages exchanged daily, the number of accounts per user, and the number of devices on which email is accessed have been constantly growing. Most previous studies on email have focused on management and retrieval behaviour within a single account and on a single device. In this paper, we examine how people find email in todays ecosystem through an in-depth qualitative diary study with 16 participants. We found that personal and work accounts are managed differently, resulting in diverse retrieval strategies: while work accounts are more structured and thus email is retrieved through folders, personal accounts have fewer folders and users rely primarily on the built-in search option. Moreover, retrieval occurs primarily on laptops and PCs compared to smartphones. We explore the reasons, and uncover barriers and workarounds related to managing multiple accounts and devices. Finally, we consider new design possibilities for email clients to better support how email is used today.

A small space for playful messaging in the workplace: designing and deploying Picco

We present Picco, a tiny situated display for drawings and simple animations, which are created on a dedicated tablet app. Picco was designed to support playful messaging in the workplace through a glanceable desktop device that would place minimal demands on users. Two studies of the device at work demonstrated how crafting was an expression of intimacy when the device was used to connect the workplace to the home, and a way of demonstrating skill and humor to a broad audience when messages were sent amongst co-workers. However, the level of skill needed to produce these messages became a barrier to entry for some co-workers. Our findings suggest that visible ownership of a situated device, which can be personalized in other ways, can underpin a secondary level of participation that is crucial in supporting a sense of involvement when the level of crafting required can stifle more direct participation.