Jaakko Hyry

Remote assistance using visual prompts for demented elderly in cooking

This paper presents a smart kitchen system for supporting demented elderly cooking in a kitchen. In this system, a remote supporter provides a user with verbal and visual prompts manually. As a prompting method for this system projection should be chosen as a priority because it enables direct pointing of targets in a real scene. Even if projection is used as a priority, this system should be designed to solve three practical problems: 1) there are many areas where sharp images cannot be projected in a kitchen, 2) kitchen is a too complex environment to display visual prompts using only a single method, 3) remote supporters do not know the kitchen environment well enough. In this paper we propose a novel system overcoming the above problems as follows, respectively.1) The system first tries indirect projection of circular markers as visual prompts around target objects.2) Proper method is automatically selected from using projector, embedded monitor and illumination devices based on environmental information.3) The system automatically acquires flat surfaces to project on and their reflectance properties as the environmental information. Based on an observation of two elderly suffering from dementia, we discuss the feasibility and concrete problems in displaying visual prompt and how to solve them technically.

PiTaSu: wearable interface for assisting senior citizens with memory problems

Abstract Little research has been carried out on specialized wearable input interfaced designs to assist memory impaired senior citizens. This paper proposes and implements PiTaSu (Picture based Tapping on wall Surfaces) to realize a direct input interface system to offer visual feedback and tactile feedback. PiTaSu is based on a pictorial based Augmentative and Alternative Communication (AAC) system. PiTaSu consists of a body-worn or shoulder-attached mobile projector, a camera and an accelerometer wrist band. The projector shows information that will help assist the memory impaired senior citizen in their daily task. The camera and the accelerometer detect a tapping position and tapping trigger. Experimental results have demonstrated that a senior citizen can use PiTaSu without learning special skills, and the projection based user interface has potential. Therefore, PiTaSu can assist memory-impaired senior citizens as a daily task reminder.

User interaction in smart ambient environment targeted for senior citizen

Many countries are facing a problem when the age-structure of the society is changing. The numbers of senior citizen are rising rapidly, and caretaking personnel numbers cannot match the problems and needs of these citizens. Using smart, ubiquitous technologies can offer ways in coping with the need of more nursing staff and the rising costs of taking care of senior citizens for the society. Helping senior citizens with a novel, easy to use interface that guides and helps, could improve their quality of living and make them participate more in daily activities. This paper presents a projection-based display system for elderly people with memory impairments and the proposed user interface for the system. The user’s process recognition based on a sensor network is also described. Elderly people wearing the system can interact the projected user interface by tapping physical surfaces (such as walls, tables, or doors) using them as a natural, haptic feedback input surface.

Requirements guideline of assistive technology for people suffering from dementia

This paper presents valid concerns on current status of elderly population suffering from dementia, why societies should focus more attention in helping them and how this could impact healthcare and social services. This paper also discusses the requirements and methods, which can be used to improve the design process of wearable procam device using Picture based Input Method Using Tapping on Wall Surfaces (PiTaSu) that can help people suffering from dementia. A guideline of proposed requirements is presented that takes into account several different types of problems people suffering from dementia face. An improved user interface (UI) is proposed for people suffering from dementia, as well as the need to implement separate tele-assistance functionality for the informal and formal caretakers.

A user interface design for the elderly using a projection tabletop system

We present a design of a user interface on a projection tabletop system for the elderly. Nowadays, the population imbalance between the elderly who require daily care and caregivers is being one of global social issues since the population aging advances. Additionally, if the amount of the elderly with memory problem increases, the imbalanced situation makes the elderly worse because of few caregivers, then a negative chain reaction would be occurred. In order to avoid the worst situation, we believe that it is important to support the daily lives of the elderly persons at the early stage for reducing aging effects. In this research, we challenge to develop the internet-connected assistive system to support their daily lives individually in order to help them manage their time without the need for caregivers support on location. We focus on projection technology to display visual information onto physical surfaces such as tables or walls especially for indoor use. The projection technology does not require embedding other displays such as LCD into tables or walls that the users have already owned, and to hold or wear the special devices in hands or on heads. Also we apply interactive functions for the design that lets the users think and decide by themselves, since the quality of lives of the elderly needs to be considered to keep them from just following the given instruction without thinking. Finally, we have decided three designs of graphical user interface on the projection tabletop system through a brief user test. In this paper we show the thee different interaction methods based on the graphical user interface designs and one of augmented reality applications as an example of a practical use of the system.

Senior citizens' interaction with smart ambient environment

In society where the numbers of elderly people is growing rapidly, there is an urgent need to have smart ambient environments. It is important to design novel user interfaces for senior citizens to ease their daily lives. This paper presents a projection based display system for elderly people with memory problem. The proposed user interface for the system is also described as well as the required infrastructure of sensor networks and users process detection. Elderly people wearing the system can interact by tapping physical surfaces surrounding them (such as walls, tables or doors) as an input surface.

A laser projection-based tele-guidance system embedded on a mobility aid

This paper presents a tele-guidance system for elderly people so that they can walk outdoors without an escort and their caregivers can monitor them or guide them from remote site when they are in a need of help. The feature point of the proposed system is to adopt laser projection with consideration for use outdoor. Because the laser projection shows the arrow, which indicates a direction, all a user needs to do is to follow it intuitively. The goal of this study is to realise a tele-guidance system, which provides easy understanding for elderly users with mild dementia, with laser projection. The whole system including this proposed system aims to make preparations for a super-graying society by connecting elderly people and caregivers effectively via ubiquitous network. As a first step, a prototype system was developed and a user test was conducted with elderly participants. In the result, some technical problems and visibility problems on the projected arrow were found.

Implementation of a picture based user interface to assist the elderly suffering from memory problems

The development of user interface technologies for elderly people with memory problems is a difficult task. This paper proposes a wearable projection based communication system and communication language based on path based structured user interface. The path based user interface is based on Augmentive and Alternative communication systems which focus on picture communication. A conceptualized view of this communication channel is modeled on an abstract level using User Interface Description Language which will provide the best support for various different wearable solutions. The Projection interface consists of a camera, projector and acceleration sensor which detects the users input operation by tap operations.