Zeeshan Asghar

Remote assistance using visual prompts for demented elderly in cooking

This paper presents a smart kitchen system for supporting demented elderly cooking in a kitchen. In this system, a remote supporter provides a user with verbal and visual prompts manually. As a prompting method for this system projection should be chosen as a priority because it enables direct pointing of targets in a real scene. Even if projection is used as a priority, this system should be designed to solve three practical problems: 1) there are many areas where sharp images cannot be projected in a kitchen, 2) kitchen is a too complex environment to display visual prompts using only a single method, 3) remote supporters do not know the kitchen environment well enough. In this paper we propose a novel system overcoming the above problems as follows, respectively.1) The system first tries indirect projection of circular markers as visual prompts around target objects.2) Proper method is automatically selected from using projector, embedded monitor and illumination devices based on environmental information.3) The system automatically acquires flat surfaces to project on and their reflectance properties as the environmental information. Based on an observation of two elderly suffering from dementia, we discuss the feasibility and concrete problems in displaying visual prompt and how to solve them technically.

Conceptual design and implementation of Indicator-based Smart Glasses: A navigational device for remote assistance of senior citizens suffering from memory loss

The development of wearable technologies has generated considerable interest in the last decade. It opens doors to the emergence of user-centered assistive technologies, which are targeting senior citizens suffering from memory loss. This paper is dedicated to introducing the conceptual, behavioural and architectural design of a remote controllable head mounted display. The Indicator-based Smart Glasses are designed to assist senior citizens in daily navigational tasks with the guidance of human remote caretakers. The use of eyeglasses among the senior citizens is quite common, and it derived us to construct navigation interface prototype by implanting a set of light-emitting diode indicators on the frame of eyeglasses. The system aims to provide senior citizens with visual cues that could be perceived intuitively for navigational commands. Furthermore, the system would improve the independent mobility of senior citizens. The global positioning system- and geographical information system-based location-aware system could be integrated into Indicator-based Smart Glasses to facilitate the remote assisting process. The research method of the study is constructive design science with applied qualitative and quantitative approaches to improve and evaluate the system. The Living Lab, Wizard of Oz methods, plus observation and interviews are used to evaluate and improve the system through iterative pilot and usability tests.

Work step indication with grid-pattern projection for demented senior people

This paper proposes a work step indication method for supporting daily work with a grid-pattern projection. To support an independent life of demented senior people, it is desirable that an instruction is easy to understand visually and not complicated. The proposed method in this paper uses a range image sensor and a camera in addition to a projector. A 3D geometry of a target scene is measured by the range image sensor, and the grid-pattern is projected onto the scene directly. Direct projection of the work step is easier to be associated with the target objects around the assisted person, and the grid-pattern is a solution to indicate the spatial instruction. A prototype has been implemented and has demonstrated that the proposed grid-pattern projection is easy to show the work step.

Design For all case study: A navigation aid for elderly persons

This study presents a body worn laser device as an appropriate navigation aid for the people suffering from dementia. The study is based on award-winning “Smart Navigation for Seniour Citizen” concept that was presented at Design For All Foundation 2012 International competition. The wearable mobile system which consists of a camera and a laser pointer is a chest worn device equipped with laser projection-based arrows to guide the people suffering from dementia in indoor/outdoor mobility. This device is able to provide navigation aid to the people suffering from dementia in complex and unknown areas; it also helps the user to identify the real objects. A remote caregiver can easily get the scene where the demented person seeing and can guide the directions with laser projected arrows and directly pointing at the real objects with a laser pointer. In this paper we will explain the usability of chest-worn system in indoor/outdoor environments. The results of an indoor field test conducted with real end users are presented. Results reveal the validity and effectiveness of the chest-worn system in the complex and unknown areas.

Augmented processes: a case study in healthcare

A fundamental transformation of services is underway. The public and private services are recognized as the new source of productivity growth and dynamism in economy. Modern economies are soon 90% based on services. Information and Communication technologies (ICT) are a key factor in this development. We explore how ICT can be used to improve healthcare processes by using the research framework of the Value Creation in Smart Living Environment for Senior Citizen (VESC) project. Two new concepts: Augmented Processes and Mist Computing are proposed. We demonstrate these concepts in the context of processes dealing with remote assistance of senior citizen in outdoor navigation and in kitchen assistance for meal preparation. Additionally, we perform a case study in the Helsinki Meilahti Hospital where we developed a mobile application called Ping App to demonstrate the idea of Augmented Processes to improve healthcare workflows and to identify possible improvements.

Developing mobile services for specific user groups using virtual environments

Specifying customized mobile and ubiquitous services for special needs group, such as the elderly is a difficult task. Customized services are needed to reflect different health care issues. To test and develop new customized mobile and ubiquitous services, a mixed reality virtual test platform is proposed. The architecture of the test platform combines real sensor data to obtain the context, with the RealXtend virtual environment. Specific user processes are defined using QFD which is also used in the development of appropriate services. This paper lays out the general architecture for the system, how real sensors interact with RealXtend and how the individual processes is discovered using QFD and RealXtend.

Twinkle Megane: Near-Eye LED Indicators on Glasses for Simple and Smart Navigation in Daily Life

We present an eyeglass-type wearable device that has light emitting diode (LED) indicators on the frame of it. The device produces lighting patterns of 14 RGB LEDs near user’s eyes as guiding information. Since installed LEDs on the frame of glasses are light and saving power, it is feasible to develop it for daily use. On the other hand, it cannot provide rich information such as text or images. In this study, we aim to realize a remote assistive system that provides assistive commands by lighting patterns of the eyeglass-type device from remote sites. Especially, we consider elderlies who are suffering from mild cognitive impairment as users. They would be one of potential user groups since the device does not block their sights by text or images and it can be worn in daily life without the additional sense of restraint. This paper explains our conceptual assistive system structure, a prototype eyeglass-type device with near-eye LED indicators and usability experimentation in simple navigational tasks.

Remote Assistance for Elderly to Find Hidden Objects in a Kitchen

Remote assistive technologies are one of the most promising solutions for an aging society in the future. This paper describes a design of a remote assistive system to guide elderly to find and recognize hidden objects in a kitchen through ubiquitous technologies utilizing sensing and light projection. These intelligent technologies can play a vital role in taking care of the elderly with cognitive impairments when the caregiver’s lives or work far away. The main goal of this research is to provide visual guidance to elderly to overcoming the deficits of initiation, planning, attention and memory deficits while performing kitchen-based activities of daily living such as locating and identifying items for cooking. In a standard kitchen where objects can be placed in open and closed spaces, it is difficult for elderly with cognitive impairment to find and locate objects that are invisible and sometimes hidden behind other objects. In this situation the RFID technology can directly provide the location of the items and projection technology can display the image of the object at the exact location. An initial prototype has been developed and a user study with twelve elderly people has been conducted. The initial results show that the visual guidance makes the task of finding and identifying objects easier and simpler. Additionally, results show promise for further development and system can be used for other kitchen activities.

Internet of Things Controlled Home Objects for the Elderly.

The number of elderly people suffering from physical or cognitive difficulty is increasing continuously. Elderly people prefer to live in their familiar environment where they can easily perform different activities of their daily life which is also good for their mental and physical well-being. Internet of Things is a mechanism through which any objects can be monitored, controlled, and manipulated. In order to develop efficient application for the elderly living at home independently, the researcher should be aware of the home objects as well as of the living environment. This study uses systematic literature review to determine applications developed to assist elderly people inside their home. A total of 25 primary studies are identified. With the analysis of those studies, important and relevant objects in the daily life of the elderly are identified. Using the results from the review, a new scenario of home environment is visualized. The visualization is expected to provide caretakers with a better view of the living condition of the elderly and position and state of the home objects. This new home scenario is expected to offer a secure and easy living environment for the elderly, where Internet of Things can be used to control all the frequently used home objects by the elderly.

Twinkle Megane: Evaluation of Near-Eye LED Indicators on Glasses for Simple and Smart Navigation in Daily Life

We present an eyeglass-type wearable device that has light emitting diode (LED) indicators on the frame. The device produces lighting patterns of 14 RGB LEDs near user’s eyes as guiding information. Since installed LEDs are light and saving power, it is feasible to develop it for daily use. On the other hand, it cannot provide rich information such as text or images. In this study, we aim to realize a remote assistive system that provides assistive commands by visual cues from remote sites. Especially, we consider elderlies who are suffering from mild cognitive impairment as users. They would be one of potential user groups since the device does not block their sights by text or images and it can be worn in daily life without the additional sense of restraint. This paper explains our conceptual assistive system structure, a prototype eyeglass-type device with near-eye LED indicators and usability experimentation in simple detecting and walking navigational tasks. Received on 21 November 2016; accepted on 05 September 2017; published on 07 September 2017