Slim Kammoun

Fusion of Artificial Vision and GPS to Improve Blind Pedestrian Positioning

Orientation and mobility are tremendous problems for Blind people. Assistive technologies based on Global Positioning System (GPS) could provide them with a remarkable autonomy. Unfortunately, GPS accuracy, Geographical Information System (GIS) data and map-matching techniques are adapted to vehicle navigation only, and fail in assisting pedestrian navigation, especially for the Blind. In this paper, we designed an assistive device for the Blind based on adapted GIS, and fusion of GPS and vision based positioning. The proposed assistive device may improve user positioning, even in urban environment where GPS signals are degraded. The estimated position would then be compatible with assisted navigation for the Blind. Interestingly the vision module may also answer Blind needs by providing them with situational awareness (localizing objects of interest) along the path. Note that the solution proposed for positioning could also enhance autonomous robots or vehicles localization.

NAVIG: Guidance system for the visually impaired using virtual augmented reality

Finding ones way to an unknown destination, navigating complex routes, finding inanimate objects; these are all tasks that can be challenging for the visually impaired. The project NAVIG (Navigation Assisted by artificial VIsion and GNSS) is directed towards increasing the autonomy of visually impaired users in known and unknown environments, exterior and interior, large scale and small scale, through a combination of a Global Navigation Satellite System (GNSS) and rapid visual recognition with which the precise position of the user can be determined. Relying on geographical databases and visually identified objects, the user is guided to his or her desired destination through spatialized semantic audio rendering, always maintained in the head-centered reference frame. This paper presents the overall project design and architecture of the NAVIG system. In addition, details of the new type of detection and localization device are presented in relation to guidance directives developed through participative design with potential users and educators for the visually impaired. A fundamental concept in this project is the belief that this type of assistive device is able to solve one of the major problems faced by the visually impaired: their difficulty in localizing specific objects.

Route selection algorithm for Blind pedestrian

The vast majority of existing route selection processes is designed for vehicle navigation. In this paper we describe an adapted routing algorithm for visually impaired pedestrians based on users needs. Our aim was to find the most adapted route that connects origin and destination points, and which can provide the Blind with a sparse but helpful mental representation of the itinerary and surroundings. Based on multiple brainstorming sessions and interviews with blind people and an orientation and mobility (O&M) instructor, different classes of objects were defined and tagged in the Geographical Information System. The optimal route was then selected using the Dijkstra algorithm. This method will be used in NAVIG (Navigation Assisted by Artificial VIsion and GNSS), an assistive device for the Blind, whose aim is to improve orientation, mobility and objects localization.

Towards a geographic information system facilitating navigation of visually impaired users

In this paper, we propose some adaptation to Geographical Infor-mation System (GIS) components used in GPS based navigation system. In our design process, we adopted a user-centered design approach in collaboration with final users and Orientation and Mobility (O&M) instructors. A database scheme is presented to integrate the principal classes proposed by users and O&M instructors. In addition, some analytical tools are also implemented and integrated in the GIS. This adapted GIS can improve the guidance process of existing and future EOAs. A first implementation of an adapted guidance process allowing a better representation of the surroundings is provided as an illustration of this adapted GIS. This work is part of the NAVIG system (Navigation Assisted by Artificial VIsion and GNSS), an assistive device, whose aim is to improve the Quality of Life of Visually Impaired (VI) persons via increased orientation and mobility capabilities.

Méthodes et outils de conception participative avec des utilisateurs non-voyants

Participatory Design is a process for the design of interactive systems integrating the user in all design phases. However it is based on the assumption that users are in possess of their full physical capabilities, in particular the visual sense, and thus is for the most part not adapted for working with visually impaired people. In this article we present an approach for using participatory design when working with blind people. We start with an analysis of the existing methods, in which we discuss their limits concerning accessibility for the blind, and the peculiarities of blind users. Afterwards we present how we have adapted the classical design methods during our design process and we show the results of our project. We conclude with some recommendations and future working propositions.

Using wrist vibrations to guide hand movement and whole body navigation

Summary In the absence of vision, mobility and orientation are challenging. Audio and tactile feedback can be used to guide visually impaired people. In this paper, we present two complementary studies on the use of vibrational cues for hand guidance during the exploration of itineraries on a map, and whole body-guidance in a virtual environment. Concretely, we designed wearable Arduino bracelets integrating a vibratory motor producing multiple patterns of pulses. In a first study, this bracelet was used for guiding the hand along unknown routes on an interactive tactile map. A wizard-of-Oz study with six blindfolded participants showed that tactons, vibrational patterns, may be more efficient than audio cues for indicating directions. In a second study, this bracelet was used by blindfolded participants to navigate in a virtual environment. The results presented here show that it is possible to significantly decrease travel distance with vibrational cues. To sum up, these preliminary but complementary studies suggest the interest of vibrational feedback in assistive technology for mobility and orientation for blind people.

Designing a Virtual Environment Framework for Improving Guidance for the Visually Impaired

Electronic Orientation Aids are dedicated to orientation assistance for the visually impaired. They are made of at least 3 essential components: 1) A positioning system (e.g. GPS); 2) A Geographical Information System (GIS) that includes both a digitised map and a software designed to select routes, track the traveller’s path, and provide him with navigation information; 3) A User Interface (UI) that relies on nonvisual (usually auditory or tactile) interaction

Toward a better guidance in wearable electronic orientation aids

Electronic Orientation Aids (EOA) usually guide visually impaired pedestrians using turn-by-turn instructions. However, several studies have demonstrated that mental representations of space seem difficult to build when turn-by-turn instructions only are provided. This is a crucial point as getting an accurate spatial representation of the surroundings can make the difference between successful and unsuccessful navigation. In this paper, we describe components of a guidance system designed to provide a better service in wearable electronic orientation aids for the visually impaired. They especially include non-visual landmarks and points of interest that are used as environmental features to improve mental spatial representations.

Multimodal virtual environment subserving the design of electronic orientation aids for the blind

In the last few decades, a growing number of Electronic Orientation Aids (EOA) has been developed with the purpose of improving the autonomy of visually impaired people. However, the majority of those systems are not used by the blind due to limited usability. The main challenges to be addressed are about interaction and guidance. To address these issues, we designed a multimodal (input and output) Virtual Environment (VE) that simulates different interactions that could be used for space perception and guidance in an EOA. This platform subserves two goals: help designers to systematically test guidance strategies (i.e. for the development of new EOAs) and train blind people to use interactive EOAs, with an emphasis on cognitive mapping enhancement. In a multimodal VE, both objectives are assessed in a controlled, cost-effective, safe and flexible environment.

SIG: NVI (non-visual interaction)

In recent years there has been a surge in the development of non-visual interaction techniques targeting two application areas: making content accessible to visually impaired people, and supporting minimal attention user interfaces for situationally impaired users. This SIG aims to bring together the community of researchers working around non-visual interaction techniques for people of all abilities. It will unite members of this burgeoning community in a lively discussion and brainstorming session. Attendees will work to identify and report current and future research challenges as well as new research avenues.