Graham McAllister

An empirical investigation into the difficulties experienced by visually impaired Internet users

In this paper, an empirical based study is described which has been conducted to gain a deeper understanding of the challenges faced by the visually impaired community when accessing the Web. The study, involving 30 blind and partially sighted computer users, has identified navigation strategies, perceptions of page layout and graphics using assistive devices such as screen readers. Analysis of the data has revealed that current assistive technologies impose navigational constraints and provide limited information on web page layout. Conveying additional spatial information could enhance the exploration process for visually impaired Internet users. It could also assist the process of collaboration between blind and sighted users when performing web-based tasks. The findings from the survey have informed the development of a non-visual interface, which uses the benefits of multimodal technologies to present spatial and navigational cues to the user.

A novel multimodal interface for improving visually impaired people’s web accessibility

This paper introduces a novel interface designed to help blind and visually impaired people to explore and navigate on the Web. In contrast to traditionally used assistive tools, such as screen readers and magnifiers, the new interface employs a combination of both audio and haptic features to provide spatial and navigational information to users. The haptic features are presented via a low-cost force feedback mouse allowing blind people to interact with the Web, in a similar fashion to their sighted counterparts. The audio provides navigational and textual information through the use of non-speech sounds and synthesised speech. Interacting with the multimodal interface offers a novel experience to target users, especially to those with total blindness. A series of experiments have been conducted to ascertain the usability of the interface and compare its performance to that of a traditional screen reader. Results have shown the advantages that the new multimodal interface offers blind and visually impaired people. This includes the enhanced perception of the spatial layout of Web pages, and navigation towards elements on a page. Certain issues regarding the design of the haptic and audio features raised in the evaluation are discussed and presented in terms of recommendations for future work.

Towards developing assistive haptic feedback for visually impaired internet users

Haptic technologies are thought to have the potential to help blind individuals overcome the challenges experienced when accessing the Web. This paper proposes a structured participatory-based approach for developing targeted haptic sensations for purposes of web page exploration, and reports preliminary results showing how HTML elements can be represented through the use of force-feedback. Findings are then compared with mappings from previous studies, demonstrating the need for providing tailored haptic sensations for blind Internet users. This research aims to culminate in a framework, encompassing a vocabulary of haptic sensations with accompanying recommendations for designers to reference when developing inclusive web solutions.

Biometric storyboards: visualising game user research data

Player experience is difficult to evaluate and report, especially using quantitative methodologies in addition to observations and interviews. One step towards tying quantitative physiological measures of player arousal to player experience reports are Biometric Storyboards (BioSt). They can visualise meaningful relationships between a players physiological changes and game events. This paper evaluates the usefulness of BioSt to the game industry. We presented the Biometric Storyboards technique to six game developers and interviewed them about the advantages and disadvantages of this technique.

Improving web accessibility using content-aware plug-ins

This paper describes a novel approach to improve blind and visually impaired peoples access to the Web by using a content-aware Web browser plug-in coupled with audio and haptic tools. The Web plug-in accesses the current mouse position on-screen, and makes the co-ordinates available to the audio and haptic modalities. This allows the user to be informed when they are in the vicinity of an image or hyperlink; previously they would only have been informed when they are physically on the link. Thus, when the user is close to an image or hyperlink, haptics and audio will be used to inform and guide them to the actual spatial position. The Web browser plug-in and the associated audio and haptic feedback tools are described in the paper. Finally, results from a pilot study on the usability of this system are also presented.

A grid-based extension to an assistive multimodal interface

This paper describes an extension to a multimodal system designed to improve Internet accessibility for the visually impaired. Here we discuss the novel application of a grid (patent pending) to our assistive web interface. Findings from our evaluation have shown that the grid enhances interaction by improving the user.s positional awareness when exploring a web page.

A semiotic approach to the design of non-speech sounds

In the field of auditory display there is currently a lack of theoretical support for the design of non-speech sounds as elements of a user interface. Sound design methods are often based on ad hoc choices or the personal preferences of the designer. A method is proposed in this paper based on a semiotic approach to the design of non-speech sounds. In this approach, the design process is conceptualised by referring to structural semiotics, acknowledging the unique qualities of non-speech sounds, as a mode of conveying information. This method is based on a rich use scenario presented to a design panel. A case study where the design method has been applied is presented and evaluated. Finally recommendations for a practical design method are presented supported by this empirical investigation.

Improving Gameplay with Game Metrics and Player Metrics

Designing and developing video games is typically a long and demanding process. The overall aim of developing a game that is enjoyable and rewarding to play for everyone is a complex one due to the diversity of players who may potentially interact with the game. Understanding how players interact and behave during gameplay is of vital importance to developers. An accurate understanding of the gameplay experience during development can help identify and resolve any potential problem areas before release, leading to a better player experience and arguably, greater game review scores and sales. There are two main sources from which potentially useful data can be extracted: the video game (game metrics), and the player (player metrics).

A non-visual approach to improving collaboration between blind and sighted internet users

Assistive technologies have widened access to the Web, by providing a non-visual representation of page content for blind individuals. However, restrictions imposed by screen readers and Braille output devices have led to the development of mental representations of a web page, which differ considerably from the visual layout. As a result, both blind and sighted users find it difficult to perform joint web-based tasks. In this paper, we have applied a structured participatory-based approach to develop haptic sensations to assist the collaborative process. Preliminary results are reported and on-going development is discussed. It is anticipated that findings from the study will inform a haptic framework, which will assist developers when designing an accessible collaborative interface, using the benefits which the sense of touch can offer.

An adaptive & adaptable approach to enhance web graphics accessibility for visually impaired people

To date, efforts have been made to enable visually impaired people to gain access to graphics on the Internet. However, these studies only offer a solution for a specific type of graphic by using a fixed set of hardware. To address this, a design approach of an adaptive and adaptable architecture is introduced which adapts to different graphical content, input/output devices (including assistive technologies) and users profile and preferences. This system brings the opportunity to visually impaired people to gain access to graphics via different modalities by providing an adequate accessibility interface and interaction based on their profiles and needs.