Kenryu Nakamura

How do members of different language communities compose sentences with a picture-based communication system?—a cross–cultural study of picture–based sentences constructed by English and Japanese speakers

A number of picture-based communication systems are in use by nonspeaking people. They are not widely used in Japan. This may be because the systems, although pictorial in nature, tend to be based on English sentence formation. This study was conducted to provide a basis for a discussion about the use by people in non-English-speaking cultures of graphic-based communication aids developed in English-speaking countries. Subjects (80 Japanese and 43 English speakers) were asked to compose picture-based sentences using a computer-based system. The order of graphic symbols on the screen and the effects of syntax markers were investigated as independent variables. The results show that syntax markers and the symbol order had an important effect on the sentences produced by Japanese-speaking subjects. In addition, both the Japanese and the English speakers omitted words when using the picturebased communication system as compared to using speech.

The comparative and developmental study of auditory information processing in autistic adults

The present study examined brain functions related to information processing in autistic subjects, using auditory evoked potentials (AEP) and missing stimulus potentials (MSP). In order to study the development of autism, autistic adults served as subjects. Normal adults and children also served as control groups. Both normal and autistic adults showed normal patterns and lateralities with respect to AEP for music stimuli, but normal children did not show such matured patterns and lateralities. On the other hand, with respect to MSP, autistic adults showed matured patterns with a specific laterality. These results suggest that autistic subjects might develop some cognitive functions.

A Cross-Cultural Study on the Interpretation of Picture-Based Sentences

The purpose of this study is to clarify how Japanese and English speakers interpret picture-based sentences. Two studies were conducted, one with adults and one with children. The main task is to interpret eight picture-based sentences in two word-order conditions, SVO and SOV. These two conditions reflect the natural word orders of Japanese and English, respectively. The results suggest that word order was a more important cue for native English speakers than for native Japanese speakers in interpreting picture-based sentences. English speakers had more difficulty with picture symbols arrayed in SOV order than SVO. Japanese speakers had the most difficulty with missing syntactic particles in both word orders; successful interpretation sometimes depended on the particular meaning of the nouns and verbs in the sentences. This may be because English word order is more fixed, while Japanese word order has greater variance and capitalizes on syntax markers to clarify the meaning of a sentence.

A rapid multi-lingual communicator for non-speaking people and others

Computer-based systems that are developed to assist people with severe disabilities can often have interesting wider applications. A computer-based communication system has been developed to give non-speaking people multi-lingual capability. It is based on developments in this field in conversational modelling and utterance prediction, making use of pre-stored material. The system could also be used by people whose only communication disadvantage is not being able to speak a foreign language. The system consists of a large store of reusable conversational material duplicated in several languages and a model of conversation which allows the system to link the items together into appropriate sequences. A unique feature of the system is that both the non-speaking person and the communication partner use the communicator in their dialogue. In comparison with a multi-lingual phrase book, the system helped users to have a more natural conversation, and to take more control of the interaction.

Designing for ordinary and extraordinary users

There are a number of arguments which can be advanced to convince designers to take all potential users into account at the initial stages of any design process. In the US and to some extent in Europe, legislation requires that people with disabilities are not marginalised. This kind of legislation embodies the social and ethical values that all people matter, but also practical issues such as ensuring that a society benefits fully from the contributions which all of its citizens can make.

A multi-lingual augmentative communication system

A positive aspect of aiming for universal design is that solutions developed for people with particular needs can prove of benefit to all users. Such a case is described here. A prototype augmentative communication system has been developed which could give non-speaking people a multilingual capability. It is based on research into conversational modelling and utterance prediction, making use of prestored material. In fact, the system could also be used by people whose only communication disadvantage is not being able to speak a foreign language. A unique feature of the system is that both the non-speaking person and the communication partner will use this communicator in their dialogue. In comparison with a multi-lingual phrase book, the system helped the users to have more natural conversation, and to take more control of the interaction.