Yoichi Nagashima

Real-Time Interactive Performance with Computer Graphics and Computer Music

Abstract This is a report of some applications of human-machine systems and humancomputer interaction about experimental multimedia performing arts. The human performer and the computer systems perform computer graphics and computer music interactively in real-time. As the technical point of view, this paper is intended as an investigation of some special approaches: (1) real-time processing and communication system for performing arts, (2) original sensors and pattern detecting techniques, (3) distributed system using many computers for convenience to compose, arrange and perform.

Multimedia interactive art: system design and artistic concept of real-time performance with computer graphics and computer music

This is the report of some applications of human-computer interaction about experimental performances of multimedia interactive arts. The human performer and the computer systems perform computer graphics and computer music interactively in real-time. As the technical point of view, this paper is intended as an investigation of some special approaches : (1) the idea of “chaos” information processing techniques used in the musical part, (2) real-time communication system for the message of performance, (3) some original sensors and pattern detecting techniques, (4) distributed system using many computers for convenience to develop and to arrange.

“Improvisession-II”: A Performing/Composing System for Improvisational Sessions with Networks

This paper is intended as an investigation of new interactive environment in music. I will describe two types of performing/composing systems for improvisational sessions with networks and a concept called “GDS (Global Delayed Session) music”. These systems are called “Improvisession-I” and “Improvisession-II”, and this paper reports not only the basic idea but also the latest version and applications in education and entertainment.

Virtual performer: an environment for interactive multimedeia art

This paper describes the overview of the Virtual Performer which is designed to compose and perform interactive multimedia arts with it. The Virtual Performer consists of sensory facilities, presentation facilities and authoring facilities. The sensory facilities consist of various transducers units Its plug-in style offers users the free and optimal set up of sensors. The presentation facilities are MIDI, digital sound processing, CG generation and interactive Video controls. The authoring facilities offer two ways to design scenarios. One is to write recognition-action rules. The other is normal sequencing technique. It is mainly used to switch the scene and the former is mainly used to model the world of each scene. This paper shows some ongoing activities to produce multimedia art with the virtual Performer.

Towards the Biofeedback Game - with Interoception and Rehabilitation

This paper reports some experimental developments of serious games with bio-sensing system and multimedia environments. The key idea is the biofeedback system with a combination of interoception and rehabilitation. In the area of rehabilitation therapy, it has been attracting attention that the client themself recovers better on a voluntary basis by the biofeedback technique. I have been developing some bio-sensing / bio-feedback systems with sketching (physical computing) technique and multimedia art. I will report on some cases which can be seen as the serious games in rehabilitation in cooperating with specialists in the medical field.