Kumiko Kushiyama

Gocen: a handwritten notational interface for musical performance and learning music

Not only in childhood but also adulthood, we need some trainings to read music scores, which sometimes make music hard to learn and enjoy. In this article, we shall propose the system that enables users to play their handwritten musical notations by our musical interface.

Tactile cloud landscape

This simulation of a natural landscape is a tactile artwork that interactively expresses images and movements of clouds. Images and tactile sensations incorporating the soft movements of clouds interact simultaneously to create a tactile display that reacts to human contact. This work could be used as a universal display for the disabled and for various other forms of global communications.

Taifūrin: Wind-Chime Installation As A Novel Typhoon Early Warning System

Taifūrin is a novel typhoon early warning system that informs people when a typhoon is approaching. We combined a traditional Japanese wind-chime (known as fūrin) with near real-time remotely-sensed typhoon data and electronic components connected to a single-circuit board computer to create a unique IoT (Internet of Things) device in the form of a simple art installation. In doing so, we aimed to combine modern interactivity with a traditional sense of Japanese aesthetics, known as wabi-sabi.

CG Programming Approach to Generate Pattern of Wayang Beber Pacitan Character's Cloth

This paper is a part of our research to develop an animated film based on the wayang beber Pacitan visual form. Wayang beber Pacitan is one of the wayang beber types, an Indonesian traditional picture. We describe the programming approach to generate a pattern of wayang beber Pacitan characters cloth. This cloth has three typical patterns: a line pattern, color pattern, and wavy shape pattern. We create a new shader algorithm based on the Sors shader algorithm, s and t coloration, and surface displacement to generate these three types of patterns.

Musical Interaction Design for Real-Time Score Recognition towards Applications for Musical Learning and Interactive Art

Not only in childhood but also adulthood, we need some training to read music scores, which sometimes make music hard to learn and enjoy. In this article, we shall propose the system that enables users to play their handwritten musical notations by our musical interface. Since 1960s, Optical Music Recognition (OMR) has become mature in the field of printed score. In recent, some products were released on market that uses OMR for music composition and playing. However, few research on handwritten notations have been done, as well as an interactive system for OMR. We combined notating with performing in order to make the music more intuitive for users and give aid for learning music. Furthermore, we applied our technique to an interactive work, which is kind of vision based record disc.

ThermoGame: video game interaction system that offers dynamic temperature sensation to users

Today, many researchers reports studies about haptic, tactile or tangible art and entertainment. Particularly about temperature sensation, few interaction system has ever been presented because of it does not have good responsiveness. In this study, we shall design the video game interaction system that uses temperature sensation to users. First of all we investigate the relation of the rapidity of temperature change and user response time by using prototyped controller. Our game controller can offer temperature to users dynamically according to game situations. As a result, It was able to propose a basis of interaction system to take the temperate sensation to the game interaction.

Touch the Drop

The system captures an image from a from touch screen in real time and extracts a position and shape, then narrows down the information required to generate a drop of water and transmits a message to the image-generation component. This component shapes generation of the drop of water and animates it in real time. The shape-generation algorithm for the water drop uses a meta-ball-generation algorithm to generate the drop’s shape and behavior.