Tetsuaki Baba

Gocen: a handwritten notational interface for musical performance and learning music

Not only in childhood but also adulthood, we need some trainings to read music scores, which sometimes make music hard to learn and enjoy. In this article, we shall propose the system that enables users to play their handwritten musical notations by our musical interface.

Mobile map applications and the democratisation of hazard information

The geospatial web --- exemplified by the popularity of Google Maps --- has democratised the accessibility of geospatial data that was previously available only to those with expertise in GIS (Geographic information systems). This increased accessibility has resulted in critical information---such as the location of bushfires in Australia --- being made more accessible to communities vulnerable to such risks. This paper reports on the findings of a research project in Australia that aimed to present near real-time bushfire information in an interface that community-based users found intuitive and easy to use. It also describes the early prototype stages of an iPhone application that aims to demonstrate how Japanese natural hazard data can be presented in a more intuitive way. The work described here is intended to encourage organisations and individuals presenting spatial hazard information to non-expert users to consider the needs, abilities and concerns of their intended audience. It also describes the technologies and processes used in the design and development of the MyFireWatch and Mapping Hazards in Japan applications.

Katsukazan: An Intuitive iOS App for Informing People About Volcanic Activity in Japan

Events in recent years have drawn attention to disaster risks related to volcanic activity in Japan. People having easy access to information regarding Japans active volcanoes is of great importance - particularly as early work in our research indicated that visitors to Japan are unaware of these risks. Both disaster literature and interaction design theory emphasise considering the needs of users as part of the design process. Therefore, we are involving users at each step of the design process as we create an iOS application that allows people to explore and contextualise this information in a simple yet meaningful way.

Textile++: low cost textile interface using the principle of resistive touch sensing

Here we introduce our system Textile++, a touch-sensitive cloth consisting of fiber materials. With this system, it is possible to detect the XY coordinate position of the substance touching the cloth. In addition, pressure can be detected. Textile++ is flexible and lightweight, making it is easy to apply to conventional clothes. Compared to existing methods, the structure is simple, so it is possible to manufacture at very low cost. This paper explains the proposed Textile ++ system and its application to a cuff-based user interface (UI) created for a jacket (Figure 1).

Switch++: An Output Device of the Switches by the Finger Gestures

Regarding human-machine-interfaces, switches have not changed significantly despite the machines themselves evolving constantly. In this paper, we propose a new method of operability for devices by providing multiple switches dynamically, and users choose the switch that has the functionality that they want to use. Switch++ senses the mental model of the operating sensation of switches against the users finger gestures and changes the shape of the switch and its affordances accordingly. We design the interface based on the raw data.

A tambourine support system to improve the atmosphere of karaoke: Support of play by multiple players

Karaoke is a popular amusement, but people do not necessarily enjoy karaoke when they are not singing. It is better that non-singing people engage in karaoke to enliven it, but this is not always easy specially if they do not know the song. Here, we focus on the tambourine, which is provided in most karaoke spaces in Japan but is rarely used. We proposed a tambourine support system to enliven karaoke. The proposal is a system that instructs a non-singing person to play the tambourine. The tambourine part for this song is automatically generated based on the standard MIDI file. During playback, the tambourine part is displayed in a common music game style. The correctness of the tambourine beat is fed to the display. The results show that tambourine players rated the system highly. However, singers did not appreciate the system because tambourine players concentrated on performance and they felt lonely. Here, we propose a support system that requests all people, including singers, in karaoke box to hold and play tambourine to enliven the karaoke. Our system of play is easier than the previous system and make it possible to play while singing and instruct to tambourine player. The results showed that our system gave a sense of unity to all people and enlivens karaoke.

Taifūrin: Wind-Chime Installation As A Novel Typhoon Early Warning System

Taifūrin is a novel typhoon early warning system that informs people when a typhoon is approaching. We combined a traditional Japanese wind-chime (known as fūrin) with near real-time remotely-sensed typhoon data and electronic components connected to a single-circuit board computer to create a unique IoT (Internet of Things) device in the form of a simple art installation. In doing so, we aimed to combine modern interactivity with a traditional sense of Japanese aesthetics, known as wabi-sabi.

Hapbeat: Tension-Based Wearable Vibroacoustic Device

Hapbeat (Tension-based Wearable Vibroacoustic Device) enhances music appreciation and virtual reality experiences. It is a new type of wearable vibroacoustic device that can transmits a high fidelity acoustic vibration to the body. It consists of two coreless motors and Ultra High Molecular Weight Polyethylene string. The motors generate a vibration in the range of 0–600 Hz and the string transmits this vibration. If compared with other existing device, Hapbeat can generates a powerful low frequency vibration and can transmits vibration to the wide range of the user’s body in spite of its compact body.

Musical Interaction Design for Real-Time Score Recognition towards Applications for Musical Learning and Interactive Art

Not only in childhood but also adulthood, we need some training to read music scores, which sometimes make music hard to learn and enjoy. In this article, we shall propose the system that enables users to play their handwritten musical notations by our musical interface. Since 1960s, Optical Music Recognition (OMR) has become mature in the field of printed score. In recent, some products were released on market that uses OMR for music composition and playing. However, few research on handwritten notations have been done, as well as an interactive system for OMR. We combined notating with performing in order to make the music more intuitive for users and give aid for learning music. Furthermore, we applied our technique to an interactive work, which is kind of vision based record disc.

ThermoGame: video game interaction system that offers dynamic temperature sensation to users

Today, many researchers reports studies about haptic, tactile or tangible art and entertainment. Particularly about temperature sensation, few interaction system has ever been presented because of it does not have good responsiveness. In this study, we shall design the video game interaction system that uses temperature sensation to users. First of all we investigate the relation of the rapidity of temperature change and user response time by using prototyped controller. Our game controller can offer temperature to users dynamically according to game situations. As a result, It was able to propose a basis of interaction system to take the temperate sensation to the game interaction.