Bridget Baird

Haptic and sound correlations: pitch, loudness and texture

People process information through multiple modalities and many studies have been done that show interaction among the auditory, haptic and visual modes. This paper reports on a correlation between the haptic property of roughness and each of the audio properties of pitch and loudness. There were four experiments: given a roughness, match a loudness level to it and vice versa and given a roughness, match a pitch to it and vice versa. Subjects showed a strong correlation in the first two experiments, associating louder sounds with rougher textures and softer sounds with smoother textures. They also showed, although not always in the same direction, a strong correlation between pitch (high/low) and roughness. Applications of this study are to multimodal user interfaces and to music cognition.

The artificially intelligent computer performer: The second generation

Abstract While much research has been done on modeling human performance on a computer and several systems have been successful, few researchers have addressed the task of equipping the “artificial performer” with as much information about the score as a human performer. Highly sophisticated tracking algorithms have been developed but there remains much to be done on the problems of “musicalization” and “ensemble interaction” (group dynamics). The Artificially Intelligent Computer Performer (AICP) addresses these problems and presents a user Journal of New Music Research that is at once intuitive and pedagogical. It uses a commercially available notation and sequencing program for score input. Heuristics are invoked which overlay tracking algorithms and transform the AICP from its tradional role as an accompanist into a more intelligent decision maker. This paper accompanies a demonstration of the AICP and explains the operation of the program, as well as some of our solutions to the problems described ab...

Attribute correlations between haptic and auditory modalities

Correlations between attributes in the haptic domain and those in the auditory will assist in multimodal applications. This paper looks at the auditory attributes of pitch and reverberation and the haptic attributes of vibration, size and viscosity and seeks to correlate changes in one of the modalities with changes in the other. A total of 4 pairs of experiments were performed. The results indicate significant correlations in 3 of the pairs: pitch/vibration, pitch/viscosity, reverberation/size. There was no significant correlation found between reverberation and viscosity. These results have significance for designers of multimodal interfaces in virtual environments.