Sebastian Heise

A versatile expressive percussion instrument with game technology

Whereas virtual musical instruments are prominently featured in many current computer games, the simulations of these instruments are rather cartoonish. We propose to leverage current inexpensive game technology such as accelerometer-based input devices and physics engines in combination with audio processing to create digital replicas of a range of percussion instruments. These simulations reproduce expressive nuances faithfully and may be used for education, recording, and live performance. A single device affords highly different interaction modes; these can be mixed and matched freely with sound models. For instance, the tilting motion of a rain-stick can be combined with the sound of a tambourine.