Matthias Rath

Continuous sonic feedback from a rolling ball

Balancing a ball along a tillable track is a control metaphor for a variety of continuous control tasks. The authors designed the Ballancer experimental tangible interface to exploit such a metaphor. Direct, model-based sonification of the rolling ball improves the experience and effectiveness of the interaction.

Physically-based audio rendering of contact

This paper describes an algorithm for real-time synthesis of contact sounds for interactive simulations and animation. The algorithm is derived from a physically-based impact model, and the acoustic characteristics of colliding objects can be realistically simulated by properly adjusting the physical parameters of the model. A technique for describing the spatial dynamics of a resonating object is proposed, which allows simulation of position-dependent interaction. It is shown that the numerical implementation leads to an efficient sound synthesis module, that runs in real-time on low cost platforms. The effectiveness of the model is demonstrated, and its applications are discussed.

On the Relevance of Auditory Feedback for Quality of Control in a Balancing Task

A tangible audio-visual interface based on the metaphor of balancing a ball on a tiltable track allows the measurement of human control movements under different conditions of sensory feedback. This specific scenario of human-system interaction forms an example for the definition of various measures of performance and quality of interaction. The dependence of these measures on specific configurations of the interface with regard to the employed audio-visual feedback, and their relationship is discussed.

Explorations in sound for tilting-based interfaces

Everyday experience as well as recent studies tell that information contained in ecological sonic feedback may improve human control of, and interaction with, a system. This notion is particularly worthwhile to consider in the context of mobile, tilting-based interfaces as have been proposed, developed and studied extensively. Two interfaces are used for this scope, the Ballancer, based on the metaphor of balancing a rolling ball on a track, and a more concretely application-oriented setup of a mobile phone with tilting-based input. First pilot studies have been conducted.

A Tangible Game as Distributable Platform for Psychophysical Examination

Through the use of built-in accelerometers a game-software for recent generation MacBooks allows control of a scenario of virtual moving objects by tilting the computer. Together with integrated visual and continuous auditory feedback from models based on physical principles the software forms a possible platform for online collection of psychophysical data.

Integrated modelling of sonic vibration and macroscopic object movement: an example of an interactive ball game

Digital artifacts based on physical metaphors strongly benefit from dynamic, realtime reactive sound feedback. Making use of one integral physical model and digital implementation simultaneously for both, macroscopic, visual object behaviour and sonic feedback allows to realise scenarios not achievable in a conventional approach where sound is triggered or controlled in a one-way fashion from a macroscopic simulation. By careful consideration of possible simplifications such an integrated approach may be feasible in realtime implementation and can allow to reach higher levels of synchronicity and sensory integration.