Alain Renaud

KIMA: a holographic telepresence environment based on cymatic principles

KIMA is a holographic surround-sound installation that visualizes telepresence as both a phonetic and a synaesthetic phenomenon. The performance piece is based on the physical conditions of cymatics--the study of physically visible sound wave patterns. Two environments, a quad surround and a holographic interface, build the framework of a telematic experience that illustrates communication as wave forms while focusing on the relationship between sound and matter.

A perceptually motivated visualisation paradigm for musical timbre

Background is given on existing research into the perception and description of timbre. This is used to contextualise the development of visual mappings for acoustic timbre features. Two example systems are explained and discussed, which demonstrate the use of perceptually motivated mappings from acoustic features to visual properties, in specific contexts. Possible applications and extensions of such systems are proposed.

KIMA: The Wheel—Voice Turned into Vision: A participatory, immersive visual soundscape installation

Over the last five years, KIMA, an art and research project on sound and vision, has investigated visual properties of sound. Previous iterations of KIMA focused on digital representations of cymatics—physical sound patterns—as media for performance. The most recent development incorporated neural networks and machine learning strategies to explore visual expressions of sound in participatory music creation. The project, displayed on a 360-degree canvas at the London Roundhouse, prompted the audience to explore their own voice as intelligent, real-time visual representation. Machine learning algorithms played a key role in meaningful interpretation of sound as visual form. The resulting immersive performance turned the audience into cocreators of the piece.

Transmission: a telepresence interface for neural and kinetic interaction

Transmission is both a telepresence performance and a research project. As a real-time visualization tool, Transmission creates alternate representations of neural activity through sound and vision, investigating the effect of interaction on human consciousness. As a sonification project, it creates an immersive experience for two users: a soundscape created by the human mind and the influence of kinetic interaction. An electroencephalographic (EEG) headset interprets a users neural activity. An Open Sound Control (OSC) script then translates this data into a real-time particle stream and sound environment at one end. A second user in a remote location modifies this stream in real time through body movement. Together they become a telematic musical interface--communicating through visual and sonic representation of their interactions.

Transmission: Sonifying, Visualising and Analysing Neural Activity through Telepresence

Transmission is a telematic performance which allows for real time sonification and visualisation of brain waves and looks at the effect of interaction on the human consciousness. Users are equipped with an Emotiv EEG which enables them to perceive sonification and visualisation of their brains processing in real time. This visualisation is modified through another users movement in a remote location -- the users consciousness becomes a new musical and visual interface played by a remote person. Transmission is both a research project on telepresence and a participatory audience tool.