Kristian Gohlke

Physical Construction Toys for Rapid Sketching of Tangible User Interfaces

Physical construction toys such as Lego or similar brick-based systems provide a rich space for tangible interactions. In this paper we explore their potential as a readily available prototyping platform for Tangible User Interfaces. The system enables interaction designers and users to create functional control layouts, tangible experience prototypes, custom interface elements, and grid based interactions from Lego bricks. The position, color, orientation and shape of the markerless bricks are tracked using a camera. We have conducted an initial exploration of this design space through an exemplary case study of a tangible interface for music creation: users can construct interactive interface elements such as tangible grids for the arrangement of drum-patterns and different types of continuous controllers for parameter adjustments. The system is currently a work in progress; ongoing efforts are aimed at a more thorough evaluation.

T.F.O.: tangible flying objects

We present the prototype of an augmented game that uses an enhanced Frisbee-Disc as an interaction device to explore the capability of flying tangible user interfaces for increasing the attractiveness of physical games. While playing with the disc, a dynamic audio stream is generated, which serves as an additional semantic layer that can be leveraged to develop novel game concepts for simple catch-and-throw games. Initial observations of users interacting with our prototype indicate that minor auditory augmentations to seemingly old-fashioned physical exertion games can have a potential to enhance the playing experience and support a more persistent engagement in physical activity.

InflatiBits: A Modular Soft Robotic Construction Kit for Children

InflatiBits is a modular construction kit that enables playful exploration of pneumatically actuated kinematic systems. The kit contains different building blocks based on soft robotics principles such as soft inflatable air-chambers, constraining elements, air-connectors, pressure sources, and sensor modules. The elements can be combined and actuated manually or through an optional Arduino-based control board. The board contains a motorized air-pump, solenoid valves and allows for connecting the sensor module to achieve more complex behaviors and motion patterns. The InflatiBits modules and connectors are compatible with standard Lego parts, enabling children to integrate them into existing playing environments.

A Stretch-Flexible Textile Multitouch Sensor for User Input on Inflatable Membrane Structures & Non-Planar Surfaces

We present a textile sensor, capable of detecting multi-touch and multi-pressure input on non-planar surfaces and demonstrate how such sensors can be fabricated and integrated into pressure stabilized membrane envelopes (i.e. inflatables). Our sensor design is both stretchable and flexible/bendable and can conform to various three-dimensional surface geometries and shape-changing surfaces. We briefly outline an approach for basic signal acquisition from such sensors and how they can be leveraged to measure internal air-pressure of inflatable objects without specialized air-pressure sensors. We further demonstrate how standard electronic circuits can be integrated with malleable inflatable objects without the need for rigid enclosures for mechanical protection.

Leveraging behavioral models of sounding objects forgesture-controlled sound design

Sound designers and Foley artists have long struggled to create expressive soundscapes using standard editing software, devoting much time for the calibration of multiple sound samples and parameter adjustments. We present an intuitive approach that exploits the capabilities of off-theshelf motion-sensing input devices to enable quick and fluid interaction with sound to trigger and modulate digital sound generators based on adaptable behavioral models of familiar physical sounding objects. Rather than requiring profound technical knowledge of sound design, the system leverages the users motor memory and motion skills to mimic generic and familiar interactions with everyday sounding objects. This allows the user to fully focus on the expressive act of sound creation while enjoying a fluent workflow and a satisfying user experience.

TapShot: screenshot snippets as GUI shortcuts

During extended sessions with a graphical user interface (GUI), users often apply a small set of commands with high frequency. A majority of direct manipulation tasks on a GUI are carried out using the mouse, particularly when keyboard shortcuts are not provided or the user is not familiar with them. Thus, to invoke a certain command, the user is required to aim the mouse pointer at a given onscreen widget and click with the mouse. If the overall task requires a user to click on the same widget repeatedly as part of a sequence of different interleaved micro-tasks, the overall performance suffers, as each point-and-click action requires a considerable amount of time for correctly aiming at the respective control.