Fabian Hemmert

I'm home: Defining and evaluating a gesture set for smart-home control

Abstract Mobile phones seem to present the perfect user interface for interacting with smart environments, e.g. smart-home systems, as they are nowadays ubiquitous and equipped with an increasing amount of sensors and interface components, such as multi-touch screens. After giving an overview on related work this paper presents the adapted design methodology proposed by Wobbrock et al. (2009) for the development of a gesture-based user interface to a smart-home system. The findings for the new domain, device and gesture space are presented and compared to findings by Wobbrock et al. (2009) . Three additional steps are described: A small pre-test survey, a mapping and a memory test and a performance test of the implemented system. This paper shows the adaptability of the approach described by Wobbrock et al. (2009) for three-dimensional gestures in the smart-home domain. Elicited gestures are described and a first implementation of a user interface based on these gestures is presented.

Living interfaces: the thrifty faucet

In this paper, we present a novel type of persuasive home appliance: A thrifty water faucet. Through a servo motor construction, it is enabled to move and behave in life-like manners and to step into dialogue with the user. For example about water consumption or hygiene. We sought to research the reactions of users to such an appliance, alongside possible implications for the design of future human-machine interfaces. This project is part of a larger series of experiments in the Living Interfaces project, exploring ways in which reduced and abstract life-like movements can be beneficial for Human-Machine Interaction.

Shape-changing mobiles: tapering in two-dimensional deformational displays in mobile phones

This paper presents a novel haptic actuation system for mobile phones: Two-dimensional tapering through an actuated back plate. It proposes this type of shape-change for various applications, e.g. for ergonomically actuating the shape itself, displaying internal contents, and pointing to entities located outside the device. The paper reports a user study in which the accuracy of perceiving the two-dimensional tilt of the phones back plate is measured, as well as results from a questionnaire and a user interview. The results indicate that two-dimensional shape change may be a suitable addition to existing mobile phone technology.

Shape-changing mobiles: tapering in one-dimensional deformational displays in mobile phones

In this paper, we present a new shape-based display technique for mobile phones: A rotatory deformation of the phones chassis, resulting in a tapering between the phones front and back panel. It draws on proprioceptive skills of the human hand, which we hypothesize to be sensitive to paralellism and tapering of two opposing panels. We present a number of applications for such an actuation system: Interactive Feedback, User Notification, and Ambient Display. The proposed system is evaluated in a user study, which results point to certain advantages, as well as drawbacks, in comparison to other mobile actuation systems. We conclude by discussing areas in which tapering-based deformational displays may be used advantageously, and how the proposed system may be improved in the future.

Dynamic knobs: shape change as a means of interaction on a mobile phone

In this paper, we introduce the change of a mobile phones hardware shape as a means of tactile interaction. The alteration of shape is implemented in a hardware prototype using a dynamic knob as an interaction device for the user. The knob alters the phones shape according to different events and states, like incoming calls, new voice mail, or missed calls. Therefore, the user can explore the phones status by touching it -- ambiently, even through the pocket. Initial user testing showed that this form of tactile interaction was easy to understand and handy to interact with, also for unexperienced users.

Animate mobiles: proxemically reactive posture actuation as a means of relational interaction with mobile phones

In this paper, we explore body language in mobile phones as a means of relational interaction. We describe a prototype that allows the simulation of proxemic reactions to the nearing hand of a user, ranging from affection to aversion, based on nearness-based input and shape change-based output. A user study is reported, which indicates that users were able to interpret the prototypes behavior drawing on animal parallels. It is concluded that proxemically reactive actuation may be a viable means of actively integrating the relationship between the user and the device into the interaction.

Intimate mobiles: grasping, kissing and whispering as a means of telecommunication in mobile phones

In this paper, we explore how direct physical cues of interpersonal nearness can be achieved in mobile phones. Exemplarily, we present three novel means of communication for mobile phones: grasping, kissing and whispering. Reviewing the related work, we point to a research gap in direct physical near-body actuation in mobile telecommunication. To assess this gap, we present three prototypes that implement the proposed novel means of communication. We present initial user comments on the prototypes, which point to acceptance issues. We conclude in a set of research questions for future explorations in this field.

Weight-shifting mobiles: two-dimensional gravitational displays in mobile phones

In this paper, we present a novel type of haptic display for usage in mobile phones. It changes the gravitational properties of the device by shifting an internal weight along two axes. Its utility is explored in a performance study, in which users were estimating positions of the devices actuated center of gravity. The users also participated in qualitative studies: A questionnaire that assessed the perceived quality of interacting with the device, and an interview in which they described their experiences with the weight-shifting mobile. Furthermore, this paper suggests three domains of application in which the system may be of benefit: Augmenting digital content with physical mass, ambient displays, and haptically augmented wayfinding.

Take me by the hand: haptic compasses in mobile devices through shape change and weight shift

This paper compares two novel physical information displays, both of which allow for haptic, non-invasive, non-audiovisual information display: a shape-changing device and a weight-shifting device. As for their suitability in mobile navigation applications, the two haptic systems are compared against each other, and also against a GUI-based solution, which serves as a baseline. The results of the study indicate that the shape- and weight-based displays are less accurate than the GUI-based variant, but may be suitable for simple directional guidance (e.g. walking ahead, or turning left or right) and beneficial in terms of reaction times to visual cues (e.g. traffic lights). This paper concludes with an outlook towards potential future research activities in this field.

Reflective haptics: enhancing stylus-based interactions on touch screens

In this paper, we introduce the prototype of a low cost haptically augmented stylus for pen computing on touch screens. The stylus supports human-computer interaction through a dynamic haptic feedback. This reflective feedback is generated by a magnetically operated brake system. The feedback actuator is integrated in the stylus. Therefore, the pen supports the use of multiple styli on a single touch screen. The pen provides a broad scale of feedback-especially for the display of haptic surface cues. Hence, it is predestined for stroke gestures, as they are commonly used in crossing-based pen interfaces.