Keisuke Kawahara

You as a Puppet: Evaluation of Telepresence User Interface for Puppetry

We propose an immersive telepresence system for puppetry that transmits a human performers body and facial movements into a puppet with audiovisual feedback to the performer. The cameras carried in place of puppets eyes stream live video to the HMD worn by the performer, so that performers can see the images from the puppets eyes with their own eyes and have a visual understanding of the puppets ambience. In conventional methods to manipulate a puppet (a hand-puppet, a string-puppet, and a rod-puppet), there is a need to practice manipulating puppets, and there is difficulty carrying out interactions with the audience. Moreover, puppeteers must be positioned exactly where the puppet is. The proposed system addresses these issues by enabling a human performer to manipulate the puppet remotely using his or her body and facial movements. We conducted several user studies with both beginners and professional puppeteers. The results show that, unlike the conventional method, the proposed system facilitates the manipulation of puppets especially for beginners. Moreover, this system allows performers to enjoy puppetry and fascinate audiences.

Gushed light field: design method for aerosol-based fog display

We present a new method to render aerial images by aerosol-based fog screens. Conventional fog screens are easily affected by the air flow and their generator occupy large areas. In this study, we propose to add new tradeoffs between limited display time and payloads. We employ aerosol distribution from off-the-shelf spray as a fog screen that can resist the wind, and has high portability. We present some application example; wearable application, multi-viewpoint display, display embedded in the environment, and aerial imaging with drone or radio-controlled model car. This study will contribute to the exploration of new application areas for fog displays and expand expressions of entertainments and interactivity.

Design method for gushed light field: aerosol-based aerial and instant display

We present a new method to render aerial images using aerosol-based fog screens. Conventional fog screens are easily affected by air flow, and their fog generators occupy large areas. In this study, we propose to add new tradeoffs between the display time and the payloads. We employ aerosol distribution from off-the-shelf sprays as a fog screen that can resist wind and has high portability. Results showed that the minimum weight of the entire system is approximately 600 g including all components, the screen raise time is approximately 0.5 s, the disappearance time is approximately 0.4 s, and the maximum wind speed at which we can project images is approximately 10 m/s. We conducted user studies on wearable applications, aerial imaging with a drone or radio-controlled model car, multi-viewpoint display, and a display embedded in the environment. This study will contribute to the exploration of new application areas for fog displays, and will augment expressions of entertainment and interactivity.

Gushed Diffusers: Fast-moving, Floating, and Lightweight Midair Display

We present a novel method for fast-moving aerial imaging using aerosol-based fog screens. Conventional systems of aerial imaging cannot move fast because they need large and heavy setup. In this study, we propose to add new tradeoffs between limited display time and payloads. This system employ aerosol distribution from off-the-shelf spray as a fog screen that can resist the wind, and have high portability. As application examples, we present wearable application and aerial imaging on objects with high speed movements such as a drone, a radio-controlled model car, and performers. We believe that our study contribute to the exploration of new application areas for fog displays and expand expressions of entertainments and interactivity.

Yadori: mask-type user interface for manipulation of puppets

We propose a system for animatronics storytelling that enables performers to manipulate puppets by wearing a mask-type device on their faces.

Transformed Human Presence for Puppetry

We propose a system for transmitting a human performers body and facial movements to a puppet with audiovisual feedback to the performer. The system consists of a head-mounted display (HMD) that shows the performer the video recording of the puppets view, a microphone for voice capture, and photoreflectors for detecting the mouth movements of the human performer. In conventional puppetry, there is also the need for practice in the manipulation of the puppets to achieve good performance. The proposed telepresence system addresses these issues by enabling the human performer to manipulate the puppet through their own body and facial movements. The proposed system is expected to contribute to the development of new applications of puppetry and expand the interactivity of puppetry and the scope of entertainment.

Materialization of motions: tangible representation of dance movements for learning and archiving

We propose a method to learn and archive dance movements by fabricating tangible three-dimensional (3D) human forms. We analyze the pattern of the tempo and rhythm of a music piece and fabricate the shape of a 3D body based on the motions of the dance performer by using a 3D printer. For the implementation, we employ a depth camera to capture 3D information of a dance movement. Appropriate movements are extracted from the file at every constant tempo by analyzing the tempo of the music piece played while the dance is performed. The 3D printer enables tangible modeling of the dance movements.

Digital fabrication and manipulation method for underwater display and entertainment

Underwater expression is attractive. It seems like underwater objects are floating like anti-gravity scape by buoyancy and it is also impressive that bubbles rise while refracting the light. In this work, we aim to combine digital fabrication with interactive technology and expand underwater expression. To achieve this, we focused on a classic science experiment called the Cartesian Diver. Because of growing interest in the materialization of computer graphics, digital fabrication technologies have recently emerged as one of the most important application fields in real-world-oriented computer graphics. In particular, research on digital fabrication that gives dynamics properties is common. Spin-it [Bächer et al. 2014] presents design method for spinning objects by optimizing rotational dynamics properties. Some studies use non-contact manipulation. For example, ZeroN [Lee et al. 2011] controls the magnetic field to manipulate the object and uses it as a floating screen and input user interface(UI). Our work connects digital fabrication and non-contact manipulation that uses the space transmission power (water pressure) around the object (the diver). [Koike et al. 2016] proposes a design and manipulation method for the diver. In this work, we updated the method and investigate stability of PID control. Furthermore, we propose some applications.

Haptic marionette: wrist control technology combined with electrical muscle stimulation and hanger reflex

Many devices and systems that directly control a users hands have been proposed in previous studies. As a method for controlling a users wrist, Hanger Reflex and Electrical Muscle Stimulation is often used. We propose a method combined Electrical muscle stimulation and Hanger Reflex. We use Hanger Reflex to elicit the supination and pronation, and EMS to cause the flexion and extension. We believe that the proposed method of this study contributes to the exploration of new devices and applications on the fields of haptics, virtual and augmented reality, mobile and wearable interfaces.

Gushed Light Field: Video Showcase of Aerosol-Based Fog Display

We present a video showcase of our aerosol-based fog display. Our system employs aerosol distribution from off-the-shelf sprays as a fog screen that can resist the wind and has high portability. We present some application examples; wearable applications, multi-viewpoint display, a display embedded in the environment, and aerial imaging with a drone or radio-controlled model car. This study will contribute to the exploration of new application areas for fog displays, and expand expressions of entertainments and interactivity.