Yasutoshi Makino

Surface Sensor Network Using Inductive Signal Transmission Layer

In this paper, we report the latest results of our two-dimensional communication project. In the system we show here, the sensor node that touches the surface of a two-dimensional signal transmission sheet (2DST sheet) establishes the connection. The system allows free location of the sensor node, and proximity (non-contact) connection is realized stably. The structure of 2DST sheet is simple and realized with various materials at low cost. Since the sensor nodes communicate with electromagnetic waves confined in two-dimensional medium, they are free from the interference from the nodes apart from the sheet. Powering with microwave through the sheet is also possible.

SenSkin: adapting skin as a soft interface

We present a sensing technology and input method that uses skin deformation estimated through a thin band-type device attached to the human body, the appearance of which seems socially acceptable in daily life. An input interface usually requires feedback. SenSkin provides tactile feedback that enables users to know which part of the skin they are touching in order to issue commands. The user, having found an acceptable area before beginning the input operation, can continue to input commands without receiving explicit feedback. We developed an experimental device with two armbands to sense three-dimensional pressure applied to the skin. Sensing tangential force on uncovered skin without haptic obstacles has not previously been achieved. SenSkin is also novel in that quantitative tangential force applied to the skin, such as that of the forearm or fingers, is measured. An infrared (IR) reflective sensor is used since its durability and inexpensiveness make it suitable for everyday human sensing purposes. The multiple sensors located on the two armbands allow the tangential and normal force applied to the skin dimension to be sensed. The input command is learned and recognized using a Support Vector Machine (SVM). Finally, we show an application in which this input method is implemented.

Touch interface on back of the hand

In this paper we propose a new computer-human interface which uses the back of the hand for pointer control.

Active touch perception produced by airborne ultrasonic haptic hologram

A method to present volumetric haptic objects in the air using spatial modulation of ultrasound is proposed. Previous methods of airborne ultrasonic tactile display were based on vibrotactile radiation pressure and sensor feedback systems, which result in low spatial receptive resolution. The proposed approach produces a spatially standing haptic image using stationary ultrasonic waves that enable users to touch 3D images without depending on vibrotactile stimulation and sensor feedback. The omnidirectional spatial modulated haptic images are generated by a phased array surrounding a workspace, which enables enough power to feel shapes without vibrotactile technique. Compared with previous methods, the proposed method can create a completely silent image without temporal ultrasonic modulation noise that is free of the problems caused by feedback delay and errors. To investigate the active touch profiles of an ultrasonic image, this paper discusses a method to synthesize a haptic holographic image, the evaluation of our algorithm, and the results of pressure measurement and subjective experiments.

ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing

This article explores direct touch and manipulation techniques for surface computing environments using a specialized haptic force feedback stylus, called ImpAct, which can dynamically change its effective length and equipped with sensors to calculate its orientation in world coordinates. When a user pushes it against a touch screen, the physical stylus shrinks and a rendered projection of the stylus is drawn inside the screen, giving the illusion that it is submerged in the display device. Once the users can see the stylus immersed in the digital world below the screen, he or she can manipulate and interact with the virtual objects with active haptic sensations. In this article, ImpActs functionality, design, and prototype applications are described in detail with relevance to the concept of direct touch, giving special attention to novel interaction scenarios and design challenges. Furthermore, a technical evaluation was done to study ImpActs accuracy and controlability and the results presented. This article concludes by discussing ImpActs current limitations and future perspectives as a direct touch and manipulation tool.

HaptoClone (Haptic-Optical Clone) for Mutual Tele-Environment by Real-time 3D Image Transfer with Midair Force Feedback

In this paper, we propose a novel interactive system that mutually copies adjacent 3D environments optically and physically. The system realizes mutual user interactions through haptics without wearing any devices. A realistic volumetric image is displayed using a pair of micro-mirror array plates (MMAPs). The MMAP transmissively reflects the rays from an object, and a pair of them reconstructs the floating aerial image of the object. Our system can optically copy adjacent environments based on this technology. Haptic feedback is also given by using an airborne ultrasound tactile display (AUTD). Converged ultrasound can give force feedback in midair. Based on the optical characteristics of the MMAPs, the cloned image and the user share an identical coordinate system. When a user touches the transferred clone image, the system gives force feedback so that the user can feel the mechanical contact and reality of the floating image.

Selective stimulation to superficial mechanoreceptors by temporal control of suction pressure

In this paper we propose a new set of primitives to realize a large-area covering realistic tactile display. They stimulate the skin surface with suction pressure (SPS method) as our former paper proposed. The difference from the former device is that a single suction hole provides a pair of primitives. Since the identical hole provides the multiple primitives, we can expect multi-primitive tactile stimulation is realized more stably, and the physical structure is simpler than the former method. The method uses the frequency characteristics of the mechanoreceptor sensitivity and a feature of SPS that suction pressure through a hole does not reach the deep receptors, Pacinian corpuscles. We show the basic theory and results of fundamental experiments. In the experiments, we show the spatial feature of the virtual object (edged or round) can be controlled by the temporal profile of the primitives. We explain the reason of the phenomena based on a tactile perception model called simple bundle model.

PINOKY: a ring that animates your plush toys

PINOKY is a wireless ring-like device that can be externally attached to any plush toy as an accessory that animates the toy, such as by moving its limbs. A user is thus able to instantly convert any plush toy into a soft robot. The user can control the toy remotely or input the movement desired by moving the plush toy and having the data recorded and played back. Unlike other methods for animating plush toys, PINOKY is non-intrusive, so alterations to the toy are not required.

Large Area Sensor Skin based on Two-Dimensional Signal Transmission Technology

In this paper, we propose a stretchable large area sensor skin based on two-dimensional signal transmission (2DST) technology. A small tactile sensor chip with stable non-contact connectors (resonant proximity connector: RPC) to a 2DST sheet is developed. The sensor nodes communicate by microwave that propagates in a two-dimensional sheet. Sensor nodes connect to the 2DST sheet via RPCs without electrical contact anywhere on the sheet and also receive the power for operation from the microwave in the sheet. RPC is a spiral electrode whose total length is a quarter of the electromagnetic wavelength. The induced resonance around the electrode reduces the impedance between the connector and 2DST sheet, which allows sensor chips to connect to the 2DST sheet stably. Simulation results on spiral RPCs show that the concept is effective. We produce an on-off type tactile sensor element which consists of a RFID-tag and RPC, and experimentally confirm that the sensor element works in a stretchable 2DST sheet

Life log system based on tactile sound

In this paper, we propose a new life log system which estimates touching object based on a contact sound. A life log system records our behaviors for recommending appropriate information depending on logs. There are some devices including a camera, a microphone and a GPS for recording our actions. However, those devices record too rich information to be accepted in terms of privacy. In this research we focus on the sound when we touch/manipulate objects. A piezoelectric device on a fingernail records touching sound propagating through a fingertip. Since the recorded sound depends on touching objects, we can record what we touched. This can be used as a new life log which assures secrecy. We show that our prototype system recognizes 12 different actions with 94.4% accuracy.