Kentaro Fukuchi

Real-world interaction using the FieldMouse

We introduce an inexpensive position input device called the FieldMouse, with which a computer can tell the position of the device on paper or any flat surface without using special input tablets or position detection devices. A FieldMouse is a combination of an ID recognizer like a barcode reader and a mouse which detects relative movement of the device. Using a FieldMouse, a user first detects an ID on paper by using the barcode reader, and then drags it from the ID using the mouse. If the location of the ID is known, the location of the dragged FieldMouse can also be calculated by adding the amount of movement from the ID to the position of the FieldMouse. Using a FieldMouse in this way, any flat surface can work as a pointing device that supports absolute position input, just by putting an ID tag somewhere on the surface. A FieldMouse can also be used for enabling a graphical user interface (GUI) on paper or on any flat surface by analyzing the direction and the amount of mouse movement after detecting an ID. In this paper, we introduce how a FieldMouse can be used in various situations to enable computing in real-world environments.

PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity

PhotoelasticTouch is a novel tabletop system designed to intuitively facilitate touch-based interaction via real objects made from transparent elastic material. The system utilizes vision-based recognition techniques and the photoelastic properties of the transparent rubber to recognize deformed regions of the elastic material. Our system works with elastic materials over a wide variety of shapes and does not require any explicit visual markers. Compared to traditional interactive surfaces, our 2.5 dimensional interface system enables direct touch interaction and soft tactile feedback. In this paper we present our force sensing technique using photoelasticity and describe the implementation of our prototype system. We also present three practical applications of PhotoelasticTouch, a force-sensitive touch panel, a tangible face application, and a paint application.

Transparent 2-D markers on an LCD tabletop system

Tabletop systems are currently being focused on and many applications using these systems are being developed. In such tabletop systems, how to recognize real objects on the table is an essential and important issue. In existing tabletop systems, 2-D markers have been often used. However, their black-and-white pattern, which means nothing to humans, spoils the appearance of the object. We developed transparent markers on a liquid crystal display (LCD) tabletop system by using the polarization features of the LCD and optical lms. In particular, through experiments with various kinds of optical films, we found that two halfwave plates make the markers rotation invariant. By using the transparent markers, tangible transparent Magic Lenses(TM) applications were developed.

Multi-track scratch player on a multi-touch sensing device

Scratching with turntables is a popular sound generation technique in todays music scene, especially in hip-hop culture. A conventional turntable system consists of two turntables (record players) and an audio mixer, but the proposed system requires a computer and a multi-touch sensing device, so it is smaller and portable. Moreover, the proposed system enables the use of various novel scratching techniques that are difficult or impossible to perform on existing systems. In this paper we describe the implementation of the proposed system and introduce some scratching techniques that can be used with it.

EffecTV: A Real-Time Software Video Effect Processor for Entertainment

EffecTV is a real-time software video effect processor based on motion detection and image processing techniques. EffecTV was released in 2001 as an open source software, and has been growing the number of features and effects through contributions from the open source community. EffecTV has been used for various purpose – desktop toy applications, by visual jockeys (VJs), in theatrical plays and other stage performances. In this paper, we describe the implementation of EffecTV and some case studies.

Laser cooking: a novel culinary technique for dry heating using a laser cutter and vision technology

We propose a novel cooking technology that uses a laser cutter as a dry-heating device. In general, dry-heat cooking heats the whole surface of an ingredient, while a laser cutter heats a small spot of the surface in a very short time. Our approach employs a computer-controlled laser cutter and a video image-processing technique to cook ingredients according to their shape and composition, allowing for new tastes, textures, decorations, and engraving unique identifiers to the ingredients. We introduce some examples of laser cooking. In addition, we propose a multi-layered 3D printing technique using powdered sugar to create edible sculpture.

A laser pointer/laser trails tracking system for visual performance

Visual performance with a large video projection screen is popular for various entertainment events such as DJ events. Some performers use computers to generate visuals, but using a keyboard or a mouse to control the visuals in front of a large screen is neither exciting nor intuitive for performers and audiences. We developed an interactive display system using camera-tracked laser pointers that enables performers to interact with the screen directly. The system can also detect shapes of the laser trails that enables the performer to move the laser pointers quickly. Most of existing systems employ color and pattern matching techniques that are not suitable for visual performance.

Digital sports using the "Bouncing Star" rubber ball comprising IR and full-color LEDs and an acceleration sensor

1. Background and Purpose of this project Since ancient times, many people in the world loves a ball as an entertainment equipment. Design of the ball has been established and sophisticated as sport equipment used in soccer and baseball, in the sports that many people enjoy enthusiastically. Recently, a technical breakthrough has transformed the ball. Electronic devices have been started to be installed inside the balls. In our project, we focus on the creation of a new ball and entertainments for human beings using a ball comprising electronic devices. The previous studies carried out on our ball are as follows: 1Lumica Glow Football (Lumica Corporation) 2A ball containing infrared (IR) LEDs: IR Roboball MK2 3A ball containing IR LEDs: RCJ-04 (EK Japan Co., Ltd.) 4A ball containing a three-axis acceleration sensor in Kyukon We propose a ball that contains the abovementioned elements in one ball in order to realize a quality entertainment environment for human beings. The appearance of our ball (surface color, flashing speed of light and graphical effect around the ball) changes dynamically according to the acceleration data, and the position of the ball. To change the appearance, the ball is composed of full-color LEDs, whose color is controlled by a microprocessor connected to an acceleration sensor inside the ball. The ball is designed to emit IR light so that it can be detected. In order to obtain high elasticity, silicone was used as material to manufacture the ball “Bouncing Star” (Hane-Boshi in Japanese). Furthermore, we created effective computer graphics for determining performance using this ball. We also created new digital sports content “Space Ball” using Bouncing Star.

PhotoelasticTouch: transparent rubbery interface using a LCD and photoelasticity

PhotoelasticTouch is a tabletop system designed to intuitively facilitate touch-based interaction via real objects made from transparent elastic material. The transparent elastic material (transparent rubber) provides a realistic haptic interface, which when combined with the visual content displayed on the LCD tabletop, enables a balanced coupling of the physical world and digital content. The system utilizes the photo-elastic properties of the transparent rubber to recognize when a user pushes, pulls or pinches the object, while the LCD provides the appropriate visual feedback in accordance to the stress applied to the elastic material.

Implementation and evaluations of vision-based finger flicking gesture recognition for tabletops

Finger flicking is a familiar finger movement, and we often flick a small object on the table with a finger in our daily life. We developed a flicking gesture recognition system called the dasiaOHAJIKI interfacepsila, which can track very rapid flicking movements using a high-speed camera, and estimate the flicking power and direction in real time. In this paper, we describe the recognition techniques of the flicking gesture on a large LCD to produce a novel tabletop system that enables us to use the gesture to flick a virtual marble on the table. Moreover, we also present an evaluation of a vision-based flicking tabletop system as an entertainment application.