Maiya Hori

Novel stereoscopic view generation by image-based rendering coordinated with depth information

This paper describes a method of stereoscopic view generation by image-based rendering in wide outdoor environments. The stereoscopic view can be generated from an omnidirectional image sequence by a light field rendering approach which generates a novel view image from a set of images. The conventional methods of novel view generation have a problem such that the generated image is distorted because the image is composed of parts of several omnidirectional images captured at different points. To overcome this problem, we have to consider the distances between the novel viewpoint and observed real objects in the rendering process. In the proposed method, in order to reduce the image distortion, stereoscopic images are generated considering depth values estimated by dynamic programming (DP) matching using the images that are observed from different points and contain the same ray information in the real world. In experiments, stereoscopic images in wide outdoor environments are generated and displayed.

Arbitrary Stereoscopic View Generation Using Multiple Omnidirectional Image Sequences

This paper proposes a novel method for generating arbitrary stereoscopic view from multiple omni directional image sequences. Although conventional methods for arbitrary view generation with an image-based rendering approach can create binocular views, positions and directions of viewpoints for stereoscopic vision are limited to a small range. In this research, we attempt to generate arbitrary stereoscopic views from omni directional image sequences that are captured in various multiple paths. To generate a high-quality stereoscopic view from a number of images captured at various viewpoints, appropriate ray information needs to be selected. In this paper, appropriate ray information is selected from a number of omni directional images using a penalty function expressed as ray similarity. In experiments, we show the validity of this penalty function by generating stereoscopic view from multiple real image sequences.

Pano UMECHIKA: A crowded underground city panoramic view system

Toward a really useful navigation system, utilizing spherical panoramic photos with maps like Google Street View is efficient. Users expect the system to be available in all areas they go. Conventional shooting methods obtain the shot position from GPS sensor. However, indoor areas are out of GPS range. Furthermore, most urban public indoor areas are crowded with pedestrians. Even if we blur the pedestrians in a photo, the photos with blurring are not useful for scenic information. Thus, we propose a method which simultaneously subtracts pedestrians based on background subtraction method and generates location metadata by manually input from maps. Using these methods, we achieved an underground panoramic view system which displays no pedestrians.

Generation of Facial Expression Emphasized with Cartoon Techniques Using a Cellular-Phone-Type Teleoperated Robot with a Mobile Projector

We propose a method for generating facial expressions emphasized with cartoon techniques using a cellular-phone-type teleoperated android with a mobile projector. Elfoid is designed to transmit the speaker’s presence to their communication partner using a camera and microphone, and has a soft exterior that provides the look and feel of human skin. To transmit the speaker’s presence, Elfoid sends not only the voice of the speaker but also emotional information captured by the camera and microphone. Elfoid cannot, however, display facial expressions because of its compactness and a lack of sufficiently small actuator motors. In this research, facial expressions are generated using Elfoid’s head-mounted mobile projector to overcome the problem. Additionally, facial expressions are emphasized using cartoon techniques: movements around the mouth and eyes are emphasized, the silhouette of the face and shapes of the eyes are varied by projection effects, and color stimuli that induce a particular emotion are added. In an experiment, representative face expressions are generated with Elfoid and emotions conveyed to users are investigated by subjective evaluation.

Generation of facial expression for communication using elfoid with projector

We propose a method for generating facial expressions with a mobile projector built into a cellphone-type tele-operated android, called Elfoid. Elfoid is designed to transmit the presence of a speaker to a communication partner in a remote place using a camera and microphone and a soft exterior that provides the look and feel of human skin. To transmit the presence of a speaker, Elfoid sends not only voice but also facial expressions and emotion information captured by the camera and microphone. Elfoid cannot, however, display facial motions because of its compactness and the lack of sufficiently small actuator motors. Therefore, we use a mobile projector and generate projection patterns to represent facial expressions estimated with a camera.

Power Demand Forecasting Using Meteorological Data and Human Congestion Information

In this paper, we propose a method for forecasting power demand using meteorological data and human congestion information. In an energy management system (EMS), accurate power demand forecasts reduce the cost on the demand side and stabilize the power supply on the supply side. Although previously observed power consumption and meteorological data are conventionally used for forecasting power demand, it is difficult to estimate power demand in cases that are greatly affected by the behavior of people. Power consumption may vary according to the behavior of just one person, depending on the size of the community. In this study, the power demands of multiple buildings on the campus of a university are estimated accurately by analyzing heterogeneous data obtained with various sensors. Experiments show that using meteorological data and human congestion improves results. Consequently, we confirm that a cyber physical system can play an important role in the construction of an EMS.

Expression transmission using exaggerated animation for Elfoid

We propose an expression transmission system using a cellular-phone-type teleoperated robot called Elfoid. Elfoid has a soft exterior that provides the look and feel of human skin, and is designed to transmit the speakers presence to their communication partner using a camera and microphone. To transmit the speakers presence, Elfoid sends not only the voice of the speaker but also the facial expression captured by the camera. In this research, facial expressions are recognized using a machine learning technique. Elfoid cannot, however, display facial expressions because of its compactness and a lack of sufficiently small actuator motors. To overcome this problem, facial expressions are displayed using Elfoids head-mounted mobile projector. In an experiment, we built a prototype system and experimentally evaluated its subjective usability.

Removal of moving objects and inconsistencies in color tone for an omnidirectional image database

This paper proposes a method for removing image inconsistencies which occur by an existence of moving objects or a change of illumination condition when an omnidirectional image database is generated. The database is used for archiving an outdoor scene in wide areas or generating novel view images with an image-based rendering approach. In related work, it is difficult to remove moving objects in an outdoor environment where illumination condition drastically changes, and to remove inconsistencies of color tone of images which included moving objects. The proposed method iterates the two processes which are the estimation of candidate region of moving objects and the achievement of color consistency to split regions. The color consistency is achieved by estimating linear color transformation parameters which change a histogram of an input image to that of the standard image.

Poster: MR telepresence system with inertial force sensation using a motion platform and an immersive display

This paper presents a telepresence system for a ride, such as on a roller coaster, using a motion platform that can provide a seated user with the sensation of inertial force. Most conventional studies using a motion platform with a few degrees of freedom have not generated an inertial force when a ride accelerates, because a motion platform cannot simulate the same motion of a real roller coaster. We propose a new telepresence system that can provide a user with an inertial force sensation using a motion platform with a few degrees of freedom and an immersive display. In our research, the inertial force sensation is generated by acceleration of gravity produced by inclining the motion platform. The inclination of the seated user is estimated from an image sequence captured using an omnidirectional camera placed on an actual running roller coaster. In our experiments, the inertial force sensation is realized using a motion platform and an immersive display.

Simulation of energy management by controlling crowd behavior

We propose a method of energy management aimed at reducing the emission of carbon dioxide by changing people’s behavior in small and medium-sized electricity communities. In the conventional energy management system, a power peak is cut and shifted mainly using solar power generation and batteries. In this research, a power peak is cut and shifted by controlling the power demand. The power demand for each facility in small communities is controlled by changing crowd behavior. In experiments, models for predicting power demand according to crowd congestion are constructed for each facility and the accuracies of prediction are verified.