Toshiyuki Amano

Appearance Control Using Projection with Model Predictive Control

The unified technique for the irradiance correction and appearance enhancement for the real scene is proposed in this paper. The proposed method employed MPC algorithm for the projector camera system and enabled arbitrary appearance control such like photo retouching software in the real world. In the experiment, the appearance control of saturation enhancement, color removal, phase control, edge enhancement, image blur, makes unique brightness and the other enhancements for the real scene are shown.

Correlation Based Image Defect Detection

The defect inspection that used image sensing such as automated pattern inspection is a useful solution to automatize the visual check, not limit to factory automation field. Mostly such defect inspection is using the models of defect that described by primitive features. This paper proposes a new defect detection method that is the non-model based approach. In this approach, the method extracts the image description rule from local regions. It is useful for the defect inspection problems that cannot prepare a defect model such as scratch or superimpose detection, texture image analysis, etc. In the experiment, I tried the defect detection to the landscape picture which several types of superimpose were added. From these results, it was confirmed that the proposed method has high ability to detect the defected regions independently with the texture type. Furthermore, I attempted the application to a scene image. Therefrom, the possibility to apply the figure-ground separation of the image understanding basic problem was confirmed

Real world dynamic appearance enhancement with procam feedback

In this paper, a dynamic appearance enhancement method for the less saturated object is proposed. The appearance enhancement method proposed in this paper is realized with a projector camera dynamic feed back system. Therefore, the proposed method has an ability of the rapid and continuous appearance enhancement and it is useful for the human visual perception assistance. Also, the system not requires a pre-captured appearance of the target.

Image interpolation by high dimensional projection based on subspace method

This work presents a new image interpolation technique for image cracking such as telop character occlusion or picture deterioration. The landscape picture and texture pattern or other natural scenes contain the behavior of the autocorrelation pattern, and a method of image interpolation based on the autocorrelation pattern has been established. This method extracts many local regions from a piece of image and generates a subspace by the image vectors. The subspace limits the freedom of the image description at the local region by the hyperplane restriction in the image vector space. This paper explains for an image interpolation method based on eigen-space and explains the expansion using kernel non-linear projection.

Eigen space approach for a pose detection with range images

An application of the pose detection using range images usually uses characteristic matching of the geometrical model but this method has two problems: selecting characteristics from range images is difficult; and it is difficult to make a geometrical model for a complicated shape. Previously a parametric eigen-space method was proposed for pose detection. This method makes object recognition and pose detection possible, but this parametric eigen-space method has a problem that intensity-images depend on a variety of light conditions therefore learning images must include variation of light conditions.

Projection Based Real-Time Material Appearance Manipulation

We introduce a new projection display technique that converts a visual material appearance of target object. Unlike conventional projection display, our approach allowed us successive material appearance manipulation by the projector camera feedback without scene modeling. First, we introduce an appearance control framework with a coaxial projector camera system. Next, we introduce two image based material appearance manipulation methods of translucency and glossiness. Last, we verify the ability of the material appearance manipulation of the proposed display technique through the experiments.

Closed-Loop Feedback Illumination for Optical Inverse Tone-Mapping in Light Microscopy

In this paper, we show that optical inverse tone-mapping (OITM) in light microscopy can improve the visibility of specimens, both when observed directly through the oculars and when imaged with a camera. In contrast to previous microscopy techniques, we premodulate the illumination based on the local modulation properties of the specimen itself. We explain how the modulation of uniform white light by a specimen can be estimated in real time, even though the specimen is continuously but not uniformly illuminated. This information is processed and back-projected constantly, allowing the illumination to be adjusted on the fly if the specimen is moved or the focus or magnification of the microscope is changed. The contrast of the specimens optical image can be enhanced, and high-intensity highlights can be suppressed. A formal pilot study with users indicates that this optimizes the visibility of spatial structures when observed through the oculars. We also demonstrate that the signal-to-noise (S/N) ratio in digital images of the specimen is higher if captured under an optimized rather than a uniform illumination. In contrast to advanced scanning techniques that maximize the S/N ratio using multiple measurements, our approach is fast because it requires only two images. This can improve image analysis in digital microscopy applications with real-time capturing requirements.

Semi-Parametric Color Reproduction Method for Optical See-Through Head-Mounted Displays

The fundamental issues in Augmented Reality (AR) are on how to naturally mediate the reality with virtual content as seen by users. In AR applications with Optical See-Through Head-Mounted Displays (OST-HMD), the issues often raise the problem of rendering color on the OST-HMD consistently to input colors. However, due to various display constraints and eye properties, it is still a challenging task to indistinguishably reproduce the colors on OST-HMDs. An approach to solve this problem is to pre-process the input color so that a user perceives the output color on the display to be the same as the input. We propose a color calibration method for OST-HMDs. We start from modeling the physical optics in the rendering and perception process between the HMD and the eye. We treat the color distortion as a semi-parametric model which separates the non-linear color distortion and the linear color shift. We demonstrate that calibrated images regain their original appearance on two OST-HMD setups with both synthetic and real datasets. Furthermore, we analyze the limitations of the proposed method and remaining problems of the color reproduction in OST-HMDs. We then discuss how to realize more practical color reproduction methods for future HMD-eye system.

Projection Center Calibration for a Co-located Projector Camera System

A co-located projector camera system where the projector and camera are positioned in the same optical position by a plate beam splitter enables various spatial augmented reality applications for dynamic three dimensional scenes. The extremely precise alignment of the projection centers of the camera and projector is necessary for these applications. However, the conventional calibration procedure for a camera and projector cannot achieve high accuracy because an iterative verification process for the alignment is not included. This paper proposes a novel interactive alignment approach that displays a capture of the projected grid pattern on the calibration screen. Additionally, a misalignment display technique that employs projector camera feedback is proposed for fine adjustment.

Appearance enhancement using a projector-camera feedback system

In this paper, a dynamic appearance enhancement method for the less saturated object is proposed. The appearance enhancement method proposed in this paper is realized with a projector camera dynamic feedback system. Therefore, the proposed method has an ability of the rapid and continuous appearance enhancement and it is useful for the human visual perception assistance. Also, the system not requires a pre-captured appearance of the target.