Yusuke Okada

A 2.2/3-inch 4K2K CMOS image sensor based on dual resolution and exposure technique

The recent trend in ultra-high-density cameras is running from HD to 4K2K, which will further extend to 8K4K / portable 4K2K. With advancements in device fabrication process technologies, there has been a pressing need for the miniaturization as well as high resolution and high sensitivity in image sensors [1].

Image reconstruction for high-sensitivity imaging by using combined long/short exposure type single-chip image sensor

We propose a image reconstruction method and a sensor for high-sensitivity imaging using long-term exposed green pixels over several frames. As a result of extending the exposure time of green pixels, motion blur increases. We use motion information detected from highframe-rate red and blue pixels to remove the motion blur. To implement this method, both long- and short-term exposed pixels are arranged in a checkerboard pattern on a single-chip image sensor. Using the proposed method, we improved fourfold the sensitivity of the green pixels without any motion blur.

Real-time computational camera system for high-sensitivity imaging by using combined long/short exposure

In this study, we realize high-resolution (4K-format), small-size (1.43 x 1.43 μm pixel pitch size with a single imager) and high-sensitivity (four times higher sensitivity as compared to conventional imagers) video camera system. Our proposed system is the real time computational camera system that combined long exposure green pixels with short exposure red / blue pixels. We demonstrate that our proposed camera system is effective even in conditions of low illumination.

Real Time High-Sensitivity Imaging for Home Surveillance System by Using Combined Long/Short Exposure

In the future, a comprehensive home surveillance system could be constructed using a network of pre-existing cameras found in household products. To be incorporated into household products, the camera must be small. In addition, for surveillance cameras, resolution and sensitivity are important. There is a trade-off between these three requirements, small-size, high-resolution and high-sensitivity. In this study, we realize the real time camera system that satisfies all the three requirements for home surveillance system. This proposed camera system is 4K-format with four times higher sensitivity as compared to conventional imagers. And, the pixel pitch size of imager of this proposed system is 1.43um. Then we propose a speedup algorithm to achieve 24fps operation using 62 FPGAs.

Performance evaluation of high sensitive DRE camera for cultural heritage in subdued light conditions

We proposed a color video generation method for spatio-temporal high resolution video imaging in dark conditions.[1] The method (dual resolutions and exposures(DRE) method) consists of a high sensitive imaging with employing long time exposure and a subsequent spatio-temporal decomposition process which suppresses a motion blur caused by the long time exposure. Imaging step captures RGB color video sequences with different spatio-temporal resolution sets to increase light amount. Processing step reconstructs a high spatio-temporal resolution color video from those input video sequences using the regularization framework. The performance of DRE is regard to the spectral distribution of a subject was evaluated in this study. Firstly, the spectral distribution of a green subject (which is though to be unfavorable from the viewpoint of imaging with DRE) was measured. Secondly, this subject was captured on video with DRE, the peak signal-to-noise ratio (PSNR) of the video images was evaluated. Experimental results showed that the DRE method is effective in regard to green subjects. As for subjects that are commonly seen, their spectral distribution showed a broad shape, and the reconstructed images with DRE had high PSNRs. Moreover, even for the subject with a peaky spectral distribution (such as an LED), PSNR value was high. This is because the spectral characteristic of the color filter used with DRE has a wide crosstalk region across the colors

Blur-free high-sensitivity imaging system utilizing combined long/short exposure green pixels

In previous work, we have proposed a high-sensitivity imaging system based on the long exposure for all the G(green) pixels, in which the inherent blur was suppressed with using both the regularization method and motion information from blur-free short-term exposed information from R(red) / B(blue) pixels. However this method was ineffective if detected motion information is inaccurate. As a result, an inadequate accuracy of motion information lost image quality and caused blur image. In this study, we propose a new high-sensitivity imaging system that is stable under such a condition. We arrange long- and short-term exposed G pixels for each line alternatively. With combining regularization method and blur-free G pixel information obtained from the short-term exposure, the proposed system does not require motion information. Then reconstruction images of our proposed system include no blur even if accurate motion detection is difficult.