J. C. Fernandez

Reference based holoscopic 3D camera aperture stitching for widening the overall viewing angle

Holoscopic 3D imaging also known as Integral imaging is a promising technique for creating full color 3D optical models that exist in space independently of the viewer. The images exhibit continuous parallax throughout the viewing zone. In order to achieve depth control, robust and real-time, a single aperture holoscopic 3D imaging camera is used for recording holoscopic 3D image using a regularly spaced array of small lenslets, which view the scene at a slightly different angle to its neighbor. However, the main problem the holoscopic 3D camera aperture faces is that it is not big enough for recording larger scene with existing 2D camera sensors. This paper proposes a novel reference based holoscopic 3D camera aperture stitching method that enlarges overall viewing angle of the holoscopic 3D camera in post-production after the capture.

Pre-processing of holoscopic 3D image for autostereoscopic 3D displays

Holoscopic 3D imaging also known as Integral imaging is an attractive technique for creating full color 3D optical models that exist in space independently of the viewer. The constructed 3D scene exhibits continuous parallax throughout the viewing zone. In order to achieve depth control, robust and real-time, a single aperture holoscopic 3D imaging camera is used for recording holoscopic 3D image using a regularly spaced array of microlens arrays, which view the scene at a slightly different angle to its neighbor. However, the main problem is that the microlens array introduces a dark borders in the recorded image and this causes errors at playback on the holoscopic 3D Display. This paper proposes a reference based pre-processing of holoscopic 3D image for autostereoscopic holoscopic 3D displays. The proposed method takes advantages of microlens as reference point to detect amount of introduced dark borders and reduce/remove them from the holoscopic 3D image.

Super depth-map rendering by converting holoscopic viewpoint to perspective projection

The expansion of 3D technology will enable observers to perceive 3D without any eye-wear devices. Holoscopic 3D imaging technology offers natural 3D visualisation of real 3D scenes that can be viewed by multiple viewers independently of their position. However, the creation of a super depth-map and reconstruction of the 3D object from a holoscopic 3D image is still in its infancy. The aim of this work is to build a high-quality depth map of a real 3D scene from a holoscopic 3D image through extraction of multi-view high resolution Viewpoint Images (VPIs) to compensate for the poor features of VPIs. To manage this, we propose a reconstruction method based on the perspective formula to convert sets of directional orthographic low resolution VPIs into perspective projection geometry. Following that, we implement an Auto-Feature point algorithm for synthesizing VPIs to distinctive Feature-Edge (FE) blocks to localize and provide an individual feature detector that is responsible for integration of 3D information. Detailed experiments proved the reliability and efficiency of the proposed method, which outperforms state-of-the-art methods for depth map creation.

Distributed pixel mapping for refining dark area in parallax barriers based holoscopic 3D Display

Autostereoscopic 3D Display is robustly developed and available in the market for both home and professional users. However 3D resolution with acceptable 3D image quality remains a great challenge. This paper proposes a novel pixel mapping method for refining dark areas between two pinholes by distributing it into 3 times smaller dark areas and creating micro-pinholes in parallax barriers based holoscopic 3D displays. The proposed method allows to project RED, GREEN, BLUE subpixels separately from 3 different pinholes and it distributes the dark spaces into 3 times smaller dark spaces, which become unnoticeable and improves quality of the constructed holoscopic 3D scene significantly. Parallax barrier technology refers to a pinhole sheet or device placed in front or back of a liquid crystal display, allowing to project viewpoint pixels into space that reconstructs a holoscopic 3D scene in space. The holoscopic technology mimics the imaging system of insects, such as the fly, utilizing a single camera, equipped with a large number of micro-lenses or pinholes, to capture a scene, offering rich parallax information and enhanced 3D feeling without the need of wearing specific eyewear.

Three-dimensional integral image reconstruction based on viewpoint interpolation

This paper presents new algorithm for improving the visual definition quality of real integral images computationally throughimage reconstructing. The proposed algorithm takes advantage of true 3D “Integral imaging”. A real world scene is recorded based on the flys eye technique, which is simulated by an array of microlenses.. The proposed method works on orthographic viewpoint images, where shift-and-integration of the neighboring viewpoints are used with quadratic interpolation to increase the visual quality on the final image. This process returns a standard photographic image with enhanced image quality. Detailed experiments have been conducted to demonstrate the effectiveness of proposed method and results are offered.

Holoscopic 3D image rendering for Autostereoscopic Multiview 3D Display

The Autostereoscopic Multiview 3D Display is robustly developed and widely adopted by both home and professional users however Multiview 3D content generation remains a great challenge. This paper proposes a novel method for Multiview 3D content generation and it describes the necessary steps for Holoscopic 3D image rendering for autostereoscopic Multiview 3D display. The Holoscopic imaging technology mimics the imaging system of insects, such as the fly, utilizing a single camera, equipped with a large number of micro-lenses, to capture a scene, offering rich parallax information and enhanced 3D feeling without the need of wearing specific eyewear. In addition a 3D pixel mapping/conversion algorithm has been developed that is supported by the Multiview 3D display.

Scene depth extraction from Holoscopic Imaging technology

3D Holoscopic Imaging (3DHI) is a promising technique for viewing natural continuous parallax 3D objects within a wide viewing zone using the principle of “Flys eye”. The 3D content is captured using a single aperture camera in real-time and represents a true volume spatial optical model of the object scene. The 3D content viewed by multiple viewers independently of their position, without 3D eyewear glasses. The 3DHI technique merely requires a single recording that the acquisition of the 3D information and the compactness of depth measurement that is used has been attracting attention as a novel depth extraction technique. This paper presents a new corresponding and matching technique based on a novel automatic Feature-Match Selection (FMS) algorithm. The aim of this algorithm is to estimate and extract an accurate full parallax 3D model form from a 3D Omni-directional Holoscopic Imaging (3DOHI) system. The basis for the novelty of the paper is on two contributions: feature blocks selection and corresponding automatic optimization process. There are solutions for three main problems related to the depth map estimation from 3DHI: uncertainty and region homogeneity at image location, dissimilar displacements within the matching block around object borders, and computational complexity.

Omnidirectional Holoscopic 3D content generation using dual orthographic projection

In recent years there has been a considerable amount of development work been made in the area of Three-Dimensional (3D) imaging systems and displays. Such systems have attracted the attention and have been widely consumed by both home and professional users in sectors such as entertainment and medicine. However, computer generated 3D content remains a challenge as the 3D scene construction requires contributions from thousands of micro images “also known as elemental images”. Rendering microlens images is very time-consuming because each microlens image is rendered by a perspective or orthographic pinhole camera in a computer generated environment. In this paper we propose and present the development of a new method to simplify and speed-up the rendering process in computer graphics. We also describe omnidirectional 3D image recoding using a two-layer orthographic camera. Results show that its rendering performance makes it an ideal candidate for real-time/interactive 3D content visualization application(s).

Dynamic hyperlinker for 3D content search and retrieval

Recently, 3D display technology, and content preparation and creation tools have been under vigorous development. Consequently, they are also widely adopted by home and professional users. 3D digital repositories are increasing and becoming available ubiquitously. However, there is not yet a single 3D content search and retrieval platform. In this paper, we propose and present the development of a novel approach for 3D content search and retrieval which is called Dynamic hyperlinker for 3D content search and retrieval. It advances 3D multimedia navigability and searchability by creating dynamic links for selectable and clickable objects in the scene while the 3D video clip is being replayed. The proposed system involves 3D video processing, such as detecting/tracking clickable objects, annotating objects, and metadata engineering. Such system attracts the attention from both home and professional users such as broadcasters and digital content providers. The experiment is conducted on Holoscopic 3D images “also known as integral images”.

Generating stereoscopic 3D from holoscopic 3D

In this paper a single aperture motion picture camera based on holoscopic imaging used to generate high-resolution stereoscopic image. The idea of single aperture camera reduces the very cumbersome and expensive of dual cameras in stereoscopic production. The camera is known as light field camera, which was first proposed in 1908 by lippmann [1]. The rendering method relied on upsampling, shift and integrating of different views to extract stereo images. This is the first experiment attempted to generate stereo form holoscopic content on motion capturing, where researchers so far have been experimenting on still images. In this paper presents motion picture image rendering on holoscopic content to generate content for stereoscopic systems. We have carried out experiments with focused ploneptic camera on a single stage omnidirectional integral camera arrangement with capturing both horizontal and vertical parallax, using a low cost lens array and relay lens. Our results show an improvement in the resolution of images with artifact free and also the rendered stereo content are played back on polarized stereoscopic system and anaglyph system to perceive the 3D depth using filter glasses in our experimental section.