Seokil Moon

Additive light field displays: realization of augmented reality with holographic optical elements

We propose a see-through additive light field display as a novel type of compressive light field display. We utilize holographic optical elements (HOEs) as transparent additive layers. The HOE layers are almost free from diffraction unlike spatial light modulator layers, which makes this additive light field display more advantageous when modifying the number of layers, thickness, and pixel density compared with conventional compressive displays. Meanwhile, the additive light field display maintains advantages of compressive light field displays. The proposed additive light field display shows bright and full-color volumetric images in high definition. In addition, users can view real-world scenes beyond the displays. Hence, we expect that our method can contribute to the realization of augmented reality. Here, we describe implementation of a prototype additive light field display with two additive layers, evaluate the performance of transparent HOE layers, describe several results of display experiments, discuss the diffraction effect of spatial light modulators, and analyze the ability of the additive light field display to express uncorrelated light fields.

Compact three-dimensional head-mounted display system with Savart plate.

We propose three-dimensional (3D) head-mounted display (HMD) providing multi-focal and wearable functions by using polarization-dependent optical path switching in Savart plate. The multi-focal function is implemented as micro display with high pixel density of 1666 pixels per inches is optically duplicated in longitudinal direction according to the polarization state. The combination of micro display, fast switching polarization rotator and Savart plate retains small form factor suitable for wearable function. The optical aberrations of duplicated panels are investigated by ray tracing according to both wavelength and polarization state. Astigmatism and lateral chromatic aberration of extraordinary wave are compensated by modification of the Savart plate and sub-pixel shifting method, respectively. To verify the feasibility of the proposed system, a prototype of the HMD module for monocular eye is implemented. The module has the compact size of 40 mm by 90 mm by 40 mm and the weight of 131 g with wearable function. The micro display and polarization rotator are synchronized in real-time as 30 Hz and two focal planes are formed at 640 and 900 mm away from eye box, respectively. In experiments, the prototype also provides augmented reality function by combining the optically duplicated panels with a beam splitter. The multi-focal function of the optically duplicated panels without astigmatism and color dispersion compensation is verified. When light field optimization for two additive layers is performed, perspective images are observed, and the integration of real world scene and high quality 3D images is confirmed.

See-through multi-projection three-dimensional display using transparent anisotropic diffuser

We propose a see-through multi-projection three-dimensional (3D) display using a transparent anisotropic diffuser. By immersing a metal-coated anisotropic diffuser into index matching oil which has the same refractive index of anisotropic diffuser, a transparent anisotropic diffuser is implemented. The reflectance of the transparent anisotropic diffuser is analyzed with the transfer matrix. Two multi-projection methods are proposed based on reflection type integral imaging and multi-view method. Especially, the reflection type multi-view-based system is realized with a curved anisotropic diffuser. High resolution see-through 3D display can be realized with the proposed methods. They can be used in various applications with the two multi-projection methods. In order to show the augmented reality features, real objects and virtual 3D images are presented at the same time in the experimental setup.

Viewing zone duplication of multi-projection 3D display system using uniaxial crystal.

We propose a novel multiplexing technique for increasing the viewing zone of a multi-view based multi-projection 3D display system by employing double refraction in uniaxial crystal. When linearly polarized images from projector pass through the uniaxial crystal, two possible optical paths exist according to the polarization states of image. Therefore, the optical paths of the image could be changed, and the viewing zone is shifted in a lateral direction. The polarization modulation of the image from a single projection unit enables us to generate two viewing zones at different positions. For realizing full-color images at each viewing zone, a polarization-based temporal multiplexing technique is adopted with a conventional polarization switching device of liquid crystal (LC) display. Through experiments, a prototype of a ten-view multi-projection 3D display system presenting full-colored view images is implemented by combining five laser scanning projectors, an optically clear calcite (CaCO3) crystal, and an LC polarization rotator. For each time sequence of temporal multiplexing, the luminance distribution of the proposed system is measured and analyzed.

Computational multi-projection display

A computational multi-projection display is proposed by employing a multi-projection system combining with compressive light field displays. By modulating the intensity of light rays from a spatial light modulator inside a single projector, the proposed system can offer several compact views to observer. Since light rays are spread to all directions, the system can provide flexible positioning of viewpoints without stacking projectors in vertical direction. Also, if the system is constructed properly, it is possible to generate view images with inter-pupillary gap and satisfy the super multi-view condition. We explain the principle of the proposed system and verify its feasibility with simulations and experimental results.

Compact multi-projection 3D display system with light-guide projection.

We propose a compact multi-projection based multi-view 3D display system using an optical light-guide, and perform an analysis of the characteristics of the image for distortion compensation via an optically equivalent model of the light-guide. The projected image traveling through the light-guide experiences multiple total internal reflections at the interface. As a result, the projection distance in the horizontal direction is effectively reduced to the thickness of the light-guide, and the projection part of the multi-projection based multi-view 3D display system is minimized. In addition, we deduce an equivalent model of such a light-guide to simplify the analysis of the image distortion in the light-guide. From the equivalent model, the focus of the image is adjusted, and pre-distorted images for each projection unit are calculated by two-step image rectification in air and the material. The distortion-compensated view images are represented on the exit surface of the light-guide when the light-guide is located in the intended position. Viewing zones are generated by combining the light-guide projection system, a vertical diffuser, and a Fresnel lens. The feasibility of the proposed method is experimentally verified and a ten-view 3D display system with a minimized structure is implemented.

Layered Display with Accommodation Cue Using Scattering Polarizers

A projection-type layered display inducing the accommodation cue is proposed. To support the accommodation cue, the concept of multiplane displays, especially the principle of additive type compressive light field display, is adopted. To achieve the additive type light field display, two layered scattering polarizers and a single projector which is synchronized with polarization rotator are used. Scattering polarizer diffuses light rays with specific linear polarization state while transmits the other rays with the orthogonal polarization state. Utilizing this characteristic, two layer images can be displayed at different depths presenting multiplane display. By adopting an additional computational process, several viewpoints can be provided to a single eye and support the accommodation cue. We expect that the proposed method can be adopted to virtual reality system. Detailed principle of the proposed system and its feasibility are explained with simulations and experiments.

Depth-Fused Multi-Projection Display using Scattering Polarizers

Multi-projection displays have advantages of representing high-resolution three-dimensional (3D) images compared to panel type 3D displays. We propose another type of multi-projection display which provides the focal cue using depth-fused algorithm. The system adopts layered scattering polarizers and Fresnel lens to achieve multi-plane display. Since scattering polarizer performs as a reflective or transmissive diffuser for the light with the specific polarization state, it is possible to generate two layer images at different depth using a single projector with synchronized polarization rotator. We explain the principle of the proposed system and verify its feasibility with simulations and experimental results.

Metasurface eyepiece for augmented reality

Recently, metasurfaces composed of artificially fabricated subwavelength structures have shown remarkable potential for the manipulation of light with unprecedented functionality. Here, we first demonstrate a metasurface application to realize a compact near-eye display system for augmented reality with a wide field of view. A key component is a see-through metalens with an anisotropic response, a high numerical aperture with a large aperture, and broadband characteristics. By virtue of these high-performance features, the metalens can overcome the existing bottleneck imposed by the narrow field of view and bulkiness of current systems, which hinders their usability and further development. Experimental demonstrations with a nanoimprinted large-area see-through metalens are reported, showing full-color imaging with a wide field of view and feasibility of mass production. This work on novel metasurface applications shows great potential for the development of optical display systems for future consumer electronics and computer vision applications.Here, the authors demonstrate a metasurface application to realize a compact near-eye display system for augmented reality with a wide field of view, full-color imaging, high resolution and a sufficiently large eyebox.

Hybrid light-field display

In this paper, a new type of light field display by combining additive and multiplicative light field displays is proposed. Combination of the two types of compressive light field displays makes the system compact, improves the light efficiency, and alleviates the diffraction effect. The system implements four physical image planes to widen the depth range. Layer image optimization algorithm suitable for the proposed system is introduced. In result, the target light field is decomposed into four different layer images. We explain the principle of the proposed system and verify its feasibility with simulation and experimental results.