Zahir Y. Alpaslan

Three-dimensional interaction with autostereoscopic displays

A low temperature curing polyurethane coating system is provided which enables the deposition of adherent corrosion resistant coatings having a desirable balance of hardness and flexibility by using a mixture of a solution copolymer of from 55-85% styrene with the balance of the copolymer consisting essentially of monoethylenically unsaturated hydroxy functional monomer, the copolymer being in solution in inert organic solvent, and an organic polyisocyanate. The polyisocyanate is kept separate from the copolymer solution until the desired liquid mixture is formed and used. Steel substrates coated with this coating system are cured without exceeding 250 DEG F.

Multiple camera image acquisition models for multi-view 3D display interaction

Multi-view autostereoscopic (AS) displays are a recently developed technology that allows several viewers to see stereo 3D images without the use of glasses or goggles. Our system enables users to interact with real or virtual 3D displayed objects by means of a hand-held cursor or (in the future) through hand gestures. In this paper we mathematically derive two multicamera image acquisition models for multi-view AS displays. These models describe the relationship of object coordinates to camera, screen and image coordinates. We present some examples of virtual objects rendered using the models.

Depth assisted compression of full parallax light fields

Full parallax light field displays require high pixel density and huge amounts of data. Compression is a necessary tool used by 3D display systems to cope with the high bandwidth requirements. One of the formats adopted by MPEG for 3D video coding standards is the use of multiple views with associated depth maps. Depth maps enable the coding of a reduced number of views, and are used by compression and synthesis software to reconstruct the light field. However, most of the developed coding and synthesis tools target linearly arranged cameras with small baselines. Here we propose to use the 3D video coding format for full parallax light field coding. We introduce a view selection method inspired by plenoptic sampling followed by transform-based view coding and view synthesis prediction to code residual views. We determine the minimal requirements for view sub-sampling and present the rate-distortion performance of our proposal. We also compare our method with established video compression techniques, such as H.264/AVC, H.264/MVC, and the new 3D video coding algorithm, 3DV-ATM. Our results show that our method not only has an improved rate-distortion performance, it also preserves the structure of the perceived light fields better.

Effects of gender, application, experience, and constraints on interaction performance using autostereoscopic displays

We describe a set of experiments that compare 2D CRT, shutter glasses and autostereoscopic displays; measure user preference for different tasks in different displays; measure the effect of previous user experience in the interaction performance for new tasks; and measure the effect of constraining the users hand motion and hand-eye coordination. In this set of tests, we used interactive object selection and manipulation tasks using standard scalable configurations of 3D block objects. We also used a 3D depth matching test in which subjects are instructed to align two objects located next to each other on the display to the same depth plane. New subjects tested with hands out of field of view constraint performed more efficiently with glasses than with autostereoscopic displays, meaning they were able to match the objects with less movement. This constraint affected females more negatively than males. From the results of the depth test, we note that previous subjects on average performed better than the new subjects. Previous subjects had more correct results than the new subjects, and they finished the test faster than the new subjects. The depth test showed that glasses are preferred to autostereo displays in a task that involves only stereoscopic depth.

Light field display simulation for light field quality assessment

We introduce our light field display simulation software that simulates the image observed by a viewer looking at a full parallax light field display. The simulation software uses the display parameters, viewer location and orientation, viewer pupil size and focus location to simulate the image observed by the viewer. This software has been used in simulating full parallax light field displays of various geometry and complexities as well as image processing and full parallax light field compression algorithms. The simulation results follow the real world observations very closely.

Development and deployment of a tiled full parallax light field display system

Ostendo’s Quantum Photonic Imager (QPI) is very small pixel pitch, emissive display with high brightness and low power consumption. We used QPI’s to create a high performance light field display tiles with a very small form factor. Using these light field display tiles various full parallax light field displays demonstrating small form factor, high resolution and focus cues were created. In this paper, we will explain the design choices that were made in creating the displays and their effects on the display performance. This paper details the system design approach including: hardware design, software design, compression methods and human factors.

Small form factor full parallax tiled light field display

With the recent introduction of Ostendo’s Quantum Photonic Imager (QPI) display technology, a very small pixel pitch, emissive display with high brightness and low power consumption became available. We used QPI’s to create a high performance light field display tiles with a very small form factor. Using 8 of these QPI light field displays tiled in a 4x2 array we created a tiled full parallax light field display. Each individual light field display tile combines custom designed micro lens array layers with monochrome green QPIs. Each of the light field display tiles can address 1000 x 800 pixels placed under an array of 20 x 16 lenslets with 500 μm diameters. The light field display tiles are placed with small gaps to create a tiled display of approximately 46 mm (W) x 17 mm (H) x 2 mm (D) in mechanical dimensions. The prototype tiled full parallax light field display demonstrates small form factor, high resolution and focus cues.

Information processing challenges of full parallax light field displays

Currently under development high fidelity and interactive full parallax light field displays have unique and challenging requirements due to human factors and space constraints imposed on them. A high fidelity light field display with no vergence accommodation conflict and desktop size foot print implies a display with tens of gigapixels and pixel pitch in the range of 10 microns or below. Achieving interactive image and video display performance on these types of displays requires a fundamental redesign of the display input interface and image processing pipeline. In this paper, we discuss various ways of addressing these issues with light field compression and display system design innovations.

JPEG Pleno: a standard framework for representing and signaling plenoptic modalities

In recent years, we have observed the advent of plenoptic modalities such as light fields, point clouds and holography in many devices and applications. Besides plenty of technical challenges brought by these new modalities, a particular challenge is arising at the horizon, namely providing interoperability between these devices and applications, and – in addition – at a cross-modality level. Based on these observations the JPEG committee (ISO/IEC JTC1/SC29/WG1 and ITU-T SG16) has initiated a new standardization initiative – JPEG Pleno – that is intended to define an efficient framework addressing the above interoperability issues. In this paper, an overview is provided about its current status and future plans.

Optical multi-token-ring networking using smart pixels with field programmable gate arrays (FPGAs)

This research explores architectures and design principles for monolithic optoelectronic integrated circuits (OEICs) through the implementation of an optical multi-token-ring network testbed system. Monolithic smart pixel CMOS OEICs are of paramount importance to high performance networks, communication switches, computer interfaces, and parallel signal processing for demanding future multimedia applications. The general testbed system is called Reconfigurable Translucent Smart Pixel Array (R-Transpar) and includes a field programmable gate array (FPGA), a transimpedance receiver array, and an optoelectronic very large-scale integrated (OE-VLSI) smart pixel array. The FPGA is an Altera FLEX10K100E chip that performs logic functions and receives inputs from the transimpedance receiver array. A monolithic (OE-VLSI) smart pixel device containing an array of 4 X 4 vertical-cavity surface-emitting lasers (VCSELs) spatially interlaced with an array of 4 X 4 metal- semiconductor-metal (MSM) detectors connects to these devices and performs optical input-output functions. These components are mounted on a printed circuit board for testing and evaluation of integrated monolithic OEIC designs and various optical interconnection techniques. The system moves information between nodes by transferring 3-D optical packets in free space or through fiber image guides. The R-Transpar system is reconfigurable to test different network protocols and signal processing functions. In its operation as a 3-D multi-token-ring network, we use a specific version of the system called Transpar-Token-Ring (Transpar-TR) that uses novel time-division multiplexed (TDM) network node addressing to enhance channel utilization and throughput. Host computers interface with the system via a high-speed digital I/O board that sends commands for networking and application algorithm operations. We describe the system operation and experimental results in detail.