Noa M. Rensing

Evaluation of a prototype Minified Augmented-View device for patients with impaired night vision.

An evaluation was carried out of the first prototype (LV‐3) of a new night vision device, which incorporates visual field expansion through minification (Minified Augmented‐View), to provide feedback for continuing development. Six subjects with night blindness completed visual function measurements and indoor mobility assessments without a device, with the LV‐3 and with a commercially available comparison device (the Multi‐Vision) at light levels representative of well lit and poorly lit streets. Device performance and potential benefits in real‐world situations were evaluated at four outdoor locations (well lit to very dark). Results indicate that the see‐through nature and spectacle‐frame mounting of the LV‐3 address some of the cosmetic and ergonomic disadvantages of currently available devices; however insufficient light sensitivity of the prototype camera limited LV‐3 performance. With improved camera sensitivity and full implementation of the Minified‐Contours Augmented‐View concept in the next prototype, patients might be able to make better use of the novel field expansion and vision multiplexing features to aid outdoor night mobility.

Applications of Augmented Vision Head-Mounted Systems in Vision Rehabilitation

Vision loss typically affects either the wide peripheral vision (important for mobility), or central vision (important for seeing details). Traditional optical visual aids usually recover the lost visual function, but at a high cost for the remaining visual function. We have developed a novel concept of vision-multiplexing using augmented vision head-mounted display systems to address vision loss. Two applications are discussed in this paper. In the first, minified edge images from a head-mounted video camera are presented on a see-through display providing visual field expansion for people with peripheral vision loss, while still enabling the full resolution of the residual central vision to be maintained. The concept has been applied in daytime and nighttime devices. A series of studies suggested that the system could help with visual search, obstacle avoidance, and nighttime mobility. Subjects were positive in their ratings of device cosmetics and ergonomics. The second application is for people with central vision loss. Using an on-axis aligned camera and display system, central visibility is enhanced with 1:1 scale edge images, while still enabling the wide field of the unimpaired peripheral vision to be maintained. The registration error of the system was found to be low in laboratory testing.

DEVELOPMENT AND EVALUATION OF VISION MULTIPLEXING DEVICES FOR VISION IMPAIRMENTS.

We have proposed a novel concept of vision multiplexing for the visually impaired - superimposing contour images over their natural view of a scene or over original images presented on a TV screen. We have implemented the concept using an optical see-through head mounted display to provide either visual field expansion to patients with peripheral field loss or vision enhancement to patients with central vision loss. We have also implemented the concept in a video player with dynamic magnification for patients with central vision loss. Results of initial testing in the lab and on the street are promising.

Registration of an on-axis see-through head-mounted display and camera system

An optical see-through head-mounted display (HMD) system integrating a miniature camera that is aligned with the users pupil is developed and tested. Such an HMD system has a potential value in many augmented reality applications, in which registration of the virtual display to the real scene is one of the critical aspects. The camera alignment to the users pupil results in a simple yet accurate calibration and a low registration error across a wide range of depth. In reality, a small camera-eye misalignment may still occur in such a system due to the inevitable variations of HMD wearing position with respect to the eye. The effects of such errors are measured. Calculation further shows that the registration error as a function of viewing distance behaves nearly the same for different virtual image distances, except for a shift. The impact of prismatic effect of the display lens on registration is also discussed.

Threat response: a compelling application for wearable computing

This paper explores the application of wearable computer systems to threat response, exemplified by the multi-functional micro-controllable interface module (MMIM)/digital military policeman (DMP) system. The system consists of a wearable computer, eyewear interface developed by MicroOptical comprising display, camera, and audio, and software incorporating the FaceIt face recognition algorithms developed by Identix (formerly, Visionics). This system will enhance gate security at military installations by enabling guards to use automated face recognition to verify the identity of visitors and check the database of known threatening individuals automatically.

Video I/O interface for wearable computers

This paper is a report of work in progress toward the development and testing of a computer interface mounted in eyewear, and capable of both input and output functions. The unique feature of this interface is the use of advanced embedded optical techniques to form eyeglass lenses capable of relaying images internally, without significant optical components in front of the users face. These optical techniques make possible the incorporation of both a camera and display within eyeglasses. The interface also includes audio input and output. The paper discusses methods of constructing such an interface, design considerations, and will describe work in progress to realize working models.

Optical approaches to incorporation of displays within eyeglasses

We report the development of a new approach to design and fabrication of eyeglass-based displays. The principal feature of this technique is the incorporation of an optical relay between the display and the eye within the eyeglass lens, and the incorporation of a display within the eyeglass temple. Color eyeglass-based displays are described.

22.4: Invited Paper: Augmented Vision Head-Mounted Systems for Vision Impairments

developed, implemented and tested a novel concept of vision-multiplexing using augmented vision systems for people with vision impairments. Minified contour images from a head-mounted, miniature video camera are presented on a see-through display providing visual field expansion while still enabling the full resolution of the residual central vision to be maintained. 1. Background With normal vision we enjoy the benefits of a wide field of view, primarily used for navigation and orientation, together with high- resolution capabilities that enable discrimination of fine details. Visual impairments due to disease or injury typically affect only one of these aspects, either restricting the wide peripheral visual field (VF) in conditions such as retinitis pigmentosa (RP) and glaucoma, or damaging the high-resolution fovea in conditions such as age- related macular degeneration (AMD). When peripheral VF loss is severe (leaving useful VFs less than 20° in diameter - tunnel vision), a patients mobility can be affected due to reduced ability to spot obstacles and difficulties in navigation. Social interactions of patients may be affected by failing to note or respond to people appropriately. In addition, RP and related diseases often cause night blindness due to early loss of rods.

Toward eyeglasses-based electronic displays

The development of a head mounted display concealed within eyeglasses has been a long term objective of many head mounted display (HMD) development efforts. This paper will review design concepts from the literature, with a view toward assessing the practical merits of the various approaches. The factors of importance in miniaturizing a HMD will be summarized. Finally, we will briefly summarize some new approaches including the use of alternative display technology that may lead to a display system hidden within eyeglasses frames.

Eyewear-based displays for personal electronics

This paper addresses the development of eyewear based displays for portable, personal electronics. The personal electronic system applications include the wearable personal computer, portable digital video disk player, and the cellular telephone. We describe progress on integrated eyewear systems, as well as on clip-on systems that can attach to ordinary eyewear. We conclude with a short description of a system that will include a camera, display, and audio system.