Chern-Sheng Lin

Design of a computer game using an eye-tracking device for eye's activity rehabilitation

An eye mouse interface that can be used to operate a computer using the movement of the eyes is described. We developed this eye-tracking system for eye motion disability rehabilitation. When the user watches the screen of a computer, a charge-coupled device will catch images of the users eye and transmit it to the computer. A program, based on a new cross-line tracking and stabilizing algorithm, will locate the center point of the pupil in the images. The calibration factors and energy factors are designed for coordinate mapping and blink functions. After the system transfers the coordinates of pupil center in the images to the display coordinate, it will determine the point at which the user gazed on the display, then transfer that location to the game subroutine program. We used this eye-tracking system as a joystick to play a game with an application program in a multimedia environment. The experimental results verify the feasibility and validity of this eye-game system and the rehabilitation effects for the users visual movement.

A digital image-based measurement system for a LCD backlight module

A LCD light guide plate is an element of the LCD backlight module that is often used for the display of compact electronic devices. In this study, a vision system is proposed to detect the degree of uniformity of light reflection using a light guide plate before the diffuser has been attached. A new bright spot search and statistical software has been designed and the parameters for the LCD light guide plate can be adjusted before manufacture to provide greater economy and make the device user friendly. Since many different types of backlight modules had to be analyzed in this study, we used different methods to determine the nonuniform factors and the backlight module area for each type. A wrapping algorithm is presented in the searching and statistic process of bright spot. This algorithm can combine the procedures of segmentation process and nonlinear grey scale mapping. After revising carved depth of the poor brightness area, the diffuser was attached and the analysis performed again to verify the design procedure correction. When the source light density is adjusted, the lighting error for the on line inspection is retained to within 3%.

A new data processing and calibration method for an eye-tracking device pronunciation system

In this paper, a new data processing and calibration method for a pronunciation system of an eye-tracking device is described. The eye-tracking device was created using both head mounted display (HMD) technology and remote operation capabilities. A pattern recognition computer program was used to distinguish the pupil position and calculate its coordinates. This system can be adapted to provide a digital speech function. A new method for processing the image of the eye in the PC-based system was also developed. With one video CCD camera and frame grabber analyzing a series of human pupil images while the subject is gazing at the screen, an auto-calibration algorithm is used to obtain the direction of the eye gaze in real time. The computers provide the speech sound according to the location where the eye gazes exceed 0:5 s. The availability of multipurpose in this eye-tracking system with very simple equipment will be recon=rmed for future advanced research. ? 2002 Elsevier Science Ltd. All rights reserved.

An eye behavior measuring device for VR system

This work presents an eye-tracking and pupil size-measuring device that interfaces with a computer for applications useful in psychometry, ophthalmology, physiology and virtual reality (VR) systems. This system utilizes a change-coupled device (CCD) camera, appropriate lenses, PC with frame grabber and a DSP unit with various types of VR equipment, i.e., HMD, simulator or LCD projection device. The digital signal processing unit is used to calculate the average brightness and contrast of the VR video image. A CCD camera with various attachments can be mounted on various VR systems to capture the human eye image for testing. An image capture card and a personal computer are used to analyze the test image. From the eye digital image, the computer obtains data on the pupil size and a trace of the tested eye. A pattern recognition computer program and five measurement parameters are used to distinguish the position of the pupil, calculate the pupil location coordinate and analyze the physical conditions of the user. These data can be plotted against the average brightness and contrast of the VR video image in real time. This information is shown on the screen of a personal computer and used for cross-link analysis. This eye-tracking interface can determine the position of a subjects pupil and map that position into a display point on a computer screen. The pupil size and location data versus the average brightness and contrast of a VR video image are computed in real time.

An image-based LCD positioning system utilizing the modified FHT method

Summary In this paper, a LCD positioning system based on an image processing method is described. This method is effective in finding the angle of the geometric features in the cross registration mask. However, when two marks appear in the same frame, the problem of situation verification becomes more complex. We use an algorithm that assists with calculating the location and rotation angle for two marks precisely and quickly using the Fast Hough Transform (FHT). This method determines the locations of two masks and calculates the rotation angle from a blurred edge to adjust the LCD position and orientation.

Rapid bio-test strips reader with image processing technology

Summary We present an algorithm of automatic vision inspection to solve the problems in a rapid bio-test strips reader. The image inspection area of a rapid bio-test strip includes control line testing zone, test line testing zone, and the assist-measuring zone of reference. By determining the central line of control line testing zone, we can calculate the central line of test line testing zone, and can calculate the characteristics of control line, test line and the reference light-field out further. We set different threshold values for each division for the different light-field to identify whether the reaction has occurred or not. The number of pixels in positive condition is usually less than that in negative condition for the divisions in the testing zone. In this bio-strips reader we can acquire the result within 0.3 seconds computer judgment after specimen rose to test line in 10–15 minutes.

The method of diagonal-box checker search for measuring one's blink in eyeball tracking device

Abstract A new method for meauring ones blink in the new human–machine interfaces have been developed in this paper. The major part of eyeball tracking technology is the feature extraction of the eyes and in the experiment we use a diagonal-box checker search to solve the problem. Prior to diagonal-box checker search, we find the feature subset and features that are needed so that we save much searchtime. The opening-and-closing action of the eyes results in other controlling commands that will be used for driving the robots to working or dialing the phone system.

The application of extension neuro-network on computer-assisted lip-reading recognition for hearing impaired

Within the communication process of human beings, the speakers facial expression and lip-shape movement contains extremely rich language information. The hearing impaired, aside from using residual listening to communicate with other people, can also use lip reading as a communication tool. As the hearing impaired learn the lip reading using a computer-assisted lip-reading system, they can freely learn lip reading without the constraints of time, place or situation. Therefore, we propose a computer-assisted lip-reading system (CALRS) for phonetic pronunciation recognition of the correct lip-shape with an image processing method, object-oriented language and neuro-network. This system can accurately compare the lip image of Mandarin phonetic pronunciation using self-organizing map neuro-network (SOMNN) and extension theory to help hearing impaired correct their pronunciation.

The laser displacement measurement with feedback control in a magnetic levitation and suspension system

In this study, we used a laser displacement sensor, which the resolution was precise over 2 μm and capable of measuring infinitesimal displacement rapidly for magnetic levitation and suspension equipment. A feedback control was applied in this system, which required quick response to voltage variations. We also derived the equations of motion to determine the stability limits and compared our calculations with the experimental results. From the experimental results, this mag-lev system, with special optical sensors and feedback circuits, is able to dynamically adjust unstable levitation positions.

Design and Evaluation of a Public Installation of an Eye-Gaze System

ABSTRACT This article evaluates an eye-tracking device (“I Can Speak With My Eyes”) designed for a museum exhibition. An eye-tracking system is designed not only for able individuals, but also for bedridden patients or physically handicapped people who intend to use computers. With one video CCD camera and frame grabber analyzing a series of images taken of the human pupil gazing at a screen, an auto-range-finding algorithm can be used to obtain the location of the pupil in real time. The computers will produce speech according to the location of where the eyes are gazing. In essence, the participants can speak with their eyes to achieve the advantages of learning and communicating. After the system was implemented, an experimental evaluation with innovation diffusion theory was conducted to survey users’ feelings regarding the system. The implications of the evaluation findings are discussed to aid further research and education.