Gadi Geiger

Trainable videorealistic speech animation

We describe how to create with machine learning techniques a generative, videorealistic, and speech animation module. A human subject is first recorded using a videocamera as he/she utters a pre-determined speech corpus. After processing the corpus automatically, a visual speech module is learned from the data that is capable of synthesizing the human subjects mouth uttering entirely novel utterances that were not recorded in the original video. The synthesized utterance is re-composited onto a background sequence, which contains natural head and eye movement. The final output is videorealistic in the sense that it looks like a video camera recording of the subject. At run time, the input to the system can be either real audio sequences or synthetic audio produced by a text-to-speech system, as long as they have been phonetically aligned.

Wide and Diffuse Perceptual Modes Characterize Dyslexics in Vision and Audition

We examined the performance of dyslexic and typically reading children on two analogous recognition tasks: one visual and the other auditory. Both tasks required recognition of centrally and peripherally presented stimuli. Dyslexics recognized letters visually farther in the periphery and more diffuse near the center than typical readers did. Both groups performed comparably in recognizing centrally spoken stimuli presented without peripheral interference, but in the presence of a surrounding speech mask (the ‘cocktail-party effect’) dyslexics recognized the central stimuli significantly less well than typical readers. However, dyslexics had a higher ratio of the number of words recognized from the surrounding speech mask, relative to the ones from the center, than typical readers did. We suggest that the evidence of wide visual and auditory perceptual modes in dyslexics indicates wider multi-dimensional neural tuning of sensory processing interacting with wider spatial attention.

The Muller-Lyer figure and the fly

In the Muller-Lyer illusion two horizontal line segments of equal length are perceived by humans as unequal. The gaze of a fly presented with Muller-Lyer figures corresponds to human eye movements and human (illusionary) evaluations of the segment lengths. It is suggested that a theory similar to the phenomenological theory which accounts for the flys gaze may account for the human eyes movement during an observation of Muller-Lyer figures.