Nikolaus F. Troje

Decomposing biological motion: A framework for analysis and synthesis of human gait patterns

Biological motion contains information about the identity of an agent as well as about his or her actions, intentions, and emotions. The human visual system is highly sensitive to biological motion and capable of extracting socially relevant information from it. Here we investigate the question of how such information is encoded in biological motion patterns and how such information can be retrieved. A framework is developed that transforms biological motion into a representation allowing for analysis using linear methods from statistics and pattern recognition. Using gender classification as an example, simple classifiers are constructed and compared to psychophysical data from human observers. The analysis reveals that the dynamic part of the motion contains more information about gender than motion-mediated structural cues. The proposed framework can be used not only for analysis of biological motion but also to synthesize new motion patterns. A simple motion modeler is presented that can be used to visualize and exaggerate the differences in male and female walking patterns.

Face recognition under varying poses: The role of texture and shape

Although remarkably robust, face recognition is not perfectly invariant to pose and viewpoint changes. It has long been known that both profile and full-face views result in poorer recognition performance than a 3/4 view. However, little data exist which investigate this phenomenon in detail. The present work provides such data using a high angular resolution and a large range of poses. Since there are inconsistencies in the literature concerning these issues, we emphasize the different roles of the learning view and the testing view in the recognition experiment. We also emphasize the roles of information contained in the texture and in the shape of a face. Our stimuli were generated from laser-scanned head models and contained either the natural texture or only Lambertian shading and no texture. The results of our same/different face recognition experiments are: (1) only the learning view but not the testing view affects recognition performance. (2) For textured faces the optimal learning view is closer to the full-face view than for the shaded faces. (3) For shaded faces, we find a significantly better recognition performance for the symmetric view. The results can be interpreted in terms of different strategies to recover invariants from texture and from shading.

The Inversion Effect in Biological Motion Perception: Evidence for a “Life Detector”?

If biological-motion point-light displays are presented upside down, adequate perception is strongly impaired. Reminiscent of the inversion effect in face recognition, it has been suggested that the inversion effect in biological motion is due to impaired configural processing in a highly trained expert system. Here, we present data that are incompatible with this view. We show that observers can readily retrieve information about direction from scrambled point-light displays of humans and animals. Even though all configural information is entirely disrupted, perception of these displays is still subject to a significant inversion effect. Inverting only parts of the display reveals that the information about direction, as well as the associated inversion effect, is entirely carried by the local motion of the feet. We interpret our findings in terms of a visual filter that is tuned to the characteristic motion of the limbs of an animal in locomotion and hypothesize that this mechanism serves as a general detection system for the presence of articulated terrestrial animals.

Ultraviolet as a Component of Flower Reflections, and the Colour Perception of Hymenoptera

Based on the measurements of 1063 flower reflection spectra, we show that flower colours fall into distinct clusters in the colour space of a bee. It is demonstrated that this clustering is caused by a limited variability in the floral spectral reflectance curves. There are as few as 10 distinct types of such curves, five of which constitute 85% of all measurements. UV reflections are less frequent and always lower in intensity than reflections in other parts of the spectrum. A further cluster of colour loci is formed in the centre of the colour space. It contains the colour loci of green leaves, several other background materials and only very few flowers. We propose a system to classify the reflection functions of flowers, and a set of colour names for bee colours.

Paper windows: interaction techniques for digital paper

In this paper, we present Paper Windows, a prototype windowing environment that simulates the use of digital paper displays. By projecting windows on physical paper, Paper Windows allows the capturing of physical affordances of paper in a digital world. The system uses paper as an input device by tracking its motion and shape with a Vicon Motion Capturing System. We discuss the design of a number of interaction techniques for manipulating information on paper displays.

Person identification from biological motion: Effects of structural and kinematic cues

Human observers are able to identify a person based on his or her gait. However, little is known about the underlying mechanisms and the kind of information used to accomplish such a task. In this study, participants learned to discriminate seven male walkers shown as point-light displays from frontal, half-profile, or profile view. The displays were gradually normalized with respect to size, shape, and walking frequency, and identification performance was measured. All observers quickly learned to discriminate the walkers, but there was an overall advantage in favor of the frontal view. No effect of size normalization was found, but performance deteriorated when shape or walking frequency was normalized. Presenting the walkers from novel viewpoints resulted in a further decrease in performance. However, even after applying all normalization steps and rotating the walker by 90°, recognition performance was still nearly three times higher than chance level.

Perception of biological motion in autism spectrum disorders

In individuals with autism or autism-spectrum-disorder (ASD), conflicting results have been reported regarding the processing of biological motion tasks. As biological motion perception and recognition might be related to impaired imitation, gross motor skills and autism specific psychopathology in individuals with ASD, we performed a functional MRI study on biological motion perception in a sample of 15 adolescent and young adult individuals with ASD and typically developing, age, sex and IQ matched controls. Neuronal activation during biological motion perception was compared between groups, and correlation patterns of imitation, gross motor and behavioral measures with neuronal activation were explored. Differences in local gray matter volume between groups as well as correlation patterns of psychopathological measures with gray matter volume were additionally compared. On the behavioral level, recognition of biological motion was assessed by a reaction time (RT) task. Groups differed strongly with regard to neuronal activation and RT, and differential correlation patterns with behavioral as well as with imitation and gross motor abilities were elicited across and within groups. However, contrasting with the initial hypothesis, additional differences between groups were observed during perception and recognition of spatially moving point lights in general irrespective of biological motion. Results either point towards difficulties in higher-order motion perception or in the integration of complex motion information in the association cortex. This interpretation is supported by differences in gray matter volume as well as correlation with repetitive behavior bilaterally in the parietal cortex and the right medial temporal cortex. The specific correlation of neuronal activation during biological motion perception with hand-finger imitation, dynamic balance and diadochokinesis abilities emphasizes the possible relevance of difficulties in biological motion perception or impaired self-other matching for action imitation and gross motor difficulties in individuals with ASD.

Embodiment of Sadness and Depression—Gait Patterns Associated With Dysphoric Mood

Objective: To analyze gait patterns associated with sadness and depression. Embodiment theories suggest a reciprocal relationship between bodily expression and the way in which emotions are processed. Methods: In Study 1, the gait patterns of 14 inpatients suffering from major depression were compared with those of matched never-depressed participants. In Study 2, we employed musical mood induction to induce sad and positive mood in a sample of 23 undergraduates. A Fourier-based description of walking data served as the basis for the computation of linear classifiers and for the analysis of gait parameters. Results: Gait patterns associated with sadness and depression are characterized by reduced walking speed, arm swing, and vertical head movements. Moreover, depressed and sad walkers displayed larger lateral swaying movements of the upper body and a more slumped posture. Conclusion: The results of the present study indicate that a specific gait pattern characterizes individuals in dysphoric mood. ANCOVA = analysis of covariance; BDI = Beck Depression Inventory; DSM = Diagnostic and Statistical Manual of Mental Disorders; MANOVA = multivariate analysis of variance; MDD = major depressive disorder; SCID = Structured Clinical Interview for DSM-IV; SNRI = serotonin noradrenalin reuptake inhibitors; SSRI = selective serotonin reuptake inhibitors.

Adaptation aftereffects in the perception of gender from biological motion.

Human visual perception is highly adaptive. While this has been known and studied for a long time in domains such as color vision, motion perception, or the processing of spatial frequency, a number of more recent studies have shown that adaptation and adaptation aftereffects also occur in high-level visual domains like shape perception and face recognition. Here, we present data that demonstrate a pronounced aftereffect in response to adaptation to the perceived gender of biological motion point-light walkers. A walker that is perceived to be ambiguous in gender under neutral adaptation appears to be male after adaptation with an exaggerated female walker and female after adaptation with an exaggerated male walker. We discuss this adaptation aftereffect as a tool to characterize and probe the mechanisms underlying biological motion perception.

Structural encoding and recognition of biological motion: evidence from event-related potentials and source analysis.

In the present study, we investigated how different processing stages involved in the perceptual analysis of biological motion (BM) are reflected by modulations in event-related potentials (ERP) in order to elucidate the time course and location of neural processing of BM. Data analysis was carried out using conventional averaging techniques as well as source localization with low resolution brain electromagnetic tomography (LORETA). ERPs were recorded in response to point-light displays of a walking person, an inverted walking person and displays of scrambled motion. Analysis yielded a pronounced negativity with a peak at 180 ms after stimulus onset which was more pronounced for upright walkers than for inverted walkers and scrambled motion. A later negative component between 230 and 360 ms after stimulus onset had a larger amplitude for upright and inverted walkers as compared to scrambled walkers. In the later component, negativity was more pronounced in the right hemisphere revealing asymmetries in BM perception. LORETA analysis yielded evidence for sources specific to BM within the right fusiform gyrus and the right superior temporal gyrus for the second component, whereas sources for BM in the early component were located in areas associated with attentional aspects of visual processing. The early component might reflect the pop-out effect of a moving dot pattern representing the highly familiar form of a human figure, whereas the later component might be associated with the specific analysis of motion patterns providing biologically relevant information.