So Kanazawa

Judgment of Gender through Facial Parts

Japanese male and female undergraduate students judged the gender of a variety of facial images. These images were combinations of the following facial parts: eyebrows, eyes, nose, mouth, and the face outline (cheek and chin). These parts were extracted from averaged facial images of Japanese males and females aged 18 and 19 years by means of the Facial Image Processing System. The results suggested that, in identifying gender, subjects performed identification on the basis of the eyebrows and the face outline, and both males and females were more likely to identify the faces as those of their own gender. The results are discussed in relation to previous studies, with particular attention paid to the matter of race differences.

Perception of Object Unity in a Chimpanzee (Pan troglodytes)

Perception of object unity was studied in an 18-year-old female chimpanzee (Pan troglodytes) using a two-choice delayed matching-to-sample task. The subject was trained with two rod-shaped figures which were exactly identical except that one of them had a small gap at its center. After mastering this baseline task, she was shown the figure with its center occluded by a colored rectangle. We examined the perception of the subjects matching response on either the complete or the broken rod to investigate how she perceived these partly invisible figures. In four separate experiments, the alignment and the movement of the portions above and below the occluding rectangle were manipulated. She matched the partly occluded stimuli to the complete rod as long as the alignment was sufficient. The results suggest that like human adults, the chimpanzee can perceive unity of physically separated figures.

Distinct differences in the pattern of hemodynamic response to happy and angry facial expressions in infants--a near-infrared spectroscopic study.

Recognition of other peoples facial expressions of emotion plays an important role in social communication in infants as well as adults. Evidence from behavioral studies has demonstrated that the ability to recognize facial expressions develops by 6 to 7 months of age. Although the regions of the infant brain involved in processing facial expressions have not been investigated, neuroimaging studies in adults have revealed that several areas including the superior temporal sulcus (STS) participate in the processing of facial expressions. To examine whether the temporal area overlying the STS is responsible for the processing of facial expressions in infants, near-infrared spectroscopy (NIRS) was used to measure the neural activity in the temporal area overlying the STS as infants looked at happy and angry faces. NIRS provides a non-invasive means of estimating cerebral blood flow in the human brain and does not require severe constraints of head-movement. According to the International 10-20 system for EEG electrode placement, the measurement area was located in the bilateral temporal area centered at positions T5 and T6, which correspond to the STS. The time-course of the average change in total-Hb concentration revealed a clear difference in the pattern of hemodynamic responses to happy and angry faces. The hemodynamic response increased gradually when infants looked at happy faces and was activated continuously even after the disappearance of the face. In contrast, the hemodynamic responses for angry faces increased during the presentation of angry faces, then decreased rapidly after the face disappeared. Moreover, the left temporal area was significantly activated relative to the baseline when infants looked at happy faces, while the right temporal area was significantly activated for angry faces. These findings suggest hemispheric differences in temporal areas during the processing of positive and negative facial expressions in infants.

Infant brain activity while viewing facial movement of point-light displays as measured by near-infrared spectroscopy (NIRS)☆

Adult observers can quickly identify specific actions performed by an invisible actor from the points of lights attached to the actors head and major joints. Infants are also sensitive to biological motion and prefer to see it depicted by a dynamic point-light display. In detecting biological motion such as whole body and facial movements, neuroimaging studies have demonstrated the involvement of the occipitotemporal cortex, including the superior temporal sulcus (STS). In the present study, we used the point-light display technique and near-infrared spectroscopy (NIRS) to examine infant brain activity while viewing facial biological motion depicted in a point-light display. Dynamic facial point-light displays (PLD) were made from video recordings of three actors making a facial expression of surprise in a dark room. As in Bassilis study, about 80 luminous markers were scattered over the surface of the actors faces. In the experiment, we measured infants hemodynamic responses to these displays using NIRS. We hypothesized that infants would show different neural activity for upright and inverted PLD. The responses were compared to the baseline activation during the presentation of individual still images, which were frames extracted from the dynamic PLD. We found that the concentration of oxy-Hb increased in the right temporal area during the presentation of the upright PLD compared to that of the baseline period. This is the first study to demonstrate that infants brain activity in face processing is induced only by the motion cue of facial movement depicted by dynamic PLD.

Do Infants Represent the Face in a Viewpoint-Invariant Manner? Neural Adaptation Study as Measured by Near-Infrared Spectroscopy

Recent adult functional magnetic resonance imaging (fMRI) studies reported that face-sensitive cortical areas showed attenuated responses to the repeated presentation of an identical facial image compared to the presentation of different facial images (fMRI-adaptation effects: e.g., Andrews and Ewbank, 2004). Building upon this finding, the current study, employing the adaptation paradigm, used near-infrared spectroscopy (NIRS) to explore the neural basis of face processing in infants. In Experiment 1, we compared hemodynamic responses in the bilateral temporal regions during the repeated presentation of the same face (the same-face condition) and the sequential presentation of different faces (the different-face condition). We found that (1) hemodynamic responses in the channels around the T5 and T6 regions increased during the presentation of different faces compared to those during the presentation of different objects; and that (2) these channels showed significantly lower response in the same-face condition than in the different-face condition, demonstrating the neural adaptation effect in 5- to 8-month-olds as measured by NIRS. In Experiment 2, when faces in both the same-face and different-face conditions were changed in viewpoint, lower hemodynamic responses in the same-face condition were found in 7- to 8-month-olds but not in 5- to 6-month-olds. Our results suggest that faces are represented in a viewpoint-invariant manner in 7- and 8-month-old infants.

Do infants recognize the Arcimboldo images as faces? Behavioral and near-infrared spectroscopic study.

Arcimboldo images induce the perception of faces when shown upright despite the fact that only nonfacial objects such as vegetables and fruits are painted. In the current study, we examined whether infants recognize a face in the Arcimboldo images by using the preferential looking technique and near-infrared spectroscopy (NIRS). In the first experiment, we measured looking preference between upright and inverted Arcimboldo images among 5- and 6-month-olds and 7- and 8-month-olds. We hypothesized that if infants perceive the Arcimboldo images as faces, they would prefer the upright images to the inverted ones. We found that only 7- and 8-month-olds significantly preferred upright images, suggesting that they could perceive the Arcimboldo images as faces. In the second experiment, we measured hemodynamic responses using NIRS. Based on the behavioral data, we hypothesized that 7- and 8-month-olds would show different neural activity for upright and inverted Arcimboldo images, as do adults. Therefore, we measured hemodynamic responses in 7- and 8-month-olds while they were looking at upright and inverted Arcimboldo images. Their responses were then compared with the baseline activation during the presentation of individual vegetables. We found that the concentration of oxyhemoglobin increased in the left temporal area during the presentation of the upright images compared with the baseline during the presentation of vegetables. The results of the two experiments suggest that (a) the ability to recognize the upright Arcimboldo images as faces develops at around 7 or 8 months of age and (b) processing of the upright Arcimboldo images is related to the left temporal area of the brain.

Recognition of Facial Expressions in a Japanese Monkey (Macaca fuscata) and Humans (Homo sapiens)

Recognition of facial expressions by a Japanese monkey and two humans was studied. The monkey subject matched 20 photographs of monkey facial expressions and 20 photographs of human facial expressions. Humans sorted the same pictures. Matching accuracy by the monkey was about 80% correct for both human and monkey facial expressions. The confusion matrices of those facial expressions were analyzed by a multi-dimensional scaling procedure (MDSCAL). The resulting MDS plots suggested that the important cues in recognizing facial expressions of monkeys were “thrusting the mouth” and ‘raising the eyebrows.” Comparison of the MDS plots by the monkey subject with those by human subjects suggested that the monkey categorized the human “happiness” faces. This may suggest that the monkey has an ability to recognize human smile face even though it is learned. However, the monkey did not differentiate the human “anger/disgust” faces from the human “sad” faces, while human subjects clearly did. This may correlate with the lack of eyebrow movement in monkeys.

Asymmetrical cortical processing of radial expansion/contraction in infants and adults

We report asymmetrical cortical responses (steady-state visual evoked potentials) to radial expansion and contraction in human infants and adults. Forty-four infants (22 3-month-olds and 22 4-month-olds) and nine adults viewed dynamic dot patterns which cyclically (2.1 Hz) alternate between radial expansion (or contraction) and random directional motion. The first harmonic (F1) response in the steady-state VEP response must arise from mechanisms sensitive to the global radial motion structure. We compared F1 amplitudes between expansion-random and contraction-random motion alternations. F1 amplitudes for contraction were significantly larger than those for expansion for the older infants and adults but not for the younger infants. These results suggest that the human cortical motion mechanisms have asymmetrical sensitivity for radial expansion vs. contraction, which develops at around 4 months of age. The relation between development of sensitivity to radial motion and cortical motion mechanisms is discussed.

Sensitivity to linear-speed-gradient of radial expansion flow in infancy.

A radial expansion flow having a linear-speed-gradient (linear-grad) creates robust perception of a rigid object moving-in-depth [Perception 19 (1990) 21]. It has been reported that sensitivity to a linear-grad of radial expansion emerges at 2 months of age [Infant Behavior and Development 17 (1994) 165]. In the present study, we examined the development of sensitivity to the linear-grad of radial expansion after 2 months of age with three experiments. A total of 197 2- to 5-month-old infants participated. The results showed that sensitivity to the linear-grad improves between 2 and 3 months of age (Experiment 1), and that the infants may discriminate between an expansion having linear-grad and that having zero-grad based on their perception of motion-in-depth (Experiments 2 and 3).

Novel method to classify hemodynamic response obtained using multi-channel fNIRS measurements into two groups: exploring the combinations of channels.

Near-infrared spectroscopy (NIRS) in psychiatric studies has widely demonstrated that cerebral hemodynamics differs among psychiatric patients. Recently we found that children with attention-deficit/hyperactivity disorder (ADHD) and children with autism spectrum disorders (ASD) showed different hemodynamic responses to their own mother’s face. Based on this finding, we may be able to classify the hemodynamic data into two those groups and predict to which diagnostic group an unknown participant belongs. In the present study, we proposed a novel statistical method for classifying the hemodynamic data of these two groups. By applying a support vector machine (SVM), we searched the combination of measurement channels at which the hemodynamic response differed between the ADHD and the ASD children. The SVM found the optimal subset of channels in each data set and successfully classified the ADHD data from the ASD data. For the 24-dimensional hemodynamic data, two optimal subsets classified the hemodynamic data with 84% classification accuracy, while the subset contained all 24 channels classified with 62% classification accuracy. These results indicate the potential application of our novel method for classifying the hemodynamic data into two groups and revealing the combinations of channels that efficiently differentiate the two groups.