Reiko Graham

Garner interference reveals dependencies between emotional expression and gaze in face perception.

The relationship between facial expression and gaze processing was investigated with the Garner selective attention paradigm. In Experiment 1, participants performed expression judgments without interference from gaze, but expression interfered with gaze judgments. Experiment 2 replicated these results across different emotions. In both experiments, expression judgments occurred faster than gaze judgments, suggesting that expression was processed before gaze could interfere. In Experiments 3 and 4, the difficulty of the emotion discrimination was increased in two different ways. In both cases, gaze interfered with emotion judgments and vice versa. Furthermore, increasing the difficulty of the emotion discrimination resulted in gaze and expression interactions. Results indicate that expression and gaze interactions are modulated by discriminability. Whereas expression generally interferes with gaze judgments, gaze direction modulates expression processing only when facial emotion is difficult to discriminate.

Quantifying deficits in the perception of fear and anger in morphed facial expressions after bilateral amygdala damage

Amygdala damage has been associated with impairments in perceiving facial expressions of fear. However, deficits in perceiving other emotions, such as anger, and deficits in perceiving emotion blends have not been definitively established. One possibility is that methods used to index expression perception are susceptible to heuristic use, which may obscure impairments. To examine this, we adapted a task used to examine categorical perception of morphed facial expressions [Etcoff, N. L., & Magee, J. J. (1992). Categorical perception of facial expressions. Cognition, 44(3), 227-240]. In one version of the task, expressions were categorized with unlimited time constraints. In the other, expressions were presented with limited exposure durations to tap more automatic aspects of processing. Three morph progressions were employed: neutral to anger, neutral to fear, and fear to anger. Both tasks were administered to a participant with bilateral amygdala damage (S.P.), age- and education-matched controls, and young controls. The second task was also administered to unilateral temporal lobectomy patients. In the first version, S.P. showed impairments relative to normal controls on the neutral-to-anger and fear-to-anger morphs, but not on the neutral-to-fear morph. However, reaction times suggested that speed-accuracy tradeoffs could account for results. In the second version, S.P. showed impairments on all morph types relative to all other subject groups. A third experiment showed that this deficit did not extend to the perception of morphed identities. These results imply that when heuristics use is discouraged on tasks utilizing subtle emotion transitions, deficits in the perception of anger and anger/fear blends, as well as fear, are evident with bilateral amygdala damage.

Body mass index moderates gaze orienting biases and pupil diameter to high and low calorie food images

The primary goal of this study was to examine eye gaze behavior to different kinds of food images in individuals differing in BMI status. Eye-tracking methods were used to examine gaze and pupil responses while normal weight and overweight women freely viewed pairs of different food images: high calorie sweet foods, high calorie savory foods, and low calorie foods. Self-report measures of hunger, state and trait cravings, and restrained eating were also obtained. Results revealed orienting biases to low calorie foods and decreases in pupil diameter to high calorie sweet foods relative to low calorie foods in the overweight group. Groups did not differ in the average amount of time spent gazing at the different image types. Furthermore, increased state cravings were associated with larger pupil diameters to high calorie savory foods, especially in individuals with lower BMIs. In contrast, restrained eating scores were associated with a decreased orienting bias to high calorie sweet foods in the high BMI group. In conclusion, BMI status appears to influence gaze parameters that are less susceptible to cognitive control. Results suggest that overweight individuals, especially those who diet, have negative implicit attitudes toward high calorie foods, especially sweets.

Happy and fearful emotion in cues and targets modulate event-related potential indices of gaze-directed attentional orienting

The goal of the present study was to characterize the effects of valence in facial cues and object targets on event-related potential (ERPs) indices of gaze-directed orienting. Participants were shown faces at fixation that concurrently displayed dynamic gaze shifts and expression changes from neutral to fearful or happy emotions. Emotionally-salient target objects subsequently appeared in the periphery and were spatially congruent or incongruent with the gaze direction. ERPs were time-locked to target presentation. Three sequential ERP components were modulated by happy emotion, indicating a progression from an expression effect to a gaze-by-expression interaction to a target emotion effect. These effects included larger P1 amplitude over contralateral occipital sites for targets following happy faces, larger centrally distributed N1 amplitude for targets following happy faces with leftward gaze, and faster P3 latency for positive targets. In addition, parietally distributed P3 amplitude was reduced for validly cued targets following fearful expressions. Results are consistent with accounts of attentional broadening and motivational approach by happy emotion, and facilitation of spatially directed attention in the presence of fearful cues. The findings have implications for understanding how socioemotional signals in faces interact with each other and with emotional features of objects in the environment to alter attentional processes.

Neurocognitive mechanisms of gaze-expression interactions in face processing and social attention

The face conveys a rich source of non-verbal information used during social communication. While research has revealed how specific facial channels such as emotional expression are processed, little is known about the prioritization and integration of multiple cues in the face during dyadic exchanges. Classic models of face perception have emphasized the segregation of dynamic vs. static facial features along independent information processing pathways. Here we review recent behavioral and neuroscientific evidence suggesting that within the dynamic stream, concurrent changes in eye gaze and emotional expression can yield early independent effects on face judgments and covert shifts of visuospatial attention. These effects are partially segregated within initial visual afferent processing volleys, but are subsequently integrated in limbic regions such as the amygdala or via reentrant visual processing volleys. This spatiotemporal pattern may help to resolve otherwise perplexing discrepancies across behavioral studies of emotional influences on gaze-directed attentional cueing. Theoretical explanations of gaze-expression interactions are discussed, with special consideration of speed-of-processing (discriminability) and contextual (ambiguity) accounts. Future research in this area promises to reveal the mental chronometry of face processing and interpersonal attention, with implications for understanding how social referencing develops in infancy and is impaired in autism and other disorders of social cognition.

Modulation of reflexive orienting to gaze direction by facial expressions

Facial expression and gaze perception are thought to share brain mechanisms but behavioural interactions, especially from gaze-cueing paradigms, are inconsistent. We conducted a series of gaze-cueing studies using dynamic facial cues to examine orienting across different emotional expression and task conditions, including face inversion. Across experiments, at a short stimulus–onset asynchrony (SOA) we observed both an expression effect (i.e., faster responses when the face was emotional versus neutral) and a cue validity effect (i.e., faster responses when the target was gazed-at), but no interaction between validity and emotion. Results from face inversion suggest that the emotion effect may have been due to both facial expression and stimulus motion. At longer SOAs, validity and emotion interacted such that cueing by emotional faces, fearful faces in particular, was enhanced relative to neutral faces. These results converge with a growing body of evidence that suggests that gaze and expression are initially processed independently and interact at later stages to direct attentional orienting.

Event-related potentials reveal temporal staging of dynamic facial expression and gaze shift effects on attentional orienting

Abstract Multiple sources of information from the face guide attention during social interaction. The present study modified the Posner cueing paradigm to investigate how dynamic changes in emotional expression and eye gaze in faces affect the neural processing of subsequent target stimuli. Event-related potentials (ERPs) were recorded while participants viewed centrally presented face displays in which gaze direction (left, direct, right) and facial expression (fearful, neutral) covaried in a fully crossed design. Gaze direction was not predictive of peripheral target location. ERP analysis revealed several sequential effects, including: (1) an early enhancement of target processing following fearful faces (P1); (2) an interaction between expression and gaze (N1), with enhanced target processing following fearful faces with rightward gaze; and (3) an interaction between gaze and target location (P3), with enhanced processing for invalidly cued left visual field targets. Behaviorally, participants responded faster to targets following fearful faces and targets presented in the right visual field, in concordance with the P1 and N1 effects, respectively. The findings indicate that two nonverbal social cues—facial expression and gaze direction—modulate attentional orienting across different temporal stages of processing. Results have implications for understanding the mental chronometry of shared attention and social referencing.

Implicit and explicit attitudes to high- and low-calorie food in females with different BMI status

The study compared implicit and explicit attitudes to three types of foods (high-calorie non-sweet HCNS, high-calorie sweet HCS and low-calorie LC) among females varying in BMI status. Eight three participants completed an affective priming task (implicit attitudes), followed by explicit rating of food images. The results of ANOVA showed a significant difference in implicit attitudes to different types of food, F(3,246)=3.90, p<.01 and the difference among BMI groups (F(6, 213)=2.15, p<.05). The implicit attitudes to HCS were positive in the healthy-weight and overweight groups but negative in obese; the reversed pattern was revealed in attitudes to HCNS. All groups showed negative implicit attitudes to LC foods. The ANOVA performed on explicit ratings revealed a significant effect of food type (F(3,213)=22.54, p<001) but no interaction between food type and BMI status. All participants rated HCNS significantly lower than HCS and LC foods. Our results indicate dissociation in implicit and explicit attitudes to foods among BMI groups, especially in attitudes to HCNS and HCS foods.

Individual and Gender Differences in Subjective and Objective Indices of Pain: Gender, Fear of Pain, Pain Catastrophizing and Cardiovascular Reactivity

According to fear-avoidance models of pain perception, heightened fear of pain may increase disruptive effects of pain; however, the extent to which this affects self-reported pain severity versus physiological indices of pain is not well delineated. The current study examined self-report measures and physiological indices of pain during a cold pressor (CP) task. Individual differences in fear of pain and pain catastrophizing were also assessed via questionnaire. The primary aim of the current study was to examine the extent to which individual differences associated with fear and catastrophizing in response to pain influences subjective and physiological measures of pain. A secondary aim was to examine gender differences associated with response to pain. Average subjective pain ratings were higher for females than males. In contrast, males exhibited higher systolic and diastolic reactivity in response to the CP task relative to females, as well as failure to fully recover to baseline levels. Follow-up correlational analyses revealed that subjective pain ratings were positively associated with fear of pain in both sexes, but were not associated with cardiovascular indices. These results suggest that fear of pain and pain catastrophizing do not influence cardiovascular responses to induced pain. Further research is necessary in order to determine whether these gender differences in blood pressure and heart rate response profiles are due to biological or psychosocial influences. Results support the notion that fear of pain increases subjective pain ratings, but does not influence cardiovascular responses during CP pain-induction.

Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed non-predictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or non-threatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy—but only with the longer cue–target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimises attentional integration of gaze and expression information.