Shinichi Kita

The Effects of Local Prevalence and Explicit Expectations on Search Termination Times

In visual search tasks, the relative proportions of target-present and -absent trials have important effects on behavior. Miss error rates rise as target prevalence decreases (Wolfe, Horowitz, & Kenner, Nature 435, 439–440, 2005). At the same time, search termination times on target-absent trials become shorter (Wolfe & Van Wert, Current Biology 20, 121–124, 2010). These effects must depend on some implicit or explicit knowledge of the current prevalence. What is the nature of that knowledge? In Experiment 1, we conducted visual search tasks at three levels of prevalence (6%, 50%, and 94%) and analyzed performance as a function of “local prevalence,” the prevalence over the last n trials. The results replicated the usual effects of overall prevalence but revealed only weak or absent effects of local prevalence. In Experiment 2, the overall prevalence in a block of trials was 20%, 50%, or 80%. However, a 100%-valid cue informed observers of the prevalence on the next trial. These explicit cues had a modest effect on target-absent RTs, but explicit expectation could not explain the full prevalence effect. We conclude that observers predict prevalence on the basis of an assessment of a relatively long prior history. Each trial contributes a small amount to that assessment, and this can be modulated but not overruled by explicit instruction.

Unconscious processing of direct gaze: Evidence from an ERP study

Humans detect faces with direct gaze more rapidly than they do faces with averted gaze. Evidence suggests that the visual information of faces with direct gaze reaches conscious awareness faster than that of faces with averted gaze. This suggests that faces with direct gaze are effectively processed in the brain before they reach conscious awareness; however, it is unclear how the unconscious perception of faces with direct gaze is processed in the brain. To address this unanswered question, we recorded event-related potentials while observers viewed faces with direct or averted gaze that were either visible or rendered invisible during continuous flash suppression. We observed that invisible faces with direct gaze elicited significantly larger negative deflections than did invisible faces with averted gaze at 200, 250, and 350 ms over the parietofrontal electrodes, whereas we did not observe such effects when facial images were visible. Our results suggest that the visual information of faces with direct gaze is preferentially processed in the brain when they are presented unconsciously.

Perception of Direct Gaze Does Not Require Focus of Attention

Previous research using averted (e.g., leftward or rightward) gaze indicates that gaze perception requires a focus of attention. However, direct gaze, compared with averted gaze, is processed in the brain preferentially and enhances cognitive functions. Thus, it is necessary to use direct gaze to investigate whether gaze perception is possible without focused attention. We conducted a dual-task paradigm in which attention was drawn away from gaze. Results showed performance on gaze-direction discrimination (direct vs. averted gaze) in the dual-task condition was only slightly lower than in the single-task condition; participants were able to discriminate direct from averted gaze without focusing their attention in a similar manner to when they did focus their attention. In contrast, when participants discriminated between averted gazes (leftward and rightward), performance dropped to near-chance levels. It was concluded that gaze perception does not require a focus of attention for direct gaze.

Attentional Capture by Change in Direct Gaze

In three experiments, we examined whether change in direct gaze was better at capturing visuospatial attention than non-direct gaze change. Also, change in direct gaze can be categorised into two types: ‘look toward’, which means gaze changing to look toward observers, and ‘look away’, which means gaze changing to look away from observers. Thus, we also investigated which type of change in direct gaze was more effective in capturing visuospatial attention. Each experiment employed a change-detection task, and we compared detection accuracy between ‘look away’, ‘look toward’, and non-direct gaze-change conditions. In experiment 1, we found detection advantage for change in direct gaze relative to non-direct gaze change, and for ‘look toward’ compared with ‘look away’. In experiment 2, we conducted control experiments to exclude possibilities of simple motion detection and geometrical factors of eyes, and confirm detection advantage in experiment 1 only occurred when the stimuli were processed as faces and gazes. In experiment 3, we manipulated the head deviation, but the results in experiment 1 persisted despite changes in head orientation. The findings establish that individuals are sensitive to change in direct relative to non-direct gaze change, and ‘look toward’ compared with ‘look away’.

Attentional shifts by gaze direction in voluntary orienting: evidence from a microsaccade study

Shifts in spatial attention can be induced by the gaze direction of another. However, it is unclear whether gaze direction influences the allocation of attention by reflexive or voluntary orienting. The present study was designed to examine which type of attentional orienting is elicited by gaze direction. We conducted two experiments to answer this question. In Experiment 1, we used a modified Posner paradigm with gaze cues and measured microsaccades to index the allocation of attention. We found that microsaccade direction followed cue direction between 200 and 400xa0ms after gaze cues were presented. This is consistent with the latencies observed in other microsaccade studies in which voluntary orienting is manipulated, suggesting that gaze direction elicits voluntary orienting. However, Experiment 1 did not separate voluntary and reflexive orienting directionally, so in Experiment 2, we used an anticue task in which cue direction (direction to allocate attention) was the opposite of gaze direction (direction of gaze in depicted face). The results in Experiment 2 were consistent with those from Experiment 1. Microsaccade direction followed the cue direction, not gaze direction. Taken together, these results indicate that the shift in spatial attention elicited by gaze direction is voluntary orienting.

Implicit phonetic symbolism in voicing of consonants and visual lightness using Garner's speeded classification task.

The present study examines implicit phonetic symbolism which posits that arbitrary linguistic sound is related to certain aspects of characteristics of other modalities, such as color, touch, or emotion. In consonant discrimination and lightness discrimination using Garners speeded classification paradigm, spoken sounds (voiced/voiceless consonants) and lightness of visual stimuli (black/white squares) were systematically varied to assess cross-modal interactions. Congruent audio-visual pairs (voiced consonants and black, and between voiceless consonants and white) facilitated consonant discrimination. In lightness discrimination, no congruent facilitation or congruence effect was observed. These results indicated that cross-modal interactions in implicit phonetic symbolism can be found in correlations between linguistic spoken sounds and visual lightness.

A critical role of holistic processing in face gender perception.

Whether face gender perception is processed by encoding holistic (whole) or featural (parts) information is a controversial issue. Although neuroimaging studies have identified brain regions related to face gender perception, the temporal dynamics of this process remain under debate. Here, we identified the mechanism and temporal dynamics of face gender perception. We used stereoscopic depth manipulation to create two conditions: the front and behind condition. In the front condition, facial patches were presented stereoscopically in front of the occluder and participants perceived them as disjoint parts (featural cues). In the behind condition, facial patches were presented stereoscopically behind the occluder and were amodally completed and unified in a coherent face (holistic cues). We performed three behavioral experiments and one electroencephalography experiment, and compared the results of the front and behind conditions. We found faster reaction times (RTs) in the behind condition compared with the front, and observed priming effects and aftereffects only in the behind condition. Moreover, the EEG experiment revealed that face gender perception is processed in the relatively late phase of visual recognition (200–285 ms). Our results indicate that holistic information is critical for face gender perception, and that this process occurs with a relatively late latency.

Prevalence Effect in Haptic Search

In visual search tasks, the ratio of target-present to target-absent trials has important effects on miss rates. In this study, we examined whether the target prevalence effect occurs in a haptic search task by using artificial tactile maps. The results indicated that target prevalence has effects on miss rates, sensitivity, and criterion. Moreover, an increase in miss rates in the low-prevalence condition (10%) was strongly correlated with a decrease in search termination times (target-absent reaction times). These results suggest that the prevalence effect on haptic search is caused by a decrease in the search termination time and a shift in decision criterion and a decrease in sensitivity.

Multiple neural mechanisms for coloring words in synesthesia

Grapheme-color synesthesia is a phenomenon in which achromatic letters/digits automatically induce particular colors. When multiple letters are integrated into a word, some synesthetes perceive that all those letters are changed into the same color, reporting lexical color to that word. Previous psychological studies found several rules that determine those lexical colors. The colors to most words are determined by the first letters of the words, while some words in ordinal sequences have their specific colors. Recent studies further reported the third case where lexical colors might be influenced by semantic information of words. Although neural mechanisms determining those lexical colors remained unknown, here we identified three separate neural systems in the synesthetes brain underlying three rules for illusory coloring of words. In addition to the occipito-temporal and parietal regions previously found to be associated with the grapheme-color synesthesia, neural systems for lexical coloring extended to linguistic areas in the left inferior frontal and anterior temporal regions that were engaged in semantic analyses of words. Those results indicate an involvement of wider and higher neural networks than previously assumed in a production of synesthetic colors to visual stimuli and further showed a multiplicity of synesthetic mechanisms represented in the single brain.

Modulation of neuromagnetic responses to face stimuli by preceding biographical information.

When we encode faces in memory, we often do so in association with biographical information regarding the person. To examine the neural dynamics underlying such encoding processes, we devised a face recognition task and recorded cortical activity using magnetoencephalography. The task included two conditions. In the experimental condition, face stimuli were preceded by biographical information regarding the person whose face was to be memorized, whereas in the control condition, nonsense syllables were presented before face stimuli. Behavioral results indicated that the biographical information about a person facilitated the recognition memory of their face. Magnetoencephalography signals showed clear visually evoked magnetic fields mainly in the occipitotemporal cortex, in response to the face stimuli that were to be encoded. The phasic peak was observed at 100–200u2003ms after onset of a face stimulus, which was followed by late latency deflections (200–400u2003ms). Comparison of the signal between conditions revealed that the preceding semantic information does modulate the neuromagnetic responses to the face stimuli. This modulation occurred primarily at the late latency component in the sensors over the occipitotemporal cortex. In addition, the effects of conditions were also observed in the signals from more anterior sensors, which occurred earlier than the effects in the occipitotemporal cortex. These results provide insights into the neural dynamics underlying the encoding of faces in association with their biographical information.