Hisato Imai

I Feel Your Voice Cultural Differences in the Multisensory Perception of Emotion

Cultural differences in emotion perception have been reported mainly for facial expressions and to a lesser extent for vocal expressions. However, the way in which the perceiver combines auditory and visual cues may itself be subject to cultural variability. Our study investigated cultural differences between Japanese and Dutch participants in the multisensory perception of emotion. A face and a voice, expressing either congruent or incongruent emotions, were presented on each trial. Participants were instructed to judge the emotion expressed in one of the two sources. The effect of to-be-ignored voice information on facial judgments was larger in Japanese than in Dutch participants, whereas the effect of to-be-ignored face information on vocal judgments was smaller in Japanese than in Dutch participants. This result indicates that Japanese people are more attuned than Dutch people to vocal processing in the multisensory perception of emotion. Our findings provide the first evidence that multisensory integration of affective information is modulated by perceivers’ cultural background.

Lateral biases and reading direction: a dissociation between aesthetic preference and line bisection.

Perceptual asymmetries for tasks involving aesthetic preference or line bisection can be affected by asymmetrical neurological mechanisms or left/right reading habits. This study investigated the relative contribution of these mechanisms in 100 readers of Japanese and English. Participants made aesthetic judgments between pairs of mirror-reversed pictures showing: (a) static objects, (b) moving objects and (c) landscapes. A line bisection task was also administered. There was a strong effect of reading direction for static and mobile objects whereby Japanese readers preferred objects with a right-to-left directionality (and vice versa for English readers). In contrast, similar patterns were observed for the Japanese and English readers for the landscape and line bisection tasks. The results show that reading habits affect aesthetic judgments for static and moving object tasks, but not the landscape and line bisection tasks. The difference between the tasks may be related to the horizontal/vertical geometry of the stimuli, which makes the landscape and line bisection tasks more prone to universal effects related to cerebral dominance.

The effects of anxiety on the interpretation of emotion in the face–voice pairs

Anxious individuals have been shown to interpret others’ emotional states negatively. Since most studies have used facial expressions as emotional cues, we examined whether trait anxiety affects the recognition of emotion in a dynamic face and voice that were presented in synchrony. The face and voice cues conveyed either matched (e.g., happy face and voice) or mismatched emotions (e.g., happy face and angry voice). Participants with high or low trait anxiety were to indicate the perceived emotion using one of the cues while ignoring the other. The results showed that individuals with high trait anxiety were more likely to interpret others’ emotions in a negative manner, putting more weight on the to-be-ignored angry cues. This interpretation bias was found regardless of the cue modality (i.e., face or voice). Since trait anxiety did not affect recognition of the face or voice cues presented in isolation, this interpretation bias appears to reflect an altered integration of the face and voice cues among anxious individuals.

Reward eliminates retrieval-induced forgetting

Significance Although it is well known that reward enhances learning and memory, how extensively such enhancement occurs remains unclear. We examined how reward influences retrieval-induced forgetting (RIF) in which the retrieval of a nonpracticed item under the same category as a practiced item is worse than the retrieval of a nonpracticed item outside the category. RIF was abolished if a juice reward was given for correct answers in the practice phase. These results suggest that reward enhances processing of retrieval of unpracticed members by mechanisms such as spreading activation within the same category, irrespective of whether items were practiced or not. Although it is well known that reward enhances learning and memory, how extensively such enhancement occurs remains unclear. To address this question, we examined how reward influences retrieval-induced forgetting (RIF) in which the retrieval of a nonpracticed item under the same category as a practiced item is worse than the retrieval of a nonpracticed item outside the category. Subjects were asked to try to encode category-exemplar pairs (e.g., FISH–salmon). Then, they were presented with a category name and a two-letter word stem (e.g., FISH–sa) and were asked to complete an encoded word (retrieval practice). For a correct response, apple juice was given as a reward in the reward condition and a beeping sound was presented in the no-reward condition. Finally, subjects were asked to report whether each exemplar had been presented in the first phase. RIF was replicated in the no-reward condition. However, in the reward condition, RIF was eliminated. These results suggest that reward enhances processing of retrieval of unpracticed members by mechanisms such as spreading activation within the same category, irrespective of whether items were practiced or not.

The change in perceptual synchrony between auditory and visual speech after exposure to asynchronous speech.

Recent studies have shown that audiovisual synchrony is recalibrated after exposure to asynchronous auditory and visual signals. This temporal recalibration has been shown only under a dual-task situation for speech signals. Here we examined whether the temporal recalibration occurs for audiovisual speech in a single-task situation using an offline adaptation method. In the experiment, participants were exposed to synchronous or asynchronous audiovisual syllables (either congruent or incongruent) for 3 min. The adaptation phase was followed by test trials, in which participants judged whether the auditory or visual stimulus was presented first. Results showed shifts in the point of subjective simultaneity and the sensitivity. Our results suggest that attention to adaptation stimuli is necessary to induce temporal recalibration for speech.