Ferenc Honbolygó

Different strategies underlying uncertain decision making: higher executive performance is associated with enhanced feedback-related negativity.

The aim of the present study was to investigate the role of executive functions (EFs) in different strategies underlying risky decision making. Adult participants from a nonclinical sample were assigned to low or high EF groups based on their performance on EF tasks measuring shifting, updating, and inhibition. ERPs were recorded while participants performed the Balloon Analogue Risk Task (BART). In this task, each balloon pump was associated with either a reward or a balloon pop with unknown probability. The BART behavioral measures did not show between-group differences. However, the feedback-related negativity (FRN) associated with undesirable outcomes was larger in the high EF group than in the low EF group. Since the FRN represents salience prediction error, our results suggest that the high EF group formed internal models that were violated by the outcomes. Thus, we provided ERP evidence for EFs influencing risky decision-making processes.

Saliency or template? ERP evidence for long-term representation of word stress.

The present study investigated the event-related brain potential (ERP) correlates of word stress processing. Previous results showed that the violation of a legal stress pattern elicited two consecutive Mismatch Negativity (MMN) components synchronized to the changes on the first and second syllable. The aim of the present study was to test whether ERPs reflect only the detection of salient features present on the syllables, or they reflect the activation of long-term stress related representations. We examined ERPs elicited by pseudowords with no lexical representation in two conditions: the standard having a legal stress patterns, and the deviant an illegal one, and the standard having an illegal stress pattern, and the deviant a legal one. We found that the deviant having an illegal stress pattern elicited two consecutive MMN components, whereas the deviant having a legal stress pattern did not elicit MMN. Moreover, pseudowords with a legal stress pattern elicited the same ERP responses irrespective of their role in the oddball sequence, i.e., if they were standards or deviants. The results suggest that stress pattern changes are processed relying on long-term representation of word stress. To account for these results, we propose that the processing of stress cues is based on language-specific, pre-lexical stress templates.

High trait anxiety is associated with attenuated feedback-related negativity in risky decision making

Expectation biases could affect decision making in trait anxiety. Studying the alterations of feedback processing in real-life risk-taking tasks could reveal the presence of expectation biases at the neural level. A functional relevance of the feedback-related negativity (FRN) is the expression of outcome expectation errors. The aim of the study was to investigate whether nonclinical adults with high trait anxiety show smaller FRN for negative feedback than those with low trait anxiety. Participants (N=26) were assigned to low and high trait anxiety groups by a median split on the state-trait anxiety inventory trait score. They performed a balloon analogue risk task (BART) where they pumped a balloon on a screen. Each pump yielded either a reward or a balloon pop. If the balloon popped, the accumulated reward was lost. Participants were matched on their behavioral performance. We measured event-related brain potentials time-locked to the presentation of the feedback (balloon increase or pop). Our results showed that the FRN for balloon pops was decreased in the high anxiety group compared to the low anxiety group. We propose that pessimistic expectations triggered by the ambiguity in the BART decreased outcome expectation errors in the high anxiety group indicated by the smaller FRN. Our results highlight the importance of expectation biases at the neural level of decision making in anxiety.

Effect of maturation on suprasegmental speech processing in full- and preterm infants: a mismatch negativity study.

Infants born prematurely are at higher risk for later linguistic deficits present in delayed or atypical processing of phonetic and prosodic information. In order to be able to specify the nature of this atypical development, it is important to investigate the role of early experience in language perception. According to the concept of Gonzalez-Gomez and Nazzi (2012) there is a special intrauterine sensitivity to the prosodic features of languages that should have a special role in language acquisition. Therefore, we may also assume that pre- and full-term infants having months difference in intrauterine experience show different maturation patterns of processing prosodic and phonetic information present at word level. The aim of our study was to investigate the effect of these differences on word stress pattern vs. phoneme information processing. Two age groups of infants (6 and 10 month-olds) were included in our study. 21 of 46 of the total of infants investigated were prematurely born with low birth weight. We used the mismatch negativity (MMN) event related brain potential (ERP) component, a widely used electrophysiological correlate of acoustic change detection, for testing the assumed developmental changes of phoneme and word stress discrimination. In a passive oddball paradigm we used a word as standard, a pseudo-word as phoneme deviant, and an illegally uttered word as stress deviant. Our results showed no differences in MMN responses in the phoneme deviant condition between the groups, meaning a relatively intact maturation of phoneme processing of preterm infants as compared to their contemporaries. However, the mismatch responses measured in the stress condition revealed significant between-group differences. These results strengthen the view that the total length of intrauterine experience influences the time of emergence of prosodic processing.

ERP correlates of prosody and syntax interaction in case of embedded sentences

Abstract Understanding spoken language depends on processing the delicate combination of grammatical structure, meaning and prosody of utterances. Previous studies have established that prosody influences the processing of sentences when the grammatical structure is ambiguous, however it is unclear how closely prosody and syntax are related when there is no ambiguity. In an event-related brain potential (ERP) study, we investigated the processing of embedded normal and pseudosentences in which all function and content words were replaced by meaningless words. Sentences could have either natural prosodic structure or incongruent prosodic structure, where the prosody deviated from the one expected based on the syntactic structure, but otherwise the sentences were unambiguous. The resulting ERP components (CPS) showed that the construction of prosodic structure was similar in normal and pseudosentences, thus suggesting that prosody has an abstract, recursive representation, independent of other linguistic information. Moreover, we found evidence that the incongruent prosody was not only detected (shown by the RAN), but it induced neural reintegration processes (shown by the P600) in spite of the syntactic structure of sentences being intact. These results suggest that the prosodic structure is a mandatory constituent of sentence structure building whenever it is present.

It sounds real when you see it. Realistic sound source simulation in multimodal virtual environments

Designing multimodal virtual environments promises revolutionary advances in interacting with computers in the near future. In this paper, we report the results of an experimental investigation on the possible use of surround-sound systems to support visualization, taking advantage of increased knowledge about how spatial perception and attention work in the human brain. We designed two auditory-visual cross-modal experiments, where noise bursts and light-blobs were presented synchronously, but with spatial offsets. We presented sounds in two ways: using free field sounds and using a stereo speaker set. Participants were asked to localize the direction of sound sources. In the first experiment visual stimuli were displaced vertically relative to the sounds, in the second experiment we used horizontal offsets. We found that, in both experiments, sounds were mislocalized in the direction of the visual stimuli in each condition (ventriloquism effect), but this effect was stronger when visual stimuli were displaced vertically, as compared to horizontally. Moreover we found that the ventriloquism effect is strongest for centrally presented sounds. The analyses revealed a variation between different sound presentation modes. We explain our results from the viewpoint of multimodal interface design. These findings draw attention to the importance of cognitive features of multimodal perception in the design of virtual environment setups and may help to open new ways to more realistic surround based multimodal virtual reality simulations.

Effect of stimulus intensity on response time distribution in multisensory integration

To increase the efficiency of multimodal user interfaces, one has to design them according to how multimodal features appear in the real world. Although spatial coincidence and matching intensity levels are important for perception, these factors received little attention in human–computer interaction studies. In our present study we aimed to map how spatial coincidence and different intensity levels influence response times. Sixteen participants performed a simple auditory localization task, where sounds were presented either alone or together with visual non-targets. We found that medium intensity visual stimuli facilitated responses to low intensity sounds. Analyses of response time distributions showed that intensity of target and non-target stimuli affected different parameters of the ex-Gaussian distribution. Our results suggest that multisensory integration and response facilitation may occur even if the non-target has low predictive power to the location of the target. Furthermore, we show that the parameters of the ex-Gaussian distribution can be related to distinct cognitive processes. The current results are potentially applicable in the design of an intelligent warning system that employs the user’s reaction time to adapt the warning signal for optimal results.

Temporal dynamics of object location processing in allocentric reference frame

The spatial location of objects is processed in egocentric and allocentric reference frames, the early temporal dynamics of which have remained relatively unexplored. Previous experiments focused on ERP components related only to egocentric navigation. Thus, we designed a virtual reality experiment to see whether allocentric reference frame-related ERP modulations can also be registered. Participants collected reward objects at the end of the west and east alleys of a cross maze, and their ERPs to the feedback objects were measured. Participants made turn choices from either the south or the north alley randomly in each trial. In this way, we were able to discern place and response coding of object location. Behavioral results indicated a strong preference for using the allocentric reference frame and a preference for choosing the rewarded place in the next trial, suggesting that participants developed probabilistic expectations between places and rewards. We also found that the amplitude of the P1 was sensitive to the allocentric place of the reward object, independent of its value. We did not find evidence for egocentric response learning. These results show that early ERPs are sensitive to the location of objects during navigation in an allocentric reference frame.

Processing of word stress related acoustic information: A multi-feature MMN study

In the present study, we investigated the processing of word stress related acoustic features in a word context. In a passive oddball multi-feature MMN experiment, we presented a disyllabic pseudo-word with two acoustically similar syllables as standard stimulus, and five contrasting deviants that differed from the standard in that they were either stressed on the first syllable or contained a vowel change. Stress was realized by an increase of f0, intensity, vowel duration or consonant duration. The vowel change was used to investigate if phonemic and prosodic changes elicit different MMN components. As a control condition, we presented non-speech counterparts of the speech stimuli. Results showed all but one feature (non-speech intensity deviant) eliciting the MMN component, which was larger for speech compared to non-speech stimuli. Two other components showed stimulus related effects: the N350 and the LDN (Late Discriminative Negativity). The N350 appeared to the vowel duration and consonant duration deviants, specifically to features related to the temporal characteristics of stimuli, while the LDN was present for all features, and it was larger for speech than for non-speech stimuli. We also found that the f0 and consonant duration features elicited a larger MMN than other features. These results suggest that stress as a phonological feature is processed based on long-term representations, and listeners show a specific sensitivity to segmental and suprasegmental cues signaling the prosodic boundaries of words. These findings support a two-stage model in the perception of stress and phoneme related acoustical information.

Lexical influence on stress processing in a fixed-stress language

In the present study, we investigate how lexicality affects the processing of suprasegmental features at the word level. In contrast to earlier studies which analyzed the role of either segmental or suprasegmental feature in language processing our aim was to investigate the effect of the lexical status on the processing of violated stress pattern defined by linguistic rules. We have conducted a passive oddball ERP experiment, presenting a frequent CVCV word with legal (familiar) and illegal (unfamiliar) stress patterns. Former results obtained with pseudo-words in a similar paradigm enabled to assess the influence of lexical information on stress processing. The presence of lexically relevant information resulted in different ERP patterns compared to those obtained with pseudo-words. We obtained two consecutive MMN responses to the illegally stressed words while violating the illegal stress pattern with a legal one the deviant stimulus elicited two consecutive MMN responses as well. In the latter condition lexicality clearly enhanced the comparison of prosodic information between standard and deviant stimuli, as these components very completely missing when presenting pseudo-words. We interpret the results that lexicality acts as a filter since in the absence of lexical familiarity unfamiliar stress patterns are discriminated better. Our results highlight that even when stress is fully predictable, it is taken into account during pre-attentive processing of linguistic input.