Gianluca Borghini

Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices

Driving tasks are vulnerable to the effects of sleep deprivation and mental fatigue, diminishing drivers ability to respond effectively to unusual or emergent situations. Physiological and brain activity analysis could help to understand how to provide useful feedback and alert signals to the drivers for avoiding car accidents. In this study we analyze the insurgence of mental fatigue or drowsiness during car driving in a simulated environment by using high resolution EEG techniques as well as neurophysiologic variables such as heart rate (HR) and eye blinks rate (EBR). Results suggest that it is possible to introduce a EEG-based cerebral workload index that it is sensitive to the mental efforts of the driver during drive tasks of different levels of difficulty. Workload index was based on the estimation of increase of EEG power spectra in the theta band over prefrontal areas and the simultaneous decrease of EEG power spectra over parietal areas in alpha band during difficult drive conditions. Such index could be used in a future to assess on-line the mental state of the driver during the drive task.

Investigating Cooperative Behavior in Ecological Settings: An EEG Hyperscanning Study

The coordinated interactions between individuals are fundamental for the success of the activities in some professional categories. We reported on brain-to-brain cooperative interactions between civil pilots during a simulated flight. We demonstrated for the first time how the combination of neuroelectrical hyperscanning and intersubject connectivity could provide indicators sensitive to the humans’ degree of synchronization under a highly demanding task performed in an ecological environment. Our results showed how intersubject connectivity was able to i) characterize the degree of cooperation between pilots in different phases of the flight, and ii) to highlight the role of specific brain macro areas in cooperative behavior. During the most cooperative flight phases pilots showed, in fact, dense patterns of interbrain connectivity, mainly linking frontal and parietal brain areas. On the contrary, the amount of interbrain connections went close to zero in the non-cooperative phase. The reliability of the interbrain connectivity patterns was verified by means of a baseline condition represented by formal couples, i.e. pilots paired offline for the connectivity analysis but not simultaneously recorded during the flight. Interbrain density was, in fact, significantly higher in real couples with respect to formal couples in the cooperative flight phases. All the achieved results demonstrated how the description of brain networks at the basis of cooperation could effectively benefit from a hyperscanning approach. Interbrain connectivity was, in fact, more informative in the investigation of cooperative behavior with respect to established EEG signal processing methodologies applied at a single subject level.

Quantitative Assessment of the Training Improvement in a Motor-Cognitive Task by Using EEG, ECG and EOG Signals

Generally, the training evaluation methods consist in experts supervision and qualitative check of the operator’s skills improvement by asking them to perform specific tasks and by verifying the final performance. The aim of this work is to find out if it is possible to obtain quantitative information about the degree of the learning process throughout the training period by analyzing neuro-physiological signals, such as the electroencephalogram, the electrocardiogram and the electrooculogram. In fact, it is well known that such signals correlate with a variety of cognitive processes, e.g. attention, information processing, and working memory. A group of 10 subjects have been asked to train daily with the NASA multi-attribute-task-battery. During such training period the neuro-physiological, behavioral and subjective data have been collected. In particular, the neuro-physiological signals have been recorded on the first (T1), on the third (T3) and on the last training day (T5), while the behavioral and subjective data have been collected every day. Finally, all these data have been compared for a complete overview of the learning process and its relations with the neuro-physiological parameters. It has been shown how the integration of brain activity, in the theta and alpha frequency bands, with the autonomic parameters of heart rate and eyeblink rate could be used as metric for the evaluation of the learning progress, as well as the final training level reached by the subjects, in terms of request of cognitive resources.

A graph-theoretical approach in brain functional networks. Possible implications in EEG studies

Background Recently, it was realized that the functional connectivity networks estimated from actual brain-imaging technologies (MEG, fMRI and EEG) can be analyzed by means of the graph theory, that is a mathematical representation of a network, which is essentially reduced to nodes and connections between them. Methods We used high-resolution EEG technology to enhance the poor spatial information of the EEG activity on the scalp and it gives a measure of the electrical activity on the cortical surface. Afterwards, we used the Directed Transfer Function (DTF) that is a multivariate spectral measure for the estimation of the directional influences between any given pair of channels in a multivariate dataset. Finally, a graph theoretical approach was used to model the brain networks as graphs. These methods were used to analyze the structure of cortical connectivity during the attempt to move a paralyzed limb in a group (N=5) of spinal cord injured patients and during the movement execution in a group (N=5) of healthy subjects. Results Analysis performed on the cortical networks estimated from the group of normal and SCI patients revealed that both groups present few nodes with a high out-degree value (i.e. outgoing links). This property is valid in the networks estimated for all the frequency bands investigated. In particular, cingulate motor areas (CMAs) ROIs act as ‘‘hubs’’ for the outflow of information in both groups, SCI and healthy. Results also suggest that spinal cord injuries affect the functional architecture of the cortical network sub-serving the volition of motor acts mainly in its local feature property. In particular, a higher local efficiency El can be observed in the SCI patients for three frequency bands, theta (3-6 Hz), alpha (7-12 Hz) and beta (13-29 Hz). By taking into account all the possible pathways between different ROI couples, we were able to separate clearly the network properties of the SCI group from the CTRL group. In particular, we report a sort of compensatory mechanism in the SCI patients for the Theta (3-6 Hz) frequency band, indicating a higher level of “activation” Ω within the cortical network during the motor task. The activation index is directly related to diffusion, a type of dynamics that underlies several biological systems including possible spreading of neuronal activation across several cortical regions. Conclusions The present study aims at demonstrating the possible applications of graph theoretical approaches in the analyses of brain functional connectivity from EEG signals. In particular, the methodological aspects of the i) cortical activity from scalp EEG signals, ii) functional connectivity estimations iii) graph theoretical indexes are emphasized in the present paper to show their impact in a real application.

Towards a multimodal bioelectrical framework for the online mental workload evaluation.

In this study, a framework able to classify online different levels of mental workload induced during a simulated flight by using the combination of the Electroencephalogram (EEG) and the Heart Rate (HR) biosignals has been proposed. Ten healthy subjects were involved in the experimental protocol, performing the NASA - Multi Attribute Task Battery (MATB) over three different difficulty levels in order to simulate three classic showcases in a flight scene (cruise flight phase, flight level maintaining, and emergencies). The analyses showed that the proposed system is able to estimate online the mental workload of the subjects over the three different conditions reaching a high discriminability (p<;.05). In addition, it has been found that the classification parameters remained stable within a week, without recalibrating the system with new parameters.

Investigating Driver Fatigue versus Alertness Using the Granger Causality Network

Driving fatigue has been identified as one of the main factors affecting drivers’ safety. The aim of this study was to analyze drivers’ different mental states, such as alertness and drowsiness, and find out a neurometric indicator able to detect drivers’ fatigue level in terms of brain networks. Twelve young, healthy subjects were recruited to take part in a driver fatigue experiment under different simulated driving conditions. The Electroencephalogram (EEG) signals of the subjects were recorded during the whole experiment and analyzed by using Granger-Causality-based brain effective networks. It was that the topology of the brain networks and the brain’s ability to integrate information changed when subjects shifted from the alert to the drowsy stage. In particular, there was a significant difference in terms of strength of Granger causality (GC) in the frequency domain and the properties of the brain effective network i.e., causal flow, global efficiency and characteristic path length between such conditions. Also, some changes were more significant over the frontal brain lobes for the alpha frequency band. These findings might be used to detect drivers’ fatigue levels, and as reference work for future studies.

Assessment of driving fatigue based on intra/inter-region phase synchronization

Driver fatigue has been under more attention as it is a main cause of traffic accidents. This paper proposed a method which utilized the inter/intra-region phase synchronization and functional units (FUs) to explore whether EEG synchronization changes from the alert state to the fatigue state. Mean phase coherence (MPC) is adopted as a measure for the phase synchronization. In order to find spatial-frequency features associated with mental state, we studied the intra/inter-region phase synchronization of EEG in different frequencies. The major finding is that EEG synchronizations in delta and alpha bands in frontal and parietal lobe are significantly increased as the mental state of the driver shifted from alertness to fatigue. This finding is simultaneously validated by NASA-Task Load Index (TLX) and Karolinska sleepiness scale (KSS). The statistical analysis results suggest MPC may be used to distinguish between alert and fatigue state of mind. In addition, the another contribution of the work indicates a simple and significant spatial-frequency pair of electrodes, i.e., Fz-Oz in delta band, to evaluate driver fatigue. It helps to implement real-world applications with wearable EEG equipment.

Study of the functional hyperconnectivity between couples of pilots during flight simulation: An EEG hyperscanning study

Brain Hyperscanning, i.e. the simultaneous recording of the cerebral activity of different human subjects involved in interaction tasks, is a very recent field of Neuroscience aiming at understanding the cerebral processes generating and generated by social interactions. This approach allows the observation and modeling of the neural signature specifically dependent on the interaction between subjects, and, even more interestingly, of the functional links existing between the activities in the brains of the subjects interacting together. In this EEG hyperscanning study we explored the functional hyperconnectivity between the activity in different scalp sites of couples of Civil Aviation Pilots during different phases of a flight reproduced in a flight simulator. Results shown a dense network of connections between the two brains in the takeoff and landing phases, when the cooperation between them is maximal, in contrast with phases during which the activity of the two pilots was independent, when no or quite few links were shown. These results confirms that the study of the brain connectivity between the activity simultaneously acquired in human brains during interaction tasks can provide important information about the neural basis of the “spirit of the group”.

Avionic technology testing by using a cognitive neurometric index: A study with professional helicopter pilots

In this study, we investigated the possibility to evaluate the impact of different avionic technologies on the mental workload of helicopters pilots by measuring their brain activity with the EEG during a series of simulated missions carried out at AgustaWestland facilities in Yeovil (UK). The tested avionic technologies were: i) Head-Up Display (HUD); ii) Head-Mounted Display (HMD); iii) Full Conformal symbology (FC); iv) Flight Guidance (FG) symbology; v) Synthetic Vision System (SVS); and vi) Radar Obstacles (RO) detection system. It has been already demonstrated that in cognitive tasks, when the cerebral workload increases the EEG power spectral density (PSD) in theta band over frontal areas increases, and the EEG PSD in alpha band decreases over parietal areas. A mental workload index (MWL) has been here defined as the ratio between the frontal theta and parietal alpha EEG PSD values. Such index has been used for testing and comparing the different avionic technologies. Results suggested that the HUD provided a significant (p<;.05) workload reduction across all the flight scenarios with respect to the other technologies. In addition, the simultaneous use of FC and FG technologies (FC+FG) produced a significant decrement of the workload (p<;.01) with respect to the use of only the FC. Moreover, the use of the SVS technology provided on Head Down Display (HDD) with the simultaneous use of FC+FG and the RO seemed to produce a lower cerebral workload when compared with the use of only the FC. Interestingly, the workload estimation by means of subjective measures, provided by pilots through a NASA-TLX questionnaire, did not provide any significant differences among the different flight scenarios. These results suggested that the proposed MWL cognitive neurometrics could be used as a reliable measure of the users mental workload, being a valid indicator for the comparison and the test of different avionic technologies.

On the Use of Cognitive Neurometric Indexes in Aeronautic and Air Traffic Management Environments

In this paper the use of neurophysiological indexes for an objective evaluation of mental workload, during an ecological Air Traffic Management (ATM) task, has been proposed.