Fast EEG-Based Decoding Of The Directional Focus Of Auditory Attention Using Common Spatial Patterns

Abstract

<italic>Objective:</italic> Noise reduction algorithms in current hearing devices lack informationabout the sound source a user attends to when multiple sources are present. To resolve this issue, they can be complemented with auditory attention decoding (AAD) algorithms, which decode the attention using electroencephalography (EEG) sensors. State-of-the-art AAD algorithms employ a stimulus reconstruction approach, in which the envelope of the attended source is reconstructed from the EEG and correlated with the envelopes of the individual sources. This approach, however, performs poorly on short signal segments, whilelonger segments yield impractically long detection delays when the user switches attention. <italic>Methods:</italic> We propose decoding the directional focus of attention using filterbank common spatial pattern filters (FB-CSP) as an alternative AAD paradigm, whichdoes not require access to the clean source envelopes. <italic>Results:</italic> The proposed FB-CSP approach outperforms both the stimulus reconstruction approach on short signal segments, as well as a convolutional neural network approach on the same task. We achieve a high accuracy (80% for <inline-formula><tex-math notation= LaTeX >$\\text{1}\\;{\\rm s}$</tex-math></inline-formula> windows and 70% for quasi-instantaneous decisions), which is sufficient to reach minimal expected switch durations below <inline-formula><tex-math notation= LaTeX >$\\text{4}\\;{\\rm s}$</tex-math></inline-formula>. We also demonstrate that the decoder can adapt to unlabeled data from anunseen subject and works with only a subset of EEG channels located around the ear to emulate a wearable EEG setup. <italic>Conclusion:</italic> The proposed FB-CSP method provides fast and accurate decoding of the directional focus of auditory attention. <italic>Significance:</italic> The high accuracy on very short data segments is a major step forward towards practical neuro-steered hearing devices.