Felix Putze

Intervention-free selection using EEG and eye tracking

In this paper, we show how recordings of gaze movements (via eye tracking) and brain activity (via electroencephalography) can be combined to provide an interface for implicit selection in a graphical user interface. This implicit selection works completely without manual intervention by the user. In our approach, we formulate implicit selection as a classification problem, describe the employed features and classification setup and introduce our experimental setup for collecting evaluation data. With a fully online-capable setup, we can achieve an F_0.2-score of up to 0.74 for temporal localization and a spatial localization accuracy of more than 0.95.

Starring into the void?: Classifying Internal vs. External Attention from EEG

For any HCI system, it would be a great advantage if it was aware of the attentional state of its user: Is he or she paying attention to external stimuli provided by the users environment or is the user focusing his or her attention on internal mental tasks? In this paper, we propose a model for the discrimination of internal and external attention by using Electroencephalography. We describe the experiment we conducted to collect data of internal and external attention, describe our setup for classification and discuss the classifications results.

Mechanisms within the Parietal Cortex Correlate with the Benefits of Random Practice in Motor Adaptation

The motor learning literature shows an increased retest or transfer performance after practicing under unstable (random) conditions. This random practice effect (also known as contextual interference effect) is frequently investigated on the behavioral level and discussed in the context of mechanisms of the dorsolateral prefrontal cortex and increased cognitive efforts during movement planning. However, there is a lack of studies examining the random practice effect in motor adaptation tasks and, in general, the underlying neural processes of the random practice effect are not fully understood. We tested 24 right-handed human subjects performing a reaching task using a robotic manipulandum. Subjects learned to adapt either to a blocked or a random schedule of different force field perturbations while subjects’ electroencephalography (EEG) was recorded. The behavioral results showed a distinct random practice effect in terms of a more stabilized retest performance of the random compared to the blocked practicing group. Further analyses showed that this effect correlates with changes in the alpha band power in electrodes over parietal areas. We conclude that the random practice effect in this study is facilitated by mechanisms within the parietal cortex during movement execution which might reflect online feedback mechanisms.

Detecting Memory-Based Interaction Obstacles with a Recurrent Neural Model of User Behavior

A memory-based interaction obstacle is a condition which impedes human memory during Human-Computer Interaction, for example a memory-loading secondary task. In this paper, we present an approach to detect the presence of such memory-based interaction obstacles from logged user behavior during system use. For this purpose, we use a recurrent neural network which models the resulting temporal sequences. To acquire a sufficient number of training episodes, we employ a cognitive user simulation. We evaluate the approach with data from a user test and on which we outperform a non-sequential baseline by up to 42% relative.

Modeling Cognitive Processes from Multimodal Signals

Multimodal signals allow us to gain insights into internal cognitive processes of a person, for example: speech and gesture analysis yields cues about hesitations, knowledgeability, or alertness, eye tracking yields information about a persons focus of attention, task, or cognitive state, EEG yields information about a persons cognitive load or information appraisal. Capturing cognitive processes is an important research tool to understand human behavior as well as a crucial part of a user model to an adaptive interactive system such as a robot or a tutoring system. As cognitive processes are often multifaceted, a comprehensive model requires the combination of multiple complementary signals. In this workshop at the ACM International Conference on Multimodal Interfaces (ICMI) conference in Boulder, Colorado, USA, we discussed the state-of-the-art in monitoring and modeling cognitive processes from multi-modal signals.

Automatic classification of auto-correction errors in predictive text entry based on EEG and context information

State-of-the-art auto-correction methods for predictive text entry systems work reasonably well, but can never be perfect due to the properties of human language. We present an approach for the automatic detection of erroneous auto-corrections based on brain activity and text-entry-based context features. We describe an experiment and a new system for the classification of human reactions to auto-correction errors. We show how auto-correction errors can be detected with an average accuracy of 85%.

Technikbasiertes Spiel von Tagespflegebesuchern mit und ohne Demenz

BACKGROUND Playing of old people with or without dementia have not yet been substantially investigated. OBJECTIVE This study deals with the acceptance and impact of a tablet-based memory game, which was played on a weekly or semiweekly basis by visitors in two daycare units. MATERIAL AND METHODS Within the framework of focus groups the technical system was adapted for elderly users. The video-assisted data at the level of the game and the dynamics were investigated with respect to interaction and communication. RESULTS The analysis of psychological observation forms and game protocols, which were conducted over a period of 3 months, indicated different effects of the game on psychosocial and cognitive activation. The individual memory cards in particular served as an intensification of communication and a stimulation of episodic memory. Finally, with video analysis during the whole game setting three theoretical relationship patterns of the spheres playing and speech could be depicted. CONCLUSION Coherence, separation and incoherence of playing and speech are different forms of interaction in which individual and collaborative competences of people with and without dementia can be visualized. Furthermore, the study provides evidence for the cultural theory of playing by Huizinga.

Bremen Big Data Challenge 2017: Predicting University Cafeteria Load

Big data is a hot topic in research and industry. The availability of data has never been as high as it is now. Making good use of the data is a challenging research topic in all aspects of industry and society. The Bremen Big Data Challenge invites students to dig deep into big data. In this yearly event students are challenged to use the month of March to analyze a big dataset and use the knowledge they gained to answer a question. In this year’s Bremen Big Data Challenge students were challenged to predict the load of the university cafeteria from the load of past years. The best of 24 teams predicted the load with a root mean squared error of 8.6 receipts issued in five minutes, with a fusion system based on the top 5 entries achieving an even better result of 8.28.

[Technique-based game for daycare visitors with and without dementia : Effects, heuristics and correlates].

BACKGROUND Playing of old people with or without dementia have not yet been substantially investigated. OBJECTIVE This study deals with the acceptance and impact of a tablet-based memory game, which was played on a weekly or semiweekly basis by visitors in two daycare units. MATERIAL AND METHODS Within the framework of focus groups the technical system was adapted for elderly users. The video-assisted data at the level of the game and the dynamics were investigated with respect to interaction and communication. RESULTS The analysis of psychological observation forms and game protocols, which were conducted over a period of 3 months, indicated different effects of the game on psychosocial and cognitive activation. The individual memory cards in particular served as an intensification of communication and a stimulation of episodic memory. Finally, with video analysis during the whole game setting three theoretical relationship patterns of the spheres playing and speech could be depicted. CONCLUSION Coherence, separation and incoherence of playing and speech are different forms of interaction in which individual and collaborative competences of people with and without dementia can be visualized. Furthermore, the study provides evidence for the cultural theory of playing by Huizinga.

Technische Unterstützung für Menschen mit Demenz : Symposium 30.09. - 01.10.2013

Wie sollten technische Systeme zur Unterstutzung von Menschen mit Demenz gestaltet sein? Was wunschen sich die Patienten, Angehorigen, Pflegenden, und Arzte? Und was konnen technische Assistenzsysteme uberhaupt leisten? Am KIT fand im Oktober 2013 ein Symposium zu diesen Fragen statt. Experten aus verschiedenen Disziplinen kamen zusammen, um den aktuellen Stand in den jeweiligen Gebieten zu erortern. Dieser Band gibt einen Uberblick uber die Erkenntnisse aus den verschiedenen Blickwinkeln.