Xingguang Fu

Toward a modeling of human-centered, rule-based cooperative teamwork

Modeling of human interactions allows consideration of the different human interaction qualities to a cooperative teamwork with technical systems. The analysis of the performance of the cooperative interacting team members has become an important focus of research in recent years. The proposed approach can be used to model the behaviors for collaborations. This formalizable aspect of the teamwork uses a variety of descriptions. This contribution introduces the Situation-Operator-Modeling (SOM) approach theoretically and applies the approach with respect to the shared mutual situation awareness. Possible functionalities of SOM-based teamwork supervision and assistance are given with examples like teamwork coordination, agent learning, cognitive supervising, and automatic error detection of human errors.

System theoretic modeling of human interaction with respect to rule-based driving interactions

Abstract Modeling of human interactions allows to map the different human interactions qualitites also to Cognitive Technical Systems (CTS). Here formalized solutions can be used and integrated to the supervision of the Human-Machine-Interaction by Cognitive Interfaces. The proposed modeling approach can be used to model the human interactions to the considered part of the real world with a variety types of descriptions, such as mathematical equations, graphical networks, and algorithms. The contribution introduces the Situation-Operator-Modeling (SOM) approach theoretically and details on the representations of the approach with a rule-based algorithm with respect to driver interactions. The interaction between the human driver and the vehicle can be illustrated with a cyclic loop. Within the rule-based knowledge representation approach driver-specific variables can be defined and identified during the interaction.

Modeling of Complex Human-Process Interaction as Framework for Assistance and Supervisory Control of Technical Processes

Interactive processes are omnipresent in fields dealing with automation of complex technical processes, allowing a wide range of application scenarios of assistance systems to support human operators. However, the definition and description of the interaction strongly depends on the application. The description of Human-Process-Interaction HPI in most cases is the key for the development of interaction models leading to a framework for the development of assistance systems. The goal of such assistance systems is to support human operators, or human factors, and thereby improve the considered process in parallel. For the purpose of creating a framework for the development of assistance systems, the Situation-Operator-Model SOM approach is applied. The SOM approach is capable of modeling HPI in a net-like structure representing the complex environment or process and human interactions. By this formal modeling of HPI for the development of human-centered assistance systems based on the underlying modeled interaction is available. In this contribution illustrative examples of different applications for the proposed approach are given by a cognitive, individualized driver assistance system for lane changing maneuvers, by the assessment of operator decisions in air traffic control as well as the operator supervision in semi-automated production process.

Assistance and supervisory control of operators in complex human-process-interaction

The definition of Human-Process-Interaction (HPI) varies as the definition of interaction or process itself is strongly related to the considered research field. However, common to most cases is the need of a description of the interactions between human operators and the process or the task in order to perform further analysis and being enabled to develop innovative operator assistance, assessment, or supervisory tools supporting operators fulfilling their role in complexity gaining environments. Using the Situation-Operation-Modeling (SOM) approach, the description of complex environmental scenes by a network of actions and states is possible. Based on the related formal description of Human-Process-Interaction, the representation of human behaviors, interactions, and process procedures is performed to build up a framework for the development and the implementation of optimized human centered assistance systems. Examples are given by a cognitive, individualized driver assistance system for lane changing maneuvers, assessment of operator decisions in air traffic control, and operator supervision in semi-automated production processes.

Concept for SOM-based computer supported cooperative work

Development of CSCW has been focused on cognitive cooperative agents in recent years. Modeling of human interactions allow the mapping of the human interactions qualitites using agents, supporting Cognitive Technical Systems (CTS). The proposed concept modeling can be used and integrated to the supervision and assistance of Human-Machine-Interactions by supporting the interaction using cognitive-based interfaces for communication and cooperation. The contribution introduces briefly the Situation-Operator-Modeling (SOM) approach theoretically and details on the representations with an applicable algorithm with respect to a special case of HMI: driver-vehicle interactions. The interaction between the human driver and the vehicle can be illustrated with a cyclic loop. Within the rule-based knowledge representation approach operator-specific variables are defined and identified during the interactions. Based on the experimental-based and verified experiences the concept for SOM-based CSCW is briefly developed using similar concepts of task-based HMI-modeling for group and personal assistance.

Modeling for cooperation and coordination within structured and complex situations like unknown emergency situations

Disaster or emergency management becomes more and more important due to an increasing number of catastrophes in combination with advanced complexity of human living, working, and society. In combination with increased options for intervention, the need for related communication and coordination support increases. System allows a suitable management in combination with skilled and experienced human operators, a flexible and situative reaction leading to a suitable guidance of reaction forces as well as of groups of human etc.

Konzept zur Überwachung und Assistenz von Mensch-Maschine Systemen am Beispiel der kooperativen Durchführung eines Praktikumsversuches zur Regelung eines Drei-Tank-Systems

Zur Kooperation von an verschiedenen Orten verteilten, gemeinsam arbeitenden, Nutzerinnen und Nutzern von Mensch-Maschine Systemen, sind geeignete technischinformatorische Module zu entwickeln. Die kooperative, online- und echtzeitfahige Regelung eines Drei-Tank-Systems, welche als Praktikumsversuch fur Studierende zum Einsatz kommt, soll minimalprototypisch die Gesamtfunktionalitat abbilden. Die Versuchsstandsdaten sollen an die bedienenden Personen in Echtzeit ubermittelt werden und so die Kommunikation mit den durchfuhrenden Studierenden ermoglichen. Hierzu mussen geeignete Werkzeuge entwickelt werden. Das Konzept sieht vor, das Drei-Tank System mit einem PC zu verbinden, welcher die Software NI LabVIEW nutzt. Der PC ist gleichzeitig mit dem Internet verbunden und es wird eine HTML-Seite als Interface zur Verfugung gestellt. Die Datenaus- und eingabe und Kommunikation, in Form einer Chat Funktion, werden entsprechend ermoglicht. Zusatzlich werden Warnungen und Hinweise im Sinne der Assistenz und Uberwachung integriert.

Toward a human-centered intelligent supervision and assistance for complex technical systems

With the increasing development of complex technical systems such as power supply systems or human-machine-interaction systems, their availability, reliability and safety are always a special interest of researches. In recent years, the concept of human-centered guidance and control has been introduced into the complex technical systems to solve the growing complexity in interdependencies, uncertainties and decision making. In this contribution a human-centered approach, the Situation-Operator-Modeling (SOM), is used as an underlying approach to describe the complex interacting environmental scenes by a network of actions and states. Based on the related formal description of Human-Machine-Interaction, the representation of human behaviors, interactions, and process procedures is performed to build up a framework for the development and the implementation of optimized human-centered supervision and assistance systems. As example to the approach, a cognitive driver supervision system for lane changing maneuvers is given.