Johann Kelsch

Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations

Progress enables the creation of more automated and intelligent machines with increasing abilities that open up new roles between humans and machines. Only with a proper design for the resulting cooperative human–machine systems, these advances will make our lives easier, safer and enjoyable rather than harder and miserable. Starting from examples of natural cooperative systems, the paper investigates four cornerstone concepts for the design of such systems: ability, authority, control and responsibility, as well as their relationship to each other and to concepts like levels of automation and autonomy. Consistency in the relations between these concepts is identified as an important quality for the system design. A simple graphical tool is introduced that can help to visualize the cornerstone concepts and their relations in a single diagram. Examples from the automotive domain, where a cooperative guidance and control of highly automated vehicles is under investigation, demonstrate the application of the concepts and the tool. Transitions in authority and control, e.g. initiated by changes in the ability of human or machine, are identified as key challenges. A sufficient consistency of the mental models of human and machines, not only in the system use but also in the design and evaluation, can be a key enabler for a successful dynamic balance between humans and machines.

The theater-system technique: agile designing and testing of system behavior and interaction, applied to highly automated vehicles

In this paper, the theater-system technique, a method for agile designing and testing of system behavior and interaction concepts is described. The technique is based on the Wizard-of-Oz approach, originally used for emulating automated speech recognition, and is extended towards an interactive, user-centered design technique. The paper describes the design process using the theater-system technique, the technical build-up of the theater-system, and an application of the technique: the design of a haptic-multimodal interaction strategy for highly automated vehicles. The use of the theater-system in the design process is manifold: It is used for the concrete design work of the design team, for the assessment of user expectations as well as for early usability assessments, extending the principles of user-centered design towards a dynamically balanced design.

Shared and cooperative movement control of intelligent technical systems: Sketch of the design space of haptic-multimodal coupling between operator, co-automation, base system and environment

Abstract This paper sketches the concept of haptic-multimodal coupling between operator, co-automation, base system and environment. Haptic-multimodal couplings use mainly the haptic interaction resource, e.g. the combination of hands and feet with active inceptors like active sidesticks or steering wheels and complement this with e.g. visual and acoustic feedback. Haptic-multimodal couplings can serve as a base for shared control, and, if the co-automation has a minimum of understanding of and reactivity to the human operator, for a cooperative control between operator and automation. The paper gives a brief introduction of shared and cooperative control, starting with examples in the non-technical world and sketches the basic structure the couplings and coupling schemes. While much of the design space is yet to be explored and described more systematically, some combinations of haptic-multimodal couplings can already be applied, for example to the cooperative control of an intelligent ground vehicle or in telerobotics. The paper briefly describes examples of an automation-initiated de-coupling of a driver and of a helicopter pilot in case of an emergency maneuver and the coupling between an operator and a satellite control for a berthing maneuver.

Interaction design for nomadic devices in highly automated vehicles

Following the roadmaps of (inter)national committees, highly automated driving will be available in the next decade in production vehicles. This technology allows the driver to do some other tasks while driving and to remain only as a fallback in situations the automation is not capable to handle. This study tested if nomadic devices, that drivers might use while driving highly automated, can be integrated to support the driver in taking over control when requested. 33 drivers participated in a simulator study and drove in a highly automated vehicle on a motorway. The results showed that the takeover performance of drivers improve if the takeover request is displayed additionally on the nomadic device. Therefore, the integration of additional interfaces such as smartphones into a holistic interaction concept may be a key aspect for designing a secure and comfortable takeover process.

Validation of the MoSAIC-Driving Simulator – Investigating the impact of a human driver on cooperative driving behavior in an experimental simulation setup

The “Modular and Scalable Application Platform for ITS Components” (MoSAIC) offers the possibility to investigate cooperative driving behavior. MoSAIC consists of three driving-simulators linked together, allowing participants to drive within the same simulation. The goal of the study was to examine whether knowledge of another real driver would have an impact on cooperative driving behavior. Participants were forced to overtake a car on a motorway, while a third car was approaching from behind. Twenty people participated, of which ten were told that the approaching car was simulated by a computer and ten were told that another participant would be steering the car. However, the car was always controlled by one of the investigators. To examine cooperative driving behavior Time Headway, a measure of distance relative to speed, and the participants’ intentions were used to label a behavior as cooperative. Further the participants’ perceived risk and perceived cooperation were recorded. Significant group differences were discovered regarding the intentions, perceived risks and perceived cooperation.