Ulrike Schmuntzsch

Multimodal user interfaces in IPS 2

The field of Industrial Product-Service Systems (IPS2) faces various challenges. Goal of the recently started project is the multimodal design of interaction specific warnings and instructions in IPS2 for human operators with relation to their interactions. This approach should help to prevent mistakes of human operators whilst interaction and it should account for the support and optimization of work process in the heterogeneous area of IPS2. Here we discuss how such a project can be realized step-by-step.

The Warning Glove: Wearable Computing Technology for Maintenance Assistance in IPS2

Abstract This paper presents an approach on how multimodality and wearable technology can be used to design an innovative device for maintenance assistance of human operators in Industrial Product-Service Systems (IPS2). Based on findings from wearable computing technology and multimodality in warning design, the concept and prototypic realization of a multimodal action-specific warning glove is introduced. This glove provides visual, auditory and haptic feedback. To test the gloves usability the maintenance scenario “changing a spindle” was used. The results of the short version of the ISONORM 9241/110 questionnaire encourage further improvements of the warning glove.

Preventing Erroneous Operator Behavior and Supporting Optimal Operating Procedures within Industrial Product-Service Systems

The performance of Industrial Product-Service Systems (IPS²) relies – in addition to many technical factors – on the optimal performance of the human operators. This can be supported through the detection of erroneous behavior and user-centered warnings before injury or damage occurs.

Multimodale Nutzerinterfaces in hybriden Leistungsbündeln

Bei der Gestaltung der Mensch-Maschine-Schnittstelle fur hybride Leistungsbundel (HLB) sind deren spezifische Eigenheiten und Anforderungen, die sich u. a. auch aus den verschiedenen moglichen Geschaftsmodellen ergeben, zu berucksichtigen. Unter Anwendung des Usability Engineering Lifecycle wurden die Anforderungen an die Mensch-Maschine-Schnittstelle fur HLB ermittelt. Dies sind z. B. Nutzbarkeit fur Benutzer mit unterschiedlicher Erfahrung und Qualifikation oder die Integration von Kommunikationsmoglichkeiten und -geraten in die Mensch-Maschine-Schnittstelle. Diese Anforderungen adressiert das entwickelte Shared-Vision-System. Es ermoglicht die multimodale Interaktion eines Nutzers eines HLB und eines entfernten Experten, um kollaborativ Probleme zu losen.

Fraud Protection for Online Banking

Online-banking is becoming increasingly popular. Immense damage is done, however, by illegal actions also rising, such as unauthorized access to online-banking accounts. A project funded by the German Federal Ministry of Education and Research explores in a holistic approach, how fraud protection for online-banking can be improved. The focus is inter alia the user-end fraud detection and protection guiding, particularly for private customers, in online-banking and especially in the non-technical area of Social Engineering. Thereby the study examines the perceptibility of three different cases of fraudulent assaults, which showed that users know little about them. The comparison of two different two-factor methods of online-banking authentication and the analysis of verbal informations via the method of thinking aloud during the second experiment give initial hints which aspects should be changed in order to increase secure user behavior. Whichever, this is quite necessary regarding the high ratio of falling for assaults in the second experiment.

How Two become One – Creating Synergy Effects by Applying the Joint Interview Method to Design Wearable Technology

This paper addresses the design of wearable technology and its user acceptance by applying the Joint Interview Method. In order to further develop a wearable warning system in form of a glove, five semi-structured joint interviews were held by a trained human factors specialist. Each joint interview consisted of one respondent with an engineering background and one respondent with a psychological or cognitive-science background. In this process, the Joint Interview Method revealed two advantages: First, the interviews benefited from the discussion between both participants and, second, it enabled an observation from two different perspectives (i.e. one implementation-oriented view, which focused on the technological capabilities and the other user-oriented view, which focused on human perception and information processing). Both aspects mentioned led to synergy effects. To sum up, the Joint Interview Method turned out to be a promising usability approach to explore new technologies’ potential and user acceptance and therefore, can be recommended for its use in the process of designing and evaluating wearables.

Combining motion capture and digital human modeling for creating instructions in industrial settings

In this paper, a hybrid framework for creating an instruction video by means of motion capture technologies will be explained. In this video an animated pedagogical agent named Anastasia ( an imated as sistant for tas ks in i ndustrial a pplications) provides human operators with assistance while performing maintenance tasks in IPS2. Firstly, the paper contains a description of the creation process of an animated pedagogical agent which will be illustrated step by step on Anastasia. Secondly, the motion capture technology in form of a data glove will be presented. Thirdly, the concept and implementation how to improve realism of Anastasia by using the data glove will be introduced.

Neue Formen adaptiver und handlungsleitender Informationen im Arbeitskontext

ZusammenfassungDie Komplexität moderner Arbeitsumgebungen birgt durch die Fülle an Handlungsalternativen Überforderungspotenzial. Adaptive Technologien können in solchen Situationen durch die automatische Darbietung handlungsleitender Informationen Zielorientierung und Korrektheit von menschlichem Verhalten unterstützen. Damit diese Informationen tatsächlich in Verhalten umgesetzt werden, müssen sie sowohl handlungs-spezifisch, also einer Handlung intuitiv zuordenbar, als auch persuasiv, d.h. zur Verhaltensänderung anregend sein. Zwei Projekte der Technischen Universität Berlin und der Bundesanstalt für Arbeitsschutz und Arbeitsmedizin Dortmund untersuchen systematisch die Auswirkungen dieser Gestaltungsaspekte auf Leistungsfähigkeit und Entscheidungsverhalten von Personen. Erste Ergebnisse deuten darauf hin, dass nicht nur der Inhalt, sondern auch die Darbietungsform einen erheblichen Einfluss auf den Grad der Unterstützung besitzt.AbstractThe complexity of modern working environments may cause excessive demands on the human workers due to a large number of action alternatives. Under such circumstances, adaptive technologies can automatically present guiding information to support the goal-orientation and correctness of the human behaviour. It is more likely that the advice is transferred into action when the information given is action-specific, so the user intuitively relates it to a specific action, and persuasive, meaning it initiates a change in action. In two projects carried out by the Technische Universität Berlin and the Federal Institute for Occupational Safety and Health (BAuA) Dortmund researchers study how these aspects of information presentation affect the productivity and the decision behaviour of human. First results indicate that not only the content but also the type of presentation has a considerable impact on the degree of support.

Warnings and Instructions as Key Elements for Integrated User Support in IPS2

To keep up in times of global competition, an integrated user support is crucial for the safety and competitiveness in the field of Industrial Product-Service Systems (IPS2). This paper contains a review of the project work on warnings and instructions in IPS2 using the application scenario ‘spindle change’ on a micro milling machine. Specifically, the invented warning prototype and the animated instruction video as well as the associated experiments and their results will be presented. The paper concludes with the recent project work on the integration of both types of user support and the provision of future prospects.