Leah Reeves

Guidelines for multimodal user interface design

JMUI (Journal on Multimodal User Interfaces), Special issue “Best of affective computing and intelligent Guidelines for multimodal user interface design. support, human multi-modal information processing. characteristics to the design of a user-oriented and guidelines of multimodal interface design. Artifact lifecycle management, Consumer and user, Interfaces in Automated.Aug 2 Aug 7Los Angeles, CA, USAThursday, 6 August 2015 / HCI International 20152015.hci.international/thursday​CachedDefining and Optimizing User Interfaces Information Complexity for AI Design and Development of Multimodal Applications: A Vision on Key Issues and Traditional Heuristics and Industry Guidelines to Evaluate Multimodal Digital Artifacts

Usability engineering of virtual environments (VEs): identifying multiple criteria that drive effective VE system design

Designing usable and effective interactive virtual environment (VE) systems is a new challenge for system developers and human factors specialists. In particular, traditional usability principles do not consider characteristics unique to VE systems, such as the design of wayfinding and navigational techniques, object selection and manipulation, as well as integration of visual, auditory and haptic system outputs. VE designers must enhance presence, immersion, and system comfort, while minimizing sickness and deleterious after effects. Through the development of a multi-criteria assessment technique, the current effort categorizes and integrates these VE attributes into a systematic approach to designing and evaluating VE usability. Validation exercises suggest this technique, the Multicriteria Assessment of Usability for Virtual Environments (MAUVE) system, provides a structured approach for achieving usability in VE system design and evaluation. Applications for this research include military, entertainment, and any other interactive system that seeks to provide an enjoyable and effective user experience.

A Paradigm Shift in Interactive Computing: Deriving Multimodal Design Principles from Behavioral and Neurological Foundations

As technology advances, systems are increasingly able to provide more information than a human operator can process accurately. Thus, a challenge for designers is to create interfaces that allow operators to process the optimal amount of data. It is herein proposed that this may be accomplished by creating multimodal display systems that augment or switch modalities to maximize user information processing. Such a system would ultimately be informed by a users neurophysiological state. As a first step toward that goal, relevant literature is reviewed and a set of preliminary design guidelines for multimodal information systems is suggested.

Validation of Predictive Workload Component of the Multimodal Information Design Support (Mids) System

Operators in military C4ISR environments are required to rapidly assess and respond to critical events accurately while monitoring ongoing operations. In order to assist in designing complex display systems to support C4ISR operators, it is critical to understand when and why information displayed exceeds human capacity. Common metrics for evaluating operator overload are subjective report, which rely on self-reporting techniques (e.g., NASA/TLX, SART). A new design tool, the Multimodal Information Design Support (MIDS) system, predicts times of operator overload and offers multimodal design guidelines to streamline cognitive processing, thus alleviating times of operator workload and optimizing situation awareness. This paper empirically validates MIDS” predictive power in determining situations which may cause operator overload by comparing MIDS output to subjective reports of workload and SA during C4ISR operations. Future studies will validate MIDS” design capabilities through redesign and evaluation of performance, workload and SA on the optimized C4ISR task environment.

Multimodal, Multitask Interaction Design: Challenging Long-Standing Unimodal Design Assumptions

As the technology that supports interactive systems advances, the possibility of leveraging a multitude of sensory systems becomes possible. By using multiple sensory processors, substantial gains in the information management capacity of the human-computer integral should be realized, and those with sensory losses can be better accommodated. The question becomes when multimodal information is presented, how should these multiple sources of information be coordinated, particularly when two or more tasks are performed simultaneously? While current design theories developed primarily for unimodal interaction can be drawn on, additional research is required to fully guide multimodal multitask interaction design. The current study seeks to extend unimodal design theories to multimodal systems and identifies some interesting differences in unimodal vs multimodal multitask interaction.

New Kids on the Block: Multi-Dimensional Perspectives on Augmented Cognition

This discussion panel was organized to offer HFES members an opportunity to learn more about the burgeoning field of Augmented Cognition and to discover the multi-dimensional aspects of the discipline. The session will feature six invited panelists who were selected to represent a cross-section of the Augmented Cognition International Society community of more than 900 members. Each panelist will present their unique perspective of the AugCog field, which will provide the audience with information on a variety of research, development, and application areas in the AugCog field within the U.S and abroad. The panel members and their associated AugCog perspectives include: CDR Dylan Schmorrow, government; Denise Nicholson, academia; Dennis McBride, non-profit; Kay Stanney and Chris Berka, industry; and Blair Dickson, industry/international.