Ben J. Kraal

Guidelines for multimodal user interface design

JMUI (Journal on Multimodal User Interfaces), Special issue “Best of affective computing and intelligent Guidelines for multimodal user interface design. support, human multi-modal information processing. characteristics to the design of a user-oriented and guidelines of multimodal interface design. Artifact lifecycle management, Consumer and user, Interfaces in Automated.Aug 2 Aug 7Los Angeles, CA, USAThursday, 6 August 2015 / HCI International 20152015.hci.international/thursday​CachedDefining and Optimizing User Interfaces Information Complexity for AI Design and Development of Multimodal Applications: A Vision on Key Issues and Traditional Heuristics and Industry Guidelines to Evaluate Multimodal Digital Artifacts

Passengers in the airport: artefacts and activities

This study addresses the ordinary activities of passengers in airports. Using observational techniques we investigated how passenger activities are mediated by artefacts, in this the bags that people carry. The relationship between passengers and their bags is shown to be complex and contingent on many factors. We report on our early research in the airport and document an emerging taxonomy of passenger activity. The significance of this research is in the contribution made to an understanding of passenger activities which could contribute to the design of future technologies for passenger facilitation and to airport terminal design.

A content analysis of the consumer-facing online information about My Health Record: Implications for increasing knowledge and awareness to facilitate uptake and use

Background: Low health literacy, low levels of positive belief and privacy and security concerns have been identified as a significant barrier to personal electronic health record uptake and use. An important tool for overcoming these barriers is the consumer-facing information which accompanies the system. My Health Record (MyHR) is the Australian national e-health record system, for which a large suite of online resources exists to facilitate consumer registration and use. This study uses a number of different measures of health resource quality to assess the MyHR online consumer-facing information and identify any gaps or areas for improvement. Objective: To analyse the quality and content of the online consumer-facing resources which support the uptake and use of MyHR. Method: Australian information resources aimed at healthcare consumers about the MyHR were included in this study. A comprehensive search using Internet search engines was conducted to locate all online consumer-facing resources about MyHR from both government and non-government sources. Readability (measured by Flesch–Kincaid grade level), year of publication/review, publishing organisation type, presentation style, linked websites, target audience, and themes were identified as important measures of health information quality, and these were recorded and reported on for each resource. Results: Eighty resources met the inclusion criteria. The mean Flesch–Kincaid grade level was 11.8. Most resources were created by Australian government sources (n = 55), and the most common target audience was the general public (n = 65). Registration (n = 51), privacy/security (n = 49), and benefits of use (n = 46) were the most common resource themes. Conclusion: The authors identified a number of gaps and areas for improvement in the provision of consumer-facing information about MyHR. Readability is too high for the general Australian population, and there are few translated resources, which means that the information provided does not cater to people with low literacy levels, communication disability, and/or difficulties in understanding written English. The target audiences for resources do not reflect priority groups that were identified during the MyHR development processes. There are also gaps in information provision about how consumers can use MyHR as a tool to meaningfully engage with health professionals and services to support their own person-centred care.

The role of electronic records in disability support

The aim of this study was to explore how disability support organisations and people who work in these organisations understand electronic records within the context of their daily work. Interviews were carried out with 16 front-line support management staff from a consortium of organisations that were introducing a shared electronic record; a software firm representative; and a project manager. Interviews were analysed thematically. Participants lacked consistency in how they described and anticipated the electronic record. They were unclear about who would use and benefit from the record. The role of third parties in the use of the record, such as medical professionals, was also unclear. Clarity about the way in which electronic records might change the work of support organisations could address larger challenges related to the concepts of “choice and control” and “person-centred” support. Without a consistent understanding of electronic records in disability support, there is a risk that future implementations of such records will fail.

Scenarios for embracing errorful automatic speech recognition

Errorful speech recognition can be embraced in the design of automatic speech recognition (ASR) support for the Magistrates Court. In this paper we describe processes and scenarios that led to a design by examining work practices and considering a more realistic understanding of ASR technology than is promoted in ASR literature.This paper also uses scenarios in a novel way to package and communicate field work data in a way that is accessible to a wide range of stakeholders.

Emerging work practice with a telehealth stethoscope

We investigated the collaboration of ten doctor-nurse pairs with a prototype digital telehealth stethoscope. Doctors could see and hear the patient but could not touch them or the stethoscope. The nurse in each pair controlled the stethoscope. For ethical reasons, an experimenter stood in for a patient. Each of the ten interactions was video recorded and analysed to understand the interaction and collaboration between the doctor and nurse. The video recordings were coded and transformed into maps of interaction that were analysed for patterns of activity. The analysis showed that as doctors and nurses became more experienced at using the telehealth stethoscope their collaboration was more effective. The main measure of effectiveness was the number of corrections in stethoscope placement required by the doctor. In early collaborations, the doctors gave many corrections. After several trials, each doctor and nurse had reduced corrections and all pairs reduced their corrections. The significance of this research is the identification of the qualities of effective collaboration in the use of the telehealth stethoscope and telehealth systems more generally.

Contrasting scenarios : embracing speech recognition

The purpose of this chapter is to describe the use of caricatured contrasting scenarios (Bodker, 2000) and how they can be used to consider potential designs for disruptive technologies. The disruptive technology in this case is Automatic Speech Recognition (ASR) software in workplace settings. The particular workplace is the Magistrates Court of the Australian Capital Territory.----- Caricatured contrasting scenarios are ideally suited to exploring how ASR might be implemented in a particular setting because they allow potential implementations to be “sketched” quickly and with little effort. This sketching of potential interactions and the emphasis of both positive and negative outcomes allows the benefits and pitfalls of design decisions to become apparent.----- A brief description of the Court is given, describing the reasons for choosing the Court for this case study. The work of the Court is framed as taking place in two modes: Front of house, where the courtroom itself is, and backstage, where documents are processed and the business of the court is recorded and encoded into various systems.----- Caricatured contrasting scenarios describing the introduction of ASR to the front of house are presented and then analysed. These scenarios show that the introduction of ASR to the court would be highly problematic.----- The final section describes how ASR could be re-imagined in order to make it useful for the court. A final scenario is presented that describes how this re-imagined ASR could be integrated into both the front of house and backstage of the court in a way that could strengthen both processes.

Looking for expertise in physical interactions

In this paper, we describe the methods we have used to investigate expertise in interaction with physical interfaces. This paper covers the background of the interfaces (compression bandages), describes the methods used and presents findings on the use of tacit and explicit knowledge during interaction. Due to the increase in interest in interfaces that cross between the physical and digital, this method may be of interest to researchers who are involved in similar projects.