Meera M. Blattner

A characterization of the scientific data analysis process

It is shown how data visualization fits into the broader process of scientific data analysis. Scientists from several disciplines were observed while they analyzed their own data. Examination of the observations exposed process elements outside conventional image viewing. For example, analysts queried for quantitative information, made a variety of comparisons, applied math, managed data, and kept records. The characterization of scientific data analysis reveals activity beyond that traditionally supported by computer. It offers an understanding which has the potential to be applied to many future designs, and suggests specific recommendations for improving the support of this important aspect of scientific computing.<<ETX>>

Multimodal integration

Advances in multimedia, virtual reality, and immersive environments have expanded human computer interaction beyond text and vision to include touch, gestures, voice, and 3D sound. Although well developed single modalities for communication already exist, we do not really understand the general problem of designing integrated multimodal systems. We explore this issue and the diverse approaches to it, with emphasis on a generic platform to support multimodal interaction.

Earcons and Icons: Their Structure and Common Design Principles (Abstract only)

In this paper we examine earcons, which are audio messagesused in the user-computer interface to provide information andfeedback to the user about computer entities. (Earcons includemessages and functions, as well as states and labels.) We identifysome design principles that are common to both visual symbols andauditory messages, and discuss the use of representational andabstract icons and earcons. We give some examples of audio patternsthat may be used to design modules for earcons which then may beassembled into larger groupings called families. The modules aresingle pitches or rhythmicized sequences of pitches calledmotives. The families are constructed about related motivesthat serve to identify a family of related messages. Issuesconcerned with learning and remembering earcons are discussed.

In our image: interface design in the 1990s

People, not technology, have become the focus of current interface design. Multimedia interface designers try to take advantage of human senses to ease our communication with one another and with the computer. This survey of current work highlights the complexity facing them in their task.<<ETX>>

Metawidgets: towards a theory of multimodal interface design

The authors analyze two intertwined and fundamental issues concerning computer-to-human communication in the multimodal interface; the interplay between sound and graphics, and the role of object persistence. The observations lead to metawidgets as abstract entities capable of manifesting themselves to users as image, as sound, or as various combinations and/or sequences of the two media. The authors show examples of metawidgets in action and discuss mechanisms for choosing among alternative media for metawidget instantiation. Two experimental microworlds implemented to explore these ideas are described.<<ETX>>

Visual tools and languages: directions for the '90s

The authors identify and discuss three domains where innovative application of visual programming languages is likely to make a significant impact in the near term: concurrent computing, computer-based assistance for people with disabilities, and the multimedia/multimodal environments of tomorrow in which it will be possible to hear and physically interact with information as well as see it.<<ETX>>

CHI'90 workshop on multimedia and multimodal interface design

A large number of disparate technologies contribute to an understanding of how to design a multimedia, multimodal interface. These vary from the use of vision, gesture and sound to applications, tools for interface construction, models and metaphors, and enabling technologies, such as video disk, and image processing. The primary objective of the workshop was to integrate what we presently know of these technologies and consider the areas that need to be explored for future development of multimedia in the computer interface.

Programming the multimodal interface

Fundamental problems will confront those who wish to take full advantage of the power of tomorrow`s multimodal environments. We argue that our recently introduced concept of meta-widget, when embedded within a high level, networked user interface server, can support the effective implementation of complex multimedia applications. We develop algorithms which enable a multimodal system to select the ``best`` combination of representations for the various ``information packets`` in a display at any moment. If no acceptable - combination of available representations can be found, strategies are provided for creating a new and useful, if not beautiful, representation to resolve the impasse. A running example is provided to motivate and clarify the discussion.

Multimedia environments for scientists

This paper addresses the question of how the work of the scientist will change in the new multimedia environments. Scenarios for the process of simulating and analyzing data in such environments are constructed, and some of the underlying models used in their construction are examined.<<ETX>>

Using partitioned databases for statistical data analysis

The statistical analysis of scientific data is a process that can be viewed as consisting of three fundamental phases. First, the observations are recorded. Next, they are encoded into a numeric form suitable for statistical analysis. Finally, the calculations are performed for the particular type of analysis needed for the design of the study. This ordering is, however, only conceptual; in most real studies, the three phases interact and are overlapped. Thus, it may be the case that a preliminary analysis run indicates that a more refined coding scheme is needed or that the coding process reveals deficiencies in the data collection.