Cathleen Wharton

User interface evaluation in the real world: a comparison of four techniques

evaluation; guidelines; usability testing; cognitive walkthrough A user interface (UI) for a software product was evaluated prior to its release by four groups, each applying a different technique: heuristic evaluation, software guidelines, cognitive walkthroughs, and usability testing. Heuristic evaluation by several ill specialists found the most serious problems with the least amount of effort, although they also reported a large number of low-priority problems. The relative advantages of all the techniques are discussed, and suggestions for improvements in the techniques are offered.

Cognitive walkthroughs: a method for theory-based evaluation of user interfaces

This paper presents a new methodology for performing theory-based evaluations of user interface designs early in the design cycle. The methodology is an adaptation of the design walkthrough techniques that have been used for many years in the software engineering community. Traditional walkthroughs involve hand simulation of sections of code to ensure that they implement specified functionality. The method we present involves hand simulation of the cognitive activities of a user, to ensure that the user can easily learn to perform tasks that the system is intended to support. The cognitive walkthrough methodology, described in detail, is based on a theory of learning by exploration presented in this paper. There is a summary of preliminary results of effectiveness and comparisons with other design methods.

Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces

The value of theoretical analyses in user interface design has been hotly debated. All sides agree that it is difficult to apply current theoretical models within the constraints of real-world development projects. We attack this problem in the context of bringing the theoretical ideas within a model of exploratory learning [19] to bear on the evaluation of alternative interfaces for walk-up-and-use systems. We derived a “cognitive walkthrough” procedure for systematically evaluating features of an interface in the context of the theory. Four people independently applied this procedure to four alternative interfaces for which we have empirical usability data. Consideration of the walkthrough sheds light on the consistency with which such a procedure can be applied as well as the accuracy of the results.

Dual device user interface design: PDAs and interactive television

Computing environments which involve many interacting devices are a challenge for system and user interface designers. A prototype of a multiple-device application consisting of a personal digital assistant (PDA) that operates in conjunction with interactive television (ITV) was developed from user requirements for a real estate information service. The application is used both as a stand-alone service and in conjunction with a television. Users interact exclusively with the PDA. The television responds to PDA output and is used for the presentation of visual images and videos. In this paper the application is described and user interface design issues that arise in the context of multiple device systems are discussed.

Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations

The Cognitive Walkthrough methodology was developed in an effort to bring cognitive theory closer to practice; to enhance the design and evaluation of use interfaces in industrial settings. For the first time, small teams of professional developers have used this method to critique three complex software systems. In this paper we report evidence about how the methodology worked for these evaluations. We focus on five core issues: (1) task selection, coverage, and evaluation, (2) the process of doing a Cognitive Walkthrough, (3) requisite knowlege for the evaluators, (4) group walkthroughs, and (5) the interpretation of results. Our findings show that many variables can affect the success of the technique; we believe that if the Cognitive Walkthrough is ultimately to be successful in industrial settings, the method must be refined and augmented in a variety of ways.

Toward an HCI research and practice agenda based on human needs and social responsibility

The purpose of this workshop is to bring together HCI researchers and practitioners from diverse backgrounds, to explore and define new opportunities in HCI research and practice. We adopt the strategy of motivating our discussion of research and practice goals through a consideration of human needs and social responsibility. The rich diversity of human needs, and the intricate dialogues of socially responsible work, provide dramatic challenges to advance the state of research and practice in our field. The outcome will be new issues and projects of both theoretical and applied value. These issues and challenges will provide opportunities for developments and innovations of primary importance to our field.

A research agenda for highly effective human-computer interaction: useful, usable, and universal

Foreword: The ACM SIGCHI (Association for Computing Machinery Special lnterest Group in Computer Human Interaction) community conducted a deliberative process involving a high-visibility committee, a day-long workshop at CH199 (Pittsburgh, PA, May 15, 1999) and a collaborative authoring process. This interim report is offered to produce further discussion and input leading to endorsement by the SIGCHI Executive Committee and then other professional societies. The scope of this research agenda included advanced information and communications technology research that could yield benefits over the next two to five years.

HCI in domains: common ground and key differences

For quite a while, human-computer interaction (HCI) cannot be restricted to a group of computer gurus who provide their research results to a wider audience of consumers. HCI is more integrated in domains such as aerospace (Boy et al., 1998), medicine, education, entertainment and process control. Domains specialists need to handle HCI issues because they are much more involved in their domain needs and requirements than everyone else. These people have recognized the need to meet in order to discuss their specific domain-dependent issues in HCI. However, specificity is not their only concern. They also need to know what is being done in other domains where potential similar solutions could be of immense interest to them. Knowledge sharing in HCI is a very important issue that need to be further investigated, not from a top-down manner, but from a bottom-up manner. This is another way to produce scientific results by comparing, abstracting and categorizing results from different domains but significantly similar from an HCI perspective.

SIGCHI needs you

Volunteers are the lifeblood of SIGCHI: ACMs Special Interest Group on Computer-Human Interaction. SIGCHI is governed by an all-volunteer, elected Executive Committee which oversees conference activities, finances, publications and general operations. Volunteers organize annual CHI conferences, review papers, and organize conference venues like Panels and Workshop. Volunteers have built and maintained SIGCHIs electronic infrastructure, including Web site, e-mail lists, and databases for organizing technical programs and services for its membership, and the world-wide HCI community, As SIGCHI grows, it retains the services of professional services for its operations which permits the volunteer community to concentrate on advancing the profession. But in the end everything SIGCHI accomplishes is the direct result of volunteer input. And SIGCHI needs more of you.

CHI '95 basic research symposium on human-computer interaction (abstract)

A tvoday Research Symposium is held prior to the official CHI ’95 conference, Saturday and Sunday May 6-7, 1995. The Symposium is for active researchers in HumanComputer Interaction. The intent of the Symposium is to provide an interactive forum to promote and enhance scientific discussions of developing research issues. The Research Sympasium is designed to complement other parts of the CHI ’95 Conference, e.g., the papers program, design briefings, demonstrations, videos, panels, posters, and exhibits.