Ok-choon Park

Selective use of animation and feedback in computer-based instruction

The effects of two computer-based instructional strategies—visual display and feedback type—were investigated in the acquisition of electronic troubleshooting skills. Animation was used to simulate the functional behaviors of electronic circuits and to demonstrate the troubleshooting procedures. The first hypothesis tested was that animated visual displays would be more effective than static visual displays if animation was selectively used to support the specific learning requirements of a given task. Results supported this hypothesis by showing that college students in the animated visual display condition needed significantly fewer trials than those in the static visual display condition. The second hypothesis was that the effectiveness of intentionally mediated feedback (knowledge of results or explanatory information) would be minimal if natural feedback—the systems automatic functional reaction to external inputs—was available and the subject had the basic knowledge needed to understand the system functions. The results supported this hypothesis. Overall, this study implies that instructional strategies, including visual displays and feedback, should be applied selectively based on the specific learning requirements of a given task.

Visual Displays and Contextual Presentations in Computer-Based Instruction

The effects of two instructional strategies, visual display and contextual presentation, were investigated in the acquisition of electronic troubleshooting skills using computer-based instruction. Three types of visual displays (animation, static graphics with motion cues, and static graphics without motion cues) were used to represent structures and functions of electronic circuits and trouble-shooting procedures. The first hypothesis was that animation would be more effective than static graphics, but that static graphics with adequate motional cues representing the dynamic aspects of the task would accomplish results similar to animation. Results supported this hypothesis. The second hypothesis was that context-dependent instruction would be more efficient than context-independent instruction for solving problems in similar contexts, but that context independent instruction would be more effective in solving problems encountered in different contexts. The results supported this hypothesis. A general conclusion of this study is that the use of visual displays and contextual presentation should be based on the learning requirements of the task and the expected roles of the strategy in the learning.

An Historical Perspective and a Model for Evaluation of Intelligent Tutoring Systems.

The purposes of this article are to 1) examine the changes which have occurred in the development and evaluation of ITS systems for the last twenty years, 2) speculate on future directions, and 3) propose a conceptual model to evaluate and institutionalize this technological innovation into training and educational settings. First, we review theoretical and technical dimensions that could be considered relevant to internal evaluation of ITS technology. Secondly, we discuss evaluation dimensions which, while external to ITS per se, are relevant for situational evaluation of any technological innovation. After theoretical and methodological discussions of intelligent features and effectiveness of ITS, its research and development activities are examined from a historical perspective. The development of ITS is divided into three stages and the development focus for each stage is discussed to show the shifts. It is observed that theoretical and methodological criticisms of ITS, needs unique to practical applications, and development of computer technology have influenced the shifts of ITS development focuses: purpose, staffing, hardware and software technology used, and contributions. In stage III, most recent development focuses and future prospects are discussed, including investigation of specific instructional strategies, creation of flexible environments for instructional strategy research, modeling of the human tutor, simulation of human learning and cognition, and creation of multimedia environments. After discussing problems associated with moving ITS from the laboratory to an institutionalized part of the practical world, a conceptual model for evaluating technological innovation in training and educational environments is proposed. This model considers the technology purpose, processes, outcome measures, and the maturity of the technological innovation (the latter especially relevant for ITS). It has three major stages: adoption, implementation, and institutionalization and two major processes: assimilation and accommodation of the innovation. These stages and processes occur within a context of multiple levels of users/stakeholders or decision-makers. Taken together they make up the dimensions of the evaluation model for any technological innovation, including ITS.

A multidisciplinary model for development of intelligent computer-assisted instruction

Development of an intelligent computer-assisted instructional (ICAI) system requires a multidisciplinary team effort. A schematic model is proposed to help ICAI developers identify the types of required expertise and integrate them into a system. Three types of expertise are discussed in the model: (a) domain expertise, (b) domain engineering expertise, (c) and instructional expertise. Domain expertise is classified into two types: conceptual knowledge and performance (procedural) expertise. Specific knowledge representation methods are proposed to represent the two types of domain—semantic network for conceptual knowledge and production rules for procedural knowledge—and frames-scripts for the combined domain of the two types. For domain engineering expertise, three technical methods are discussed: knowledge acquisition, task analysis, and knowledge representation. For instructional expertise, conceptual issues and technical methods to model student learning and to select instructional strategies are discussed. A multidisciplinary cooperative effort is reemphasized in the conclusion.

Some uneasy inquiries into ID expert systems

Alternative approaches to developing software automating instructional development are described in this article. Information management and expert system approaches are compared. General assumptions underlying the development of all authoring tools, including conventional authoring systems, and additional assumptions underlying the development of expert ID tools are identified. Questions are raised concerning the viability of ID automation tools. It is argued that conventional authoring systems may not be as inadequate or inferior as ID expert system developers have claimed, and that of two approaches to ID automation, tools emphasizing information management are probably most useful. Information management tools, however, still may be inappropriate in some contexts.

Evaluation of CBT Authoring Systems: Need a Data Base

A computer-based training (CBT) authoring system is a special kind of software tool-kit for training developers with no programming skills and limited instructional design experience to use in developing CBT materials (i.e.,courseware). Many authoring systems have taken into account the needs of computer-naive users so that the learning requirements for using the systems is supposed to be minimal. However, the selection of the best authoring system for a given purpose requires a systematic evaluation because many systems have been developed to serve basically the same purpose with different procedural approaches, functional features and power. The purposes of this paper are: (a) to discuss evaluation methods for selecting an authoring system; (b) to examine important evaluation criteria; (c) to propose a set of evaluation procedures; (d) to discuss the need for developing a CBT authoring tool data base and provide initial inputs for the development of the data base.