Stanley L. Helgeson

A Study of the Effect of HyperCard and Pen-Paper Performance Assessment Methods on Expert-Novice Chemistry Problem Solving.

This study investigated HyperCard as a tool for assessment in science education and determined whether or not a HyperCard assessment instrument could differentiate between expert and novice student performance (balancing stoichiometric equations) in science education. Five chemical equations were presented by traditional pen-paper and by a HyperCard (Hyperequation) program. Thirty honors (expert) and 30 regular (novice) chemistry students were randomly divided into HyperCard and traditional pen-paper groups of 15 students each. Scoring was based on five dependent variables: performance scores, number of attempts, rate of attempts, time on task, and correctness. Correlation results indicated that students with high performance scores correctly balanced more equations, required fewer attempts to balance equations, and required less time per attempt than did students with low performance scores. MANOVA results showed that performance scores and correctness scores for both experts and novice were significantly higher on HyperCard compared to pen-paper assessment; the novice scores on HyperCard nearly equaled the expert pen-paper assessment scores. Significant interactions were found for time on task and for correctness. The results suggest that HyperCard can be a suitable tool for assessment in science education and that such an instrument can differentiate between expert and novice student performance.

Trends in Computer Applications in Science Assessment

Seven computer applications to science assessment are reviewed. Conventional test administration includes record keeping, grading, and managing test banks. Multiple-choice testing involves forced selection of an answer from a menu, whereas constructed-response testing involves options for students to present their answers within a set standard deviation. Adaptive testing attempts to individualize the test to minimize the number of items and time needed to assess a students knowledge. Figurai response testing assesses science proficiency in pictorial or graphic mode and requires the student to construct a mental image rather than selecting a response from a multiple choice menu. Simulations have been found useful for performance assessment on a large-scale basis in part because they make it possible to independently specify different aspects of a real experiment. An emerging approach to performance assessment is solution pathway analysis, which permits the analysis of the steps a student takes in solving a problem. Virtually all computer-based testing systems improve the quality and efficiency of record keeping and data analysis.

Effect of Computer Interfaces on Chemistry Problem Solving among Various Ethnic Groups: A Comparison of Pen-Point and Powerbook Computers

This study investigated the effect of Pen-Point and Powerbook computers on solving a multiple step chemistry (molaritý) problem among White, Afro-American and Hispanic students (N=60) at the high school level. The screens on both computers were partitioned into a work field and a reasoning field. Both computers were programmed to record the time spent in each field, the number of entries made, and a copy of the entries made. Statistical analysis of data showed that more of the White and Afro-American Pen-Point computer users solved the problem correctly than did students using the Powerbook computer. All three ethnic groups made fewer entries, and took less time using the Pen-Point computer than the Powerbook. Attitude survey results of all ethnic groups showed that more Pen-Point computer users felt comfortable working with computers. Over all, the results suggest that the Pen-Point computer has a more positive effect on the problem solving performance and attitude of students towards computers than the Powerbook computer.