Steve Cohen

Identifying Impediments to Learning Probability and Statistics From an Assessment of Instructional Software

A detailed, multisite evaluation of instructional software designed to help students conceptualize introductory probability and statistics yielded patterns of error on several assessment items. Whereas two of the patterns appeared to be consistent with misconceptions associated with deterministic reasoning, other patterns indicated that prior knowledge may cause students to misinterpret certain concepts and displays. Misconceptions included interpreting the y-axis on a histogram as if it were a y-axis on a scatter plot and confusing the values a variable might take on by misinterpreting plots of normal probability distributions. These kinds of misconceptions are especially important to consider in light of the increased emphasis on computing and displays in statistics education.

Using the internet to extend training in team problem solving

A hybrid training approach, composed of both computer-mediated communication on the Internet and face-to-face meetings, was implemented. The goals were to examine whether such an approach (1) could be used to extend traditional, short-term training, and (2) would be perceived as useful by the trainees. A central element of the approach was thelinchpin expert, a trainer who served as a communication bridge on the Internet between a team of trainers and a team of trainees. A coding system was developed to analyze the content of the Internet messages. Logistic regression analysis revealed that two types of content were related to the trainees’ perceptions that the messages enhanced their expertise in team problem solving: (1) outcome feedback given to a trainee about a specific activity, and (2) the sharing of conceptual information. The trainees perceived face-to-face and computer-mediated communications with the linchpin expert as being important to their development of expertise.

A method for evaluating the effectiveness of educational software

A method for executing a detailed evaluation of educational software is described. Several issues are discussed, including the use of an experimental setting versus a field study, and the design of assessment instruments suited to evaluation of educational software. The instruments include a test of remedial skills, a 103-item test of conceptual understanding, and a system for recording students’ use of the software. The method was used to evaluate ConStatS, a program for teaching conceptual understanding of probability and statistics. Preliminary results of the evaluation are presented.

A model for assessing student interaction with educational software

We present a simple model of generative learning that permits us to define four kinds of interactions and a system for tracing and recording how students use educational technology. We believe that this model will maintain a link between interaction and learning, thus providing one method for the assessment of a wide range of educational technology environments. Two results are presented from an evaluation of ConStatS, a program for teaching conceptual understanding of probability and statistics. The results illustrate the kinds of insight into generative learning that a detailed trace method can provide.