Peter R. Newsted

A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic-Mail Emotion/Adoption Study

The ability to detect and accurately estimate the strength of interaction effects are critical issues that are fundamental to social science research in general and IS research in particular. Within the IS discipline, a significant percentage of research has been devoted to examining the conditions and contexts under which relationships may vary, often under the general umbrella of contingency theory (cf. McKeen et al. 1994, Weill and Olson 1989). In our survey of such studies, the majority failed to either detect or provide an estimate of the effect size. In cases where effect sizes are estimated, the numbers are generally small. These results have led some researchers to question both the usefulness of contingency theory and the need to detect interaction effects (e.g., Weill and Olson 1989). This paper addresses this issue by providing a new latent variable modeling approach that can give more accurate estimates of interaction effects by accounting for the measurement error that attenuates the estimated relationships. The capacity of this approach at recovering true effects in comparison to summated regression is demonstrated in a Monte Carlo study that creates a simulated data set in which the underlying true effects are known. Analysis of a second, empirical data set is included to demonstrate the techniques use within IS theory. In this second analysis, substantial direct and interaction effects of enjoyment on electronic-mail adoption are shown to exist.

Research Report: Better Theory Through Measurement-Developing a Scale to Capture Consensus on Appropriation

Proper measurement is critical to the advancement of theory (Blalock 1979). Adaptive Structuration Theory (AST) is rapidly becoming an important theoretical paradigm for comprehending the impacts of advanced information technologies (DeSanctis and Poole 1994). Intended as a complement to the faithfulness of appropriation scale developed by Chin et al. (1997), this research note describes the development of an instrument to capture the AST construct of consensus on appropriation. Consensus on appropriation (COA) is the extent to which group participants perceive that they have agreed on how to adopt and use a technology. While consensus on appropriation is an important component of AST, no scale is currently available to capture this construct. This research note develops a COA instrument in the context of electronic meeting systems use. Initial item development, statistical analyses, and validity assessment (convergent, discriminant, and nomological) are described here in detail. The contribution of this effort is twofold: First, a scale is provided for an important construct from AST. Second, this report serves as an example of rigorous scale development using structural equation modeling. Employing rigorous procedures in the development of instruments to capture AST constructs is critical if the sound theoretical base provided by AST is to be fully exploited in understanding phenomena related to the use of advanced information technologies.

Research Report---The Importance of Specification in Causal Modeling: The Case of End-User Computing Satisfaction

In a survey of IS instruments spanning the years 1973 to 1988 Zmud and Boynton [Zmud, R. W., A. C. Boynton. 1991. Survey measures and instruments in MIS inventory and appraisal. K. I. Kraemer, ed. The Information Systems Research Challenge Survey Research Methods, Vol. 3. Harvard Business School, Boston, 149--180.], Doll and Torkzadehs Doll, W. J., G. Torkzadeh. 1988. The measurement of end-user computing satisfaction. MIS Quart. June 259--274. 12-item End-User Computing Satisfaction instrument was reported as one of three IS instruments that met conditions to qualify as “well developed.” Recently, Etezadi-Amoli and Farhoomand Etezadi-Amoli, J., A. F. Farhoomand. 1991. Issues and opinions on end-user computing satisfaction. MIS Quart. March 1--5. questioned the validity of these measures. Part of their critique centered on the poor model fit obtained in a re-analysis using LISREL. While other potentially valid points were raised by Etezadi-Amoli and Farhoomands critique, this report focuses only on their use of confirmatory factor analysis. In our re-analyses of Doll and Torkzadehs original covariance measures, we show how model fit is extremely dependent on model specification. While still maintaining the same number of constructs and respective measures, we demonstrate how two alternatives to the original model analyzed by Etezadi-Amoli and Farhoomand can result in models with acceptable fits.

Paper versus online presentations of subjective questionnaires

Exhibit effectiveness data from Jasper National Park in the Canadian Rockies was collected using both a paper and pencil survey and by means of a Victor 9000 microcomputer. These methods were compared to see if responses to a manually administered questionnaire are similar to responses to the same questions asked at a computer terminal. Both groups of respondents got similar percentages correct on questions about major exhibits that were textually based, but the computer group scored significantly better on those exhibits that had sound instead of text (in addition to a major visual component). The computer and manual groups were similar in their indication of how easy they felt most exhibits were to understand. However, the computer group indicated they saw significantly fewer major exhibits than did the manual group. Thus as a preliminary theory, it can be suggested that the non-random group of people drawn to the computer differ from typical random respondents in that they seem to gain more knowledge from or know more about features in exhibits which have a major sound component rather than a textual one. It was also found that the use of computerized surveying was well received by both visitors and staff. Respondents in the computer group particularly preferred it over paper and pencil questionnaires. Given these results it is concluded that the computer can be used to measure the effectiveness of many exhibits, and for those that have visual and auditory components, it may be a means of establishing a base-line or relative knowledge level for determining changing knowledge as exhibits are altered.

The impact of programming styles on debugging efficiency

Experimental results are presented indicating that programming techniques with identation, documentation, mnemonic variable names, modular design, as well as external design aids (i.e. structure charts, data flow diagrams, but not flow charts), correlate with fewer errors. Results also indicate that programmers who use these techniques take less time to detect and solve program bugs, suggesting that efficiency is increased.

Management implications of job control language standardisation

Abstract The brief history of command language standardisation efforts is reviewed: time and cost savings are detailed as reasons for requiring a standard operating system command and response language (OSCRL). A model of an abstract computing machine environment is introduced as a desirable kind of environment and as a way for management to understand the standardisation process. Management involvement is seen as all important, not only to support standardisation but to guide the increased flexibility which standardisation brings. Finally, it is stressed that technical experts must get involved to ensure a competent and comprehensive result - even though an actual standard may be five or more years distant.