Bryan R. Cole

Stability of response characteristics of a Delphi panel: application of bootstrap data expansion

BackgroundDelphi surveys with panels of experts in a particular area of interest have been widely utilized in the fields of clinical medicine, nursing practice, medical education and healthcare services. Despite this wide applicability of the Delphi methodology, there is no clear identification of what constitutes a sufficient number of Delphi survey participants to ensure stability of results.MethodsThe study analyzed the response characteristics from the first round of a Delphi survey conducted with 23 experts in healthcare quality and patient safety. The panel members had similar training and subject matter understanding of the Malcolm Baldrige Criteria for Performance Excellence in Healthcare. The raw data from the first round sampling, which usually contains the largest diversity of responses, were augmented via bootstrap sampling to obtain computer-generated results for two larger samples obtained by sampling with replacement. Response characteristics (mean, trimmed mean, standard deviation and 95% confidence intervals) for 54 survey items were compared for the responses of the 23 actual study participants and two computer-generated samples of 1000 and 2000 resampling iterations.ResultsThe results from this study indicate that the response characteristics of a small expert panel in a well-defined knowledge area are stable in light of augmented sampling.ConclusionPanels of similarly trained experts (who possess a general understanding in the field of interest) provide effective and reliable utilization of a small sample from a limited number of experts in a field of study to develop reliable criteria that inform judgment and support effective decision-making.

Quality Management in Education: Building Excellence and Equity in Student Performance

This research is based on a study of Brazosport ISD, an exemplary school district in Texas that used a quality management approach that resulted in greater equity and higher student performance. Faced with deteriorating state test scores in several schools, particularly those with a high population of economically disadvantaged students, this district elected to apply the philosophy, tools, and methods of quality management as a means to raise student achievement through system alignment and improvement of instructional processes. The findings of the study reveal a school district that successfully transformed its approach to education, redirecting its goals and processes to assure the success of every student. This article provides an analysis of the approach and deployment of changes, outcomes obtained, and implications for continuous improvement in other public school systems. In validation of the success of its new methodology and the results achieved Brazosport ISD won the Texas Quality Award in 1998 and received a site visit for the Malcolm Baldrige National Quality Award in 1999, the only school district to date to achieve both honors.

Applying total quality management principles to faculty selection

This paper outlines a systematic methodology for effecting Total Quality Management in higher education decision making with particular attention to the faculty selection process. Following a brief analysis of the application of TQM to higher education in general and consideration of the contextual and power relations issues associated with implementation of TQM, a model for integrating Total Quality Management principles into the faculty recruitment, identification, and selection process is outlined. This model relates the role of vision, mission, planning and organizational design with quality concepts (understanding a system and systems theory, leadership, empowerment, client/constituet satisfaction, team building, and continuous process improvement). Drawing upon Marchese and Lawrences (1987) work wherein they identified eight critical processes in the selection of faculty, one critical process—“Defining the job” is specifically analyzed using the continuous improvement methodology as an example of the specific application of TQM techniques to higher education decision making. The model and this example provide educational leaders/search committees with an enhanced framework within which they can effectively analyze and evaluate faculty selection processes, criteria for selection, and relevant contextual issues that will result in the identification and selection of the best qualified faculty available.

Curriculum Development in Community/Junior Colleges: The State of the Art as Viewed by the Academic Affairs Officer.

The purpose of this study was to determine the state of the art in curriculum development in U.S. community/junior colleges. Responding to a questionnaire of 33 items, 184 academic affairs officers expressed their perception of community/junior college curriculum development including (1) goals and objectives, (2) content, (3) learning experiences, (4) learner characteristics, and (5) planning and evaluation. Several areas are identified as needing attention that provide direction for improved curriculum development.