M Karanika

Evaluating organizational-level work stress interventions: Beyond traditional methods

Abstract Since the early 1990s, there has been a growing literature on organizational-level interventions for work-related stress, and associated calls for such interventions to be evaluated. At the same time, doubts have been expressed about the adequacy of traditional scientific research methods in applied psychology (the natural science paradigm) in providing an effective framework for such evaluations. This paper considers some of the philosophical and methodological issues raised by evaluation research in relation to organizational-level interventions for work-related stress. Four key issues are discussed: the concept of a study being “fit for purpose” in relation to research designs and the nature of acceptable evidence; the issue of control of research conditions in real-world studies; the need to evaluate process as well as outcome, including the interrelated nature of process and outcome; and the interpretation of imperfect evidence sets. The starting point of this paper is the reality of organizational life, which is complex and continually changing. Its main objective is not to offer an alternative to a scientific approach but to argue for a more broadly conceived and eclectic framework for evaluation that acknowledges the limitations of the traditional approach. It espouses an approach that is reflective of the reality of organizational life and in which the methods used for evaluating an intervention are fit for purpose. The paper concludes by offering an outline framework for this broader approach to the evaluation of interventions.

Work design and management in the manufacturing sector: development and validation of the Work Organisation Assessment Questionnaire

Objectives: To examine the factor structure, reliability, and validity of a new context-specific questionnaire for the assessment of work and organisational factors. The Work Organisation Assessment Questionnaire (WOAQ) was developed as part of a risk assessment and risk reduction methodology for hazards inherent in the design and management of work in the manufacturing sector. Method: Two studies were conducted. Data were collected from 524 white- and blue-collar employees from a range of manufacturing companies. Exploratory factor analysis was carried out on 28 items that described the most commonly reported failures of work design and management in companies in the manufacturing sector. Concurrent validity data were also collected. A reliability study was conducted with a further 156 employees. Results: Principal component analysis, with varimax rotation, revealed a strong 28-item, five factor structure. The factors were named: quality of relationships with management, reward and recognition, workload, quality of relationships with colleagues, and quality of physical environment. Analyses also revealed a more general summative factor. Results indicated that the questionnaire has good internal consistency and test-retest reliability and validity. Being associated with poor employee health and changes in health related behaviour, the WOAQ factors are possible hazards. It is argued that the strength of those associations offers some estimation of risk. Feedback from the organisations involved indicated that the WOAQ was easy to use and meaningful for them as part of their risk assessment procedures. Conclusions: The studies reported here describe a model of the hazards to employee health and health related behaviour inherent in the design and management of work in the manufacturing sector. It offers an instrument for their assessment. The scales derived which form the WOAQ were shown to be reliable, valid, and meaningful to the user population.