Johan Simonsen Abildgaard

Organizational interventions: A research-based framework for the evaluation of both process and effects

Abstract Organizational interventions are often recommended when organizations want to improve employee psychological health and well-being. Research, however, has revealed inconsistent results and reviewers have called for research on why interventions either bring about desired change or fail to do so. Answering the “how” and “why” of intervention outcomes requires a close examination of the elements that hinder or facilitate desired outcomes, thus moving beyond evaluation of only the overall effects. In this paper, we present an evaluation framework based on recent intervention research and process-oriented organization theory. The framework offers suggestions for which elements to include when evaluating organizational interventions. Within the framework, elements crucial to intervention evaluation are grouped into four overarching categories that we argue are crucial to evaluation over the five phases of an intervention programme. These categories are: the organizational “actors”; the mental models of those actors; the context of the intervention; and intervention design and process. Evaluation during the process as well as of the overall effects, as recommended by this framework, should throw light on what works for whom, why, how and under which circumstances.

The development and validation of a job crafting measure for use with blue-collar workers

Abstract Job crafting describes a set of proactive behaviours in which employees may engage to shape their work in order to minimize hindering job demands and maximize resources and challenging demands. Such behaviours may be particularly important among blue-collar workers whose jobs are characterized by poor working conditions and low well-being. We present the development and adaptation of a job crafting measure that may be used among blue-collar workers, based on an existing scale by Tims, Bakker, and Derks (2012) that was not specifically developed for blue-collar workers. We test the validity and reliability of the measure in a longitudinal study based on multiple source information from mail delivery workers in Denmark (N=362 at Time 1; N=408 at Time 2). Results indicate the presence of five job crafting dimensions: increasing challenging demands, decreasing social job demands, increasing social job resources, increasing quantitative demands and decreasing hindering job demands. These can be reliably measured with 15 items. The measure shows acceptable discriminant and criterion validity, and test-retest reliability. The findings extend the application of the original questionnaire. They also add to knowledge of the job crafting behaviours in which blue-collar workers engage and link them to well-being outcomes.

Putting context into organizational intervention design: Using tailored questionnaires to measure initiatives for worker well-being

Realistic evaluation emphasizes the importance of exploring the mechanisms through which organizational interventions are effected. A well-known mechanism in organizational interventions is the screening process. Standardized questionnaires, in popular use, neither consider individuals’ appraisals of working conditions nor the specific context of the workplace. Screening with items tailored to intervention contexts may overcome the limitations of standardized questionnaires. In the present study, we evaluate an approach to develop a tailored questionnaire to measure employees’ appraisals of their specific working conditions. First, we interviewed 56 employees and 17 managers and, later, developed tailored items focused on the working conditions in a postal service. In follow-up interviews, we explore participants’ experiences with the tailored questionnaire, including the development of initiatives, compared with their previous experiences with the company’s annual attitude survey that used standardized scales. Results indicated that participants felt the tailored questionnaire highlighted issues that had previously been ignored, that initiatives were easier to develop owing to its specificity and that the feedback strategy was useful in prioritizing questionnaires. Overall, it can be concluded that tailored questionnaires may be appropriate for use in organizational intervention research and more broadly that evaluations of organizational interventions need to be contextually grounded.

Participatory Intervention from an Organizational Perspective: Employees as Active Agents in Creating a Healthy Work Environment

While organizational level interventions are generally recommended and the interest in conducting such interventions is increasing, few descriptions of how researchers may develop and implement such interventions exist. In this book chapter we present the PIOP (Participatory Interventions from an Organizational Perspective) approach. It is an intervention framework that aims to improve employee well-being through changes in the way work is designed, organized and managed. Building on the job demands-resources model, and cognitive appraisal, conservation of resources, job crafting, and fit theories, an approach has been developed that focuses on building employees’ resources through participatory processes. In this chapter, we describe the five phases in the PIOP approach and describe how participation is ensured in each phase. The five phases comprise: Initiation, screening, action planning, implementation and evaluation.

How to Measure the Intervention Process? An Assessment of Qualitative and Quantitative Approaches to Data Collection in the Process Evaluation of Organizational Interventions

Organizational interventions aiming at improving employee health and wellbeing have proven to be challenging to evaluate. To analyze intervention processes two methodological approaches have widely been used: quantitative (often questionnaire data), or qualitative (often interviews). Both methods are established tools, but their distinct epistemological properties enable them to illuminate different aspects of organizational interventions. In this paper, we use the quantitative and qualitative process data from an organizational intervention conducted in a national postal service, where the Intervention Process Measure questionnaire (N = 285) as well as an extensive interview study (N = 50) were used. We analyze what type of knowledge about intervention processes these two methodologies provide and discuss strengths and weaknesses as well as potentials for mixed methods evaluation methodologies.

Can job insecurity be managed? Evaluating an organizational-level intervention addressing the negative effects of restructuring

ABSTRACT Although downsizing and reorganisation are recognised as serious threats to the psychological well-being of employees, intervention strategies for addressing these events are limited. This study evaluated the effects of a participatory organisational-level intervention in which employees and managers chose to address the psychosocial consequences, specifically job insecurity, of restructuring. The intervention was conducted among postal service letter carriers in Denmark and was evaluated based on quantitative and qualitative data. Using interviews (N = 24) and observations, the programme theory of the intervention and to what extent the intervention had been implemented were assessed. Using survey data (N = 238), repeated measures ANOVAs were conducted to test for differences in the development of job insecurity between the intervention group and a comparison group. The results indicate that the intervention group had a significantly smaller increase in one dimension of job insecurity as compared to the comparison group. Therefore, we conclude that employees’ experiencing of job insecurity, which typically follows in the wake of restructuring, can be addressed by planned efforts at the workplace level.

Supporting Sensemaking to Promote a Systemic View of Organizational Change – Contributions from Activity Theory

ABSTRACT In this case study, the potential of intentional arenas and tools to promote collective sensemaking during major structural and technical transformations in a specialist organization in the Finnish forestry sector is examined. The results suggest that sensemaking processes in complex change situations are intimately linked to the temporal development of tensions concerning new ways and structures of working. The article demonstrates how Change Workshops, based on activity theoretical methods and tools, shaped sensemaking by offering means to collectively investigate developmental tensions and their potential resolutions and promoted the creation of a systemic view of changing work. This research thus provides an insight into ways in which to foster systemic and future-orientated perspectives in collective sensemaking processes, which in turn improve the management of organizational change.

Effectiveness of a participatory physical and psychosocial intervention to balance the demands and resources of industrial workers: A cluster-randomized controlled trial

Objectives The aim of this study was to evaluate the effectiveness of a participatory physical and psychosocial workplace intervention (known as PIPPI) on work ability and recovery among industrial workers. Methods Eligible workers were cluster-randomized into intervention (N=193) and control (N=222) groups. Intervention group members participated in three workshops where they mapped positive and negative aspects of their physical and psychosocial work environment and developed action plans addressing the highlighted issues, which were subsequently implemented by the participants. Questionnaire-based data on work ability and recovery were collected at baseline and 8-, 10- and 12-month follow-up. Data on productivity, well-being, mental health, and physical demands and resources were collected at baseline and 12-month follow-up. Results The intervention was delivered and received as planned (100% planned workshops conducted, 69% [standard deviation (SD) 7%] participation in workshops) and with a response rate of 76% (SD 8%) to the questionnaires. No significant between-group improvements for any of the outcomes were found in intention-to-treat multi-level mixed models. On the contrary, tendencies were observed for poorer recovery and reduced work ability in the intervention compared to control group. Conclusion The intervention did not improve the outcomes. This result can have several explanations, such as a regression-toward-the-mean effect or that the intervention might have put an additional burden on the workers already facing high work demands. In addition, there may have been an insufficient match between the intervention components implemented and the predetermined outcomes, and implementation may have been unsuccessful. These potential explanations need to be investigated using process evaluation data.

A participatory physical and psychosocial intervention for balancing the demands and resources among industrial workers (PIPPI): study protocol of a cluster-randomized controlled trial

BackgroundNeed for recovery and work ability are strongly associated with high employee turnover, well-being and sickness absence. However, scientific knowledge on effective interventions to improve work ability and decrease need for recovery is scarce. Thus, the present study aims to describe the background, design and protocol of a cluster randomized controlled trial evaluating the effectiveness of an intervention to reduce need for recovery and improve work ability among industrial workers.Methods/DesignA two-year cluster randomized controlled design will be utilized, in which controls will also receive the intervention in year two. More than 400 workers from three companies in Denmark will be aimed to be cluster randomized into intervention and control groups with at least 200 workers (at least 9 work teams) in each group. An organizational resources audit and subsequent action planning workshop will be carried out to map the existing resources and act upon initiatives not functioning as intended. Workshops will be conducted to train leaders and health and safety representatives in supporting and facilitating the intervention activities. Group and individual level participatory visual mapping sessions will be carried out allowing team members to discuss current physical and psychosocial work demands and resources, and develop action plans to minimize strain and if possible, optimize the resources. At all levels, the intervention will be integrated into the existing organization of work schedules. An extensive process and effect evaluation on need for recovery and work ability will be carried out via questionnaires, observations, interviews and organizational data assessed at several time points throughout the intervention period.DiscussionThis study primarily aims to develop, implement and evaluate an intervention based on the abovementioned features which may improve the work environment, available resources and health of industrial workers, and hence their need for recovery and work ability.

Forms of participation: The development and application of a conceptual model of participation in work environment interventions:

In the realm of work environment improvements, the Nordic countries have led the way in demonstrating that employee participation is a key requisite for achieving improvements. Despite this, there is a lack of precision as to what ‘participatory’ in a participatory work environment intervention means. In this study, the authors present a conceptual model for participation in work environment interventions and apply it to protocols and manuals from eight participatory interventions to determine the form of participation used in each intervention. The authors suggest that the conceptual model can be applied in the design and assessment of participatory work environment interventions.