Jeremy Dawson

Probing three-way interactions in moderated multiple regression: Development and application of a slope difference test

Researchers often use 3-way interactions in moderated multiple regression analysis to test the joint effect of 3 independent variables on a dependent variable. However, further probing of significant interaction terms varies considerably and is sometimes error prone. The authors developed a significance test for slope differences in 3-way interactions and illustrate its importance for testing psychological hypotheses. Monte Carlo simulations revealed that sample size, magnitude of the slope difference, and data reliability affected test power. Application of the test to published data yielded detection of some slope differences that were undetected by alternative probing techniques and led to changes of results and conclusions. The authors conclude by discussing the tests applicability for psychological research.

The link between the management of employees and patient mortality in acute hospitals

The relationship between human resource management practices and organizational performance (including quality of care in health-care organizations) is an important topic in the organizational sciences but little research has been conducted examining this relationship in hospital settings. Human resource (HR) directors from sixty-one acute hospitals in England (Hospital Trusts) completed questionnaires or interviews exploring HR practices and procedures. The interviews probed for information about the extensiveness and sophistication of appraisal for employees, the extent and sophistication of training for employees and the percentage of staff working in teams. Data on patient mortality were also gathered. The findings revealed strong associations between HR practices and patient mortality generally. The extent and sophistication of appraisal in the hospitals was particularly strongly related, but there were links too with the sophistication of training for staff, and also with the percentages of staff working in teams.

Culture and behaviour in the English National Health Service: overview of lessons from a large multimethod study

Background Problems of quality and safety persist in health systems worldwide. We conducted a large research programme to examine culture and behaviour in the English National Health Service (NHS). Methods Mixed-methods study involving collection and triangulation of data from multiple sources, including interviews, surveys, ethnographic case studies, board minutes and publicly available datasets. We narratively synthesised data across the studies to produce a holistic picture and in this paper present a high-level summary. Results We found an almost universal desire to provide the best quality of care. We identified many ‘bright spots’ of excellent caring and practice and high-quality innovation across the NHS, but also considerable inconsistency. Consistent achievement of high-quality care was challenged by unclear goals, overlapping priorities that distracted attention, and compliance-oriented bureaucratised management. The institutional and regulatory environment was populated by multiple external bodies serving different but overlapping functions. Some organisations found it difficult to obtain valid insights into the quality of the care they provided. Poor organisational and information systems sometimes left staff struggling to deliver care effectively and disempowered them from initiating improvement. Good staff support and management were also highly variable, though they were fundamental to culture and were directly related to patient experience, safety and quality of care. Conclusions Our results highlight the importance of clear, challenging goals for high-quality care. Organisations need to put the patient at the centre of all they do, get smart intelligence, focus on improving organisational systems, and nurture caring cultures by ensuring that staff feel valued, respected, engaged and supported.

It's what you do and the way that you do it: Team task, team size, and innovation-related group processes

This article describes a study of the relationships between team inputs (task type and team size) and team processes in 87 cross industry Portuguese teams, some of which had high and some low requirements to innovate. Team processes were measured using the Team Climate Inventory (TCI), which focuses on clarity of and commitment to team objectives, levels of participation, support for innovation, and quality emphases. Three hypotheses were tested. The first proposed that teams carrying out tasks with a high innovation requirement would have high scores on a measure of team processes. This was supported insofar as such teams reported higher levels of participation and support for innovation. The second hypothesis proposed that large teams would have poorer team processes. This hypothesis was confirmed. The third hypothesis concerned the interaction between size and innovation. The results suggested that large teams operating under a relatively high pressure to innovate have poorer team processes than large teams that do not have a high requirement to innovate.

Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation

Objectives To conduct an independent evaluation of the first phase of the Health Foundation’s Safer Patients Initiative (SPI), and to identify the net additional effect of SPI and any differences in changes in participating and non-participating NHS hospitals. Design Mixed method evaluation involving five substudies, before and after design. Setting NHS hospitals in the United Kingdom. Participants Four hospitals (one in each country in the UK) participating in the first phase of the SPI (SPI1); 18 control hospitals. Intervention The SPI1 was a compound (multi-component) organisational intervention delivered over 18 months that focused on improving the reliability of specific frontline care processes in designated clinical specialties and promoting organisational and cultural change. Results Senior staff members were knowledgeable and enthusiastic about SPI1. There was a small (0.08 points on a 5 point scale) but significant (P<0.01) effect in favour of the SPI1 hospitals in one of 11 dimensions of the staff questionnaire (organisational climate). Qualitative evidence showed only modest penetration of SPI1 at medical ward level. Although SPI1 was designed to engage staff from the bottom up, it did not usually feel like this to those working on the wards, and questions about legitimacy of some aspects of SPI1 were raised. Of the five components to identify patients at risk of deterioration—monitoring of vital signs (14 items); routine tests (three items); evidence based standards specific to certain diseases (three items); prescribing errors (multiple items from the British National Formulary); and medical history taking (11 items)—there was little net difference between control and SPI1 hospitals, except in relation to quality of monitoring of acute medical patients, which improved on average over time across all hospitals. Recording of respiratory rate increased to a greater degree in SPI1 than in control hospitals; in the second six hours after admission recording increased from 40% (93) to 69% (165) in control hospitals and from 37% (141) to 78% (296) in SPI1 hospitals (odds ratio for “difference in difference” 2.1, 99% confidence interval 1.0 to 4.3; P=0.008). Use of a formal scoring system for patients with pneumonia also increased over time (from 2% (102) to 23% (111) in control hospitals and from 2% (170) to 9% (189) in SPI1 hospitals), which favoured controls and was not significant (0.3, 0.02 to 3.4; P=0.173). There were no improvements in the proportion of prescription errors and no effects that could be attributed to SPI1 in non-targeted generic areas (such as enhanced safety culture). On some measures, the lack of effect could be because compliance was already high at baseline (such as use of steroids in over 85% of cases where indicated), but even when there was more room for improvement (such as in quality of medical history taking), there was no significant additional net effect of SPI1. There were no changes over time or between control and SPI1 hospitals in errors or rates of adverse events in patients in medical wards. Mortality increased from 11% (27) to 16% (39) among controls and decreased from 17% (63) to 13% (49) among SPI1 hospitals, but the risk adjusted difference was not significant (0.5, 0.2 to 1.4; P=0.085). Poor care was a contributing factor in four of the 178 deaths identified by review of case notes. The survey of patients showed no significant differences apart from an increase in perception of cleanliness in favour of SPI1 hospitals. Conclusions The introduction of SPI1 was associated with improvements in one of the types of clinical process studied (monitoring of vital signs) and one measure of staff perceptions of organisational climate. There was no additional effect of SPI1 on other targeted issues nor on other measures of generic organisational strengthening.

Diversity faultlines, shared objectives, and top management team performance

Faultline theory suggests that negative effects of team diversity are better understood by considering the influence of different dimensions of diversity in conjunction, rather than for each dimension separately. We develop and extend the social categorization analysis that lies at the heart of faultline theory to identify a factor that attenuates the negative influence of faultlines: the extent to which the team has shared objectives. The hypothesized moderating role of shared objectives received support in a study of faultlines formed by differences in gender, tenure, and functional background in 42 top management teams. The focus on top management teams has the additional benefit of providing the first test of the relationship between diversity faultlines and objective indicators of organizational performance. We discuss how these findings, and the innovative way in which we operationalized faultlines, extend faultline theory and research as well as offer guidelines to manage diversity faultlines.

Team Reflexivity and Innovation: The Moderating Role of Team Context

Team reflexivity, the extent to which teams collectively reflect upon and adapt their working methods and functioning, has been shown to be an important predictor of team outcomes, notably innovation. As described in the current article, the authors developed and tested a team-level contingency model of team reflexivity, work demands, and innovation. They argue that highly reflexive teams will be more innovative than teams low in reflexivity when facing a demanding work environment. A field study of 98 primary health care teams in the United Kingdom corroborated their predictions: Team reflexivity was positively related to team innovation, and team reflexivity and work demands interacted such that high levels of both predicted higher levels of team innovation. Furthermore, an interaction between team reflexivity, quality of physical work environment (PWE), and team innovation showed that poor PWE coupled with high team reflexivity was associated with higher levels of team innovation. These results are discussed in the context of the need for team reflexivity and team innovation among teams at work facing high levels of work demands.

Multiple component patient safety intervention in English hospitals: controlled evaluation of second phase.

Objective To independently evaluate the impact of the second phase of the Health Foundation’s Safer Patients Initiative (SPI2) on a range of patient safety measures. Design A controlled before and after design. Five substudies: survey of staff attitudes; review of case notes from high risk (respiratory) patients in medical wards; review of case notes from surgical patients; indirect evaluation of hand hygiene by measuring hospital use of handwashing materials; measurement of outcomes (adverse events, mortality among high risk patients admitted to medical wards, patients’ satisfaction, mortality in intensive care, rates of hospital acquired infection). Setting NHS hospitals in England. Participants Nine hospitals participating in SPI2 and nine matched control hospitals. Intervention The SPI2 intervention was similar to the SPI1, with somewhat modified goals, a slightly longer intervention period, and a smaller budget per hospital. Results One of the scores (organisational climate) showed a significant (P=0.009) difference in rate of change over time, which favoured the control hospitals, though the difference was only 0.07 points on a five point scale. Results of the explicit case note reviews of high risk medical patients showed that certain practices improved over time in both control and SPI2 hospitals (and none deteriorated), but there were no significant differences between control and SPI2 hospitals. Monitoring of vital signs improved across control and SPI2 sites. This temporal effect was significant for monitoring the respiratory rate at both the six hour (adjusted odds ratio 2.1, 99% confidence interval 1.0 to 4.3; P=0.010) and 12 hour (2.4, 1.1 to 5.0; P=0.002) periods after admission. There was no significant effect of SPI for any of the measures of vital signs. Use of a recommended system for scoring the severity of pneumonia improved from 1.9% (1/52) to 21.4% (12/56) of control and from 2.0% (1/50) to 41.7% (25/60) of SPI2 patients. This temporal change was significant (7.3, 1.4 to 37.7; P=0.002), but the difference in difference was not significant (2.1, 0.4 to 11.1; P=0.236). There were no notable or significant changes in the pattern of prescribing errors, either over time or between control and SPI2 hospitals. Two items of medical history taking (exercise tolerance and occupation) showed significant improvement over time, across both control and SPI2 hospitals, but no additional SPI2 effect. The holistic review showed no significant changes in error rates either over time or between control and SPI2 hospitals. The explicit case note review of perioperative care showed that adherence rates for two of the four perioperative standards targeted by SPI2 were already good at baseline, exceeding 94% for antibiotic prophylaxis and 98% for deep vein thrombosis prophylaxis. Intraoperative monitoring of temperature improved over time in both groups, but this was not significant (1.8, 0.4 to 7.6; P=0.279), and there were no additional effects of SPI2. A dramatic rise in consumption of soap and alcohol hand rub was similar in control and SPI2 hospitals (P=0.760 and P=0.889, respectively), as was the corresponding decrease in rates of Clostridium difficile and meticillin resistant Staphylococcus aureus infection (P=0.652 and P=0.693, respectively). Mortality rates of medical patients included in the case note reviews in control hospitals increased from 17.3% (42/243) to 21.4% (24/112), while in SPI2 hospitals they fell from 10.3% (24/233) to 6.1% (7/114) (P=0.043). Fewer than 8% of deaths were classed as avoidable; changes in proportions could not explain the divergence of overall death rates between control and SPI2 hospitals. There was no significant difference in the rate of change in mortality in intensive care. Patients’ satisfaction improved in both control and SPI2 hospitals on all dimensions, but again there were no significant changes between the two groups of hospitals. Conclusions Many aspects of care are already good or improving across the NHS in England, suggesting considerable improvements in quality across the board. These improvements are probably due to contemporaneous policy activities relating to patient safety, including those with features similar to the SPI, and the emergence of professional consensus on some clinical processes. This phenomenon might have attenuated the incremental effect of the SPI, making it difficult to detect. Alternatively, the full impact of the SPI might be observable only in the longer term. The conclusion of this study could have been different if concurrent controls had not been used.

When promoting positive feelings pays: Aggregate job satisfaction, work design features, and innovation in manufacturing organizations

This study investigates the relationship between aggregate job satisfaction and organizational innovation. In a sample of manufacturing companies, data were gathered from 3717 employees in 28 UK manufacturing organizations about their job satisfaction and aggregated to the organizational level. Data on innovation in technology/processes were gathered from multiple respondents in the same organizations 24 months later. The results revealed that aggregate job satisfaction was a significant predictor of subsequent organizational innovation, even after controlling for prior organizational innovation and profitability. Moreover the data indicated that the relationship between aggregate job satisfaction and innovation in production technology/processes was moderated by two factors: job variety and a commitment to “single status”. Unlike previous studies, we conceptualize job satisfaction at the aggregate rather than the individual level and examine innovation rather than creativity. We propose that where the majority of employees experience job satisfaction, they will endorse rather than resist innovation and work collaboratively to implement as well as to generate creative ideas.

Organizational climate and climate strengths in UK hospitals

In recent years, researchers have paid increasing attention to the idea of “climate strength”—the level of agreement about climate within a work group or organization. However, at present the literature is unclear about the extent to which climate strength is a positive attribute, and is concerned predominantly with small teams or organizational units. This article considers three theoretical perspectives of climate strength, and extends these to the organizational level. These three roles of climate strength were tested in 56 hospitals in the United Kingdom. Positive relationships were discovered between two of three climate dimensions (Quality and Integration) and expert ratings of organizational performance, and a curvilinear effect between Integration climate strength and performance was also found. Very high or very low Integration climate strength was less beneficial than a moderate level of climate strength. However, there were no interaction effects discovered between climate and climate strength. Implications for future climate strength research are discussed.