Peter A. Margolis

The Influence of Context on Quality Improvement Success in Health Care: A Systematic Review of the Literature

CONTEXT The mixed results of success among QI initiatives may be due to differences in the context of these initiatives. METHODS The business and health care literature was systematically reviewed to identify contextual factors that might influence QI success; to categorize, summarize, and synthesize these factors; and to understand the current stage of development of this research field. FINDINGS Forty-seven articles were included in the final review. Consistent with current theories of implementation and organization change, leadership from top management, organizational culture, data infrastructure and information systems, and years involved in QI were suggested as important to QI success. Other potentially important factors identified in this review included: physician involvement in QI, microsystem motivation to change, resources for QI, and QI team leadership. Key limitations in the existing literature were the lack of a practical conceptual model, the lack of clear definitions of contextual factors, and the lack of well-specified measures. CONCLUSIONS Several contextual factors were shown to be important to QI success, although the current body of literature lacks adequate definitions and is characterized by considerable variability in how contextual factors are measured across studies. Future research should focus on identifying and developing measures of context tied to a conceptual model that examines context across all levels of the health care system and explores the relationships among various aspects of context.

Decreasing PICU Catheter-Associated Bloodstream Infections: NACHRI's Quality Transformation Efforts

OBJECTIVE: Despite the magnitude of the problem of catheter-associated bloodstream infections (CA-BSIs) in children, relatively little research has been performed to identify effective strategies to reduce these complications. In this study, we aimed to develop and evaluate effective catheter-care practices to reduce pediatric CA-BSIs. STUDY DESIGN AND METHODS: Our study was a multi-institutional, interrupted time-series design with historical control data and was conducted in 29 PICUs across the United States. Two central venous catheter–care practice bundles comprised our intervention: the insertion bundle of pediatric-tailored care elements derived from adult efforts and the maintenance bundle derived from the Centers for Disease Control and Prevention recommendations and expert pediatric clinician consensus. The bundles were deployed with quality-improvement teaching and methods to support their adoption by teams at the participating PICUs. The main outcome measures were the rate of CA-BSIs from January 2004 to September 2007 and compliance with each element of the insertion and maintenance bundles from October 2006 to September 2007. RESULTS: Average CA-BSI rates were reduced by 43% across 29 PICUs (5.4 vs 3.1 CA-BSIs per 1000 central-line-days; P < .0001). By September 2007, insertion-bundle compliance was 84% and maintenance-bundle compliance was 82%. Hierarchical regression modeling showed that the only significant predictor of an observed decrease in infection rates was the collective use of the insertion and maintenance bundles, as demonstrated by the relative rate (RR) and confidence intervals (CIs) (RR: 0.57 [95% CI: 0.45–0.74]; P < .0001). We used comparable modeling to assess the relative importance of the insertion versus maintenance bundles; the results showed that the only significant predictor of an infection-rate decrease was maintenance-bundle compliance (RR: 0.41 [95% CI: 0.20–0.85]; P = .017). CONCLUSIONS: In contrast with adult ICU care, maximizing insertion-bundle compliance alone cannot help PICUs to eliminate CA-BSIs. The main drivers for additional reductions in pediatric CA-BSI rates are issues that surround daily maintenance care for central lines, as defined in our maintenance bundle. Additional research is needed to define the optimal maintenance bundle that will facilitate elimination of CA-BSIs for children.

The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement

Background Quality improvement (QI) efforts have become widespread in healthcare, however there is significant variability in their success. Differences in context are thought to be responsible for some of the variability seen. Objective To develop a conceptual model that can be used by organisations and QI researchers to understand and optimise contextual factors affecting the success of a QI project. Methods 10 QI experts were provided with the results of a systematic literature review and then participated in two rounds of opinion gathering to identify and define important contextual factors. The experts subsequently met in person to identify relationships among factors and to begin to build the model. Results The Model for Understanding Success in Quality (MUSIQ) is organised based on the level of the healthcare system and identifies 25 contextual factors likely to influence QI success. Contextual factors within microsystems and those related to the QI team are hypothesised to directly shape QI success, whereas factors within the organisation and external environment are believed to influence success indirectly. Conclusions The MUSIQ framework has the potential to guide the application of QI methods in healthcare and focus research. The specificity of MUSIQ and the explicit delineation of relationships among factors allows a deeper understanding of the mechanism of action by which context influences QI success. MUSIQ also provides a foundation to support further studies to test and refine the theory and advance the field of QI science.

A comparison of cephalosporins and penicillins in the treatment of group A beta-hemolytic streptococcal pharyngitis: a meta-analysis supporting the concept of microbial copathogenicity.

Although penicillin has been the antibiotic of choice for therapy of Group A beta-hemolytic streptococcal pharyngitis for more than four decades, reports of bacteriologic and clinical treatment failures with penicillin have increased in recent years. We conducted a meta-analysis of 19 studies to examine whether oral cephalosporins were associated with lower failure rates than oral penicillin in the treatment of Group A beta-hemolytic streptococcal pharyngitis. The overall bacteriologic cure rate for penicillin was 84% (95% confidence interval (CI), 82%, 86%) compared with 92% (95% CI, 91%, 94%) among patients treated with cephalosporins (P < 0.0001). The overall clinical cure rate in the penicillin groups was 89% (95% CI, 87%, 91%) compared with 95% (95% CI, 94%, 96%) in the cephalosporin group (P < 0.001). There was no significant difference between the cephalosporins and the penicillins with respect to adverse events. There may be clinical circumstances in which treatment of Group A beta-hemolytic streptococcal pharyngitis with cephalosporins is indicated.

Coproduction of healthcare service

Efforts to ensure effective participation of patients in healthcare are called by many names—patient centredness, patient engagement, patient experience. Improvement initiatives in this domain often resemble the efforts of manufacturers to engage consumers in designing and marketing products. Services, however, are fundamentally different than products; unlike goods, services are always ‘coproduced’. Failure to recognise this unique character of a service and its implications may limit our success in partnering with patients to improve health care. We trace a partial history of the coproduction concept, present a model of healthcare service coproduction and explore its application as a design principle in three healthcare service delivery innovations. We use the principle to examine the roles, relationships and aims of this interdependent work. We explore the principles implications and challenges for health professional development, for service delivery system design and for understanding and measuring benefit in healthcare services.

Practice based education to improve delivery systems for prevention in primary care: randomised trial

Abstract Objective To examine the effectiveness of an intervention that combined continuing medical education with process improvement methods to implement “office systems” to improve the delivery of preventive care to children. Design Randomised trial in primary care practices. Setting Private paediatric and family practices in two areas of North Carolina. Participants Random sample of 44 practices allocated to intervention and control groups. Intervention Practice based continuing medical education in which project staff coached practice staff in reviewing performance and identifying, testing, and implementing new care processes (such as chart screening) to improve delivery of preventive care. Main outcome measure Change over time in the proportion of children aged 24-30 months who received age appropriate care for four preventive services (immunisations, and screening for tuberculosis, anaemia, and lead). Results The proportion of children per practice with age appropriate delivery of all four preventive services changed, after a one year period of implementation, from 7% to 34% in intervention practices and from 9% to 10% in control practices. After adjustment for baseline differences in the groups, the change in the prevalence of all four services between the beginning and the end of the study was 4.6-fold greater (95% confidence interval 1.6 to 13.2) in intervention practices. Thirty months after baseline, the proportion of children who were up to date with preventive services was higher in intervention than in control practices; results for screening for tuberculosis (54% v 32%), lead (68% v 30%), and anaemia (79% v 71%) were statistically significant (P < 0.05). Conclusion Continuing education combined with process improvement methods is effective in increasing rates of delivery of preventive care to children.

DEVELOPMENT OF A CLINICAL PREDICTION MODEL FOR AN ORDINAL OUTCOME: The World Health Organization Multicentre Study of Clinical Signs and Etiological Agents of Pneumonia, Sepsis and Meningitis in Young Infants

This paper describes the methodologies used to develop a prediction model to assist health workers in developing countries in facing one of the most difficult health problems in all parts of the world: the presentation of an acutely ill young infant. Statistical approaches for developing the clinical prediction model faced at least two major difficulties. First, the number of predictor variables, especially clinical signs and symptoms, is very large, necessitating the use of data reduction techniques that are blinded to the outcome. Second, there is no uniquely accepted continuous outcome measure or final binary diagnostic criterion. For example, the diagnosis of neonatal sepsis is ill-defined. Clinical decision makers must identify infants likely to have positive cultures as well as to grade the severity of illness. In the WHO/ARI Young Infant Multicentre Study we have found an ordinal outcome scale made up of a mixture of laboratory and diagnostic markers to have several clinical advantages as well as to increase the power of tests for risk factors. Such a mixed ordinal scale does present statistical challenges because it may violate constant slope assumptions of ordinal regression models. In this paper we develop and validate an ordinal predictive model after choosing a data reduction technique. We show how ordinality of the outcome is checked against each predictor. We describe new but simple techniques for graphically examining residuals from ordinal logistic models to detect problems with variable transformations as well as to detect non-proportional odds and other lack of fit. We examine an alternative type of ordinal logistic model, the continuation ratio model, to determine if it provides a better fit. We find that it does not but that this model is easily modified to allow the regression coefficients to vary with cut-offs of the response variable. Complex terms in this extended model are penalized to allow only as much complexity as the data will support. We approximate the extended continuation ratio model with a model with fewer terms to allow us to draw a nomogram for obtaining various predictions. The model is validated for calibration and discrimination using the bootstrap. We apply much of the modelling strategy described in Harrell, Lee and Mark (Statist. Med. 15, 361-387 (1998)) for survival analysis, adapting it to ordinal logistic regression and further emphasizing penalized maximum likelihood estimation and data reduction.

ImproveCareNow: The development of a pediatric inflammatory bowel disease improvement network

&NA; There is significant variation in diagnostic testing and treatment for inflammatory bowel disease. Quality improvement science methods can help address unwarranted variations in care and outcomes. Methods: The ImproveCareNow Network was established under the sponsorship of the North American Society for Pediatric Gastroenterology, Hepatology, and Nutrition and the American Board of Pediatrics as a prototype for a model of improving subspecialty care that included three components: 1) creating enduring multicenter collaborative networks of pediatric subspecialists, 2) sharing of performance data collected in patient registries, and 3) training in quality improvement. The network began with a focus on improving initial diagnostic testing and evaluation, the classification of the severity and extent of disease, the detection and treatment of inadequate nutrition and growth, and the appropriate dosing of immunomodulator medications. Changes are based on an evidence‐based model of chronic illness care involving the use of patient registries for population management, previsit planning, decision support, promoting self‐management, and auditing of care processes. Results: Currently, patients are being enrolled at 23 sites. Through 2009, data have been analyzed on over 2500 patients from over 7500 visits. Initial results suggest improvements in both care processes (e.g., appropriate medication dosing and completion of a classification bundle that includes the patients diagnosis, disease activity, distribution and phenotype, growth status, and nutrition status) and outcomes (e.g., the percentage of patients in remission). Conclusions: These improvements suggest that practice sites are learning how to apply quality improvement methods to improve the care of patients. (Inflamm Bowel Dis 2011;)

Improved Outcomes in a Quality Improvement Collaborative for Pediatric Inflammatory Bowel Disease

OBJECTIVES: Unintended variation in the care of patients with Crohn disease (CD) and ulcerative colitis (UC) may prevent achievement of optimal outcomes. We sought to improve chronic care delivery and outcomes for children with inflammatory bowel disease by using network-based quality improvement methods. METHODS: By using a modified Breakthrough Series collaborative structure, 6 ImproveCareNow Network care centers tested changes in chronic illness care and collected data monthly. We used an interrupted time series design to evaluate the impact of these changes. RESULTS: Data were available for 843 children with CD and 345 with UC. Changes in care delivery were associated with an increase in the proportion of visits with complete disease classification, measurement of thiopurine methyltransferase (TPMT) before initiation of thiopurines, and patients receiving an initial thiopurine dose appropriate to their TPMT status. These were significant in both populations for all process variables (P < .01) except for measurement of TPMT in CD patients (P = .12). There were significant increases in the proportion of CD (55%–68%) and UC (61%–72%) patients with inactive disease. There was also a significant increase in the proportion of CD patients not taking prednisone (86%–90%). Participating centers varied in the success of achieving these changes. CONCLUSIONS: Improvements in the outcomes of patients with CD and UC were associated with improvements in the process of chronic illness care. Variation in the success of implementing changes suggests the importance of overcoming organizational factors related to quality improvement success.

Short pediatric Crohn's disease activity index for quality improvement and observational research†

Background: Practical and objective instruments to assess pediatric Crohns disease (CD) activity are required for observational research and quality improvement. The objectives were: 1) to determine the feasibility of completing the Pediatric Crohns Disease Activity Index (PCDAI) and the Abbreviated PCDAI (APCDAI); and 2) to create a Short PCDAI by retaining and reweighting the most practical and informative components. Methods: Physicians in the ImproveCareNow Collaborative for pediatric inflammatory bowel disease (IBD) were asked to record components of the PCDAI and assign a Physician Global Assessment (PGA) of disease severity at each patient encounter. We assessed the feasibility of the PCDAI, the APCDAI, and the individual index components by determining the proportion of visits in which data were recorded. We created a short index by retaining and reweighting components of the PCDAI completed in ≥80% of visits. The feasibility of the Short PCDAI and its ability to discriminate between PGA categories were evaluated using descriptive statistics. Results: This study population included 1355 subjects with CD (6373 visits). The PCDAI and APCDAI were complete in 16.7% and 44.1% of visits, respectively. A Short PCDAI, including general well‐being, abdominal pain, stools, weight, abdominal exam, and extraintestinal manifestations were completed in 66.5% of visits. The correlation between the Short PCDAI and PGA was similar to that of the PCDAI (r = 0.60, P < 0.001 versus 0.61, P < 0.001). Conclusions: The Short PCDAI is a practical and valid tool to measure pediatric CD activity. Its use should facilitate quality improvement and observational research. (Inflamm Bowel Dis 2011;)