Sylvia J. Hysong

Audit and feedback and clinical practice guideline adherence: making feedback actionable.

BackgroundAs a strategy for improving clinical practice guideline (CPG) adherence, audit and feedback (A&F) has been found to be variably effective, yet A&F research has not investigated the impact of feedback characteristics on its effectiveness. This paper explores how high performing facilities (HPF) and low performing facilities (LPF) differ in the way they use clinical audit data for feedback purposes.MethodDescriptive, qualitative, cross-sectional study of a purposeful sample of six Veterans Affairs Medical Centers (VAMCs) with high and low adherence to six CPGs, as measured by external chart review audits.One-hundred and two employees involved with outpatient CPG implementation across the six facilities participated in one-hour semi-structured interviews where they discussed strategies, facilitators and barriers to implementing CPGs. Interviews were analyzed using techniques from the grounded theory method.ResultsHigh performers provided timely, individualized, non-punitive feedback to providers, whereas low performers were more variable in their timeliness and non-punitiveness and relied on more standardized, facility-level reports. The concept of actionable feedback emerged as the core category from the data, around which timeliness, individualization, non-punitiveness, and customizability can be hierarchically ordered.ConclusionFacilities with a successful record of guideline adherence tend to deliver more timely, individualized and non-punitive feedback to providers about their adherence than facilities with a poor record of guideline adherence. Consistent with findings from organizational research, feedback intervention characteristics may influence the feedbacks effectiveness at changing desired behaviors.

Meta-analysis: audit and feedback features impact effectiveness on care quality.

Background:Audit and feedback (A&F) has long been used to improve quality of care, albeit with variable results. This meta-analytic study tested whether Feedback Intervention Theory, a framework from industrial/organizational psychology, explains the observed variability in health care A&F research. Method:Data source: studies cited by Jamtvedts 2006 Cochrane systematic review of A&F, followed by database searches using the Cochrane reviews search strategy to identify more recent studies. Inclusion criteria: Cochrane review criteria, plus: presence of a treatment group receiving only A&F; a control group receiving no intervention; a quantitatively measurable outcome; minimum n of 10 per arm; sufficient statistics for effect size calculations. Moderators: presence of discouragement and praise; correct solution, attainment level, velocity, frequency, and normative information; feedback format (verbal, textual, graphic, public, computerized, group vs. individual); goal setting activity. Procedure: meta-analytic procedures using the Hedges-Olkin method. Results:Of 519 studies initially identified, 19 met all inclusion criteria. Studies were most often excluded due to the lack of a feedback-only arm. A&F has a modest, though significant positive effect on quality outcomes (d = 0.40, 95% confidence interval = ±0.20); providing specific suggestions for improvement, written, and more frequent feedback strengthened this effect, whereas graphical and verbal feedback attenuated this effect. Conclusions:A&F effectiveness is improved when feedback is delivered with specific suggestions for improvement, in writing, and frequently. Other feedback characteristics could also potentially improve effectiveness; however, research with stricter experimental controls is needed to identify the specific feedback characteristics that maximize its effectiveness.

Effectiveness of an Antimicrobial Stewardship Approach for Urinary Catheter–Associated Asymptomatic Bacteriuria

IMPORTANCE Overtreatment of asymptomatic bacteriuria (ASB) in patients with urinary catheters remains high. Health care professionals have difficulty differentiating cases of ASB from catheter-associated urinary tract infections. OBJECTIVES To evaluate the effectiveness and sustainability of an intervention to reduce urine culture ordering and antimicrobial prescribing for catheter-associated ASB compared with standard quality improvement methods. DESIGN, SETTING, AND PARTICIPANTS A preintervention and postintervention comparison with a contemporaneous control group from July 2010 to June 2013 at 2 Veterans Affairs health care systems. Study populations were patients with urinary catheters on acute medicine wards and long-term care units and health care professionals who order urine cultures and prescribe antimicrobials. INTERVENTION A multifaceted guidelines implementation intervention. MAIN OUTCOMES AND MEASURES The primary outcomes were urine cultures ordered per 1000 bed-days and cases of ASB receiving antibiotics (overtreatment) during intervention and maintenance periods compared with baseline at both sites. Patient-level analysis of inappropriate antimicrobial use adjusted for individual covariates. RESULTS Study surveillance included 289,754 total bed-days. The overall rate of urine culture ordering decreased significantly during the intervention period (from 41.2 to 23.3 per 1000 bed-days; incidence rate ration [IRR], 0.57; 95% CI, 0.53-0.61) and further during the maintenance period (to 12.0 per 1000 bed-days; IRR, 0.29; 95% CI, 0.26-0.32) (P < .001 for both). At the comparison site, urine cultures ordered did not change significantly across all 3 periods. There was a significant difference in the number of urine cultures ordered per month over time when comparing the 2 sites using longitudinal linear regression (P < .001). Overtreatment of ASB at the intervention site fell significantly during the intervention period (from 1.6 to 0.6 per 1000 bed-days; IRR, 0.35; 95% CI, 0.22-0.55), and these reductions persisted during the maintenance period (to 0.4 per 1000 bed-days; IRR, 0.24; 95% CI, 0.13-0.42) (P < .001 for both). Overtreatment of ASB at the comparison site was similar across all periods (odds ratio, 1.32; 95% CI, 0.69-2.52). When analyzed by type of ward, the decrease in ASB overtreatment was significant in long-term care. CONCLUSIONS AND RELEVANCE A multifaceted intervention targeting health care professionals who diagnose and treat patients with urinary catheters reduced overtreatment of ASB compared with standard quality improvement methods. These improvements persisted during a low-intensity maintenance period. The impact was more pronounced in long-term care, an emerging domain for antimicrobial stewardship.

Effects of Individual Physician-Level and Practice-Level Financial Incentives on Hypertension Care A Randomized Trial

IMPORTANCE Pay for performance is intended to align incentives to promote high-quality care, but results have been contradictory. OBJECTIVE To test the effect of explicit financial incentives to reward guideline-recommended hypertension care. DESIGN, SETTING, AND PARTICIPANTS Cluster randomized trial of 12 Veterans Affairs outpatient clinics with 5 performance periods and a 12-month washout that enrolled 83 primary care physicians and 42 nonphysician personnel (eg, nurses, pharmacists). INTERVENTIONS Physician-level (individual) incentives, practice-level incentives, both, or none. Intervention participants received up to 5 payments every 4 months; all participants could access feedback reports. MAIN OUTCOMES AND MEASURES Among a random sample, number of patients achieving guideline-recommended blood pressure thresholds or receiving an appropriate response to uncontrolled blood pressure, number of patients prescribed guideline-recommended medications, and number who developed hypotension. RESULTS Mean (SD) total payments over the study were

Unintended Consequences of Implementing a National Performance Measurement System into Local Practice

4270 (

The Safety Attitudes Questionnaire as a tool for benchmarking safety culture in the NICU

459),

Improving outpatient safety through effective electronic communication: a study protocol

2672 (

Neonatal intensive care unit safety culture varies widely.

153), and

Improving benchmarking by using an explicit framework for the development of composite indicators: an example using pediatric quality of care

1648 (

Development and validation of an algorithm to recalibrate mental models and reduce diagnostic errors associated with catheter-associated bacteriuria.

248) for the combined, individual, and practice-level interventions, respectively. The unadjusted baseline and final percentages and the adjusted absolute change over the study in patients meeting the combined blood pressure/appropriate response measure were 75% to 84% and 8.84% (95% CI, 4.20% to 11.80%) for the individual group, 80% to 85% and 3.70% (95% CI, 0.24% to 7.68%) for the practice-level group, 79% to 88% and 5.54% (95% CI, 1.92% to 9.52%) for the combined group, and 86% to 86% and 0.47% (95% CI, -3.12% to 4.04%) for the control group. The adjusted absolute estimated difference in the change between the proportion of patients with blood pressure control/appropriate response for individual incentive and control groups was 8.36% (95% CI, 2.40% to 13.00%; P=.005). The other incentive groups did not show a significant change compared with controls for this outcome. For medications, the unadjusted baseline and final percentages and the adjusted absolute change were 61% to 73% and 9.07% (95% CI, 4.52% to 13.44%), 56% to 65% and 4.98% (95% CI, 0.64% to 10.08%), 65% to 80% and 7.26% (95% CI, 2.92% to 12.48%), and 63% to 72% and 4.35% (95% CI, -0.28% to 9.28%), respectively. These changes in the use of guideline-recommended medications were not significant in any of the incentive groups compared with controls, nor was the incidence of hypotension. The effect of the incentive was not sustained after a washout. CONCLUSIONS AND RELEVANCE Individual financial incentives, but not practice-level or combined incentives, resulted in greater blood pressure control or appropriate response to uncontrolled blood pressure; none of the incentives resulted in greater use of guideline-recommended medications or increased incidence of hypotension compared with controls. Further research is needed on the factors that contributed to these findings. TRIAL REGISTRATION clinicaltrials.gov Identifier: NCT00302718.