Heather Colquhoun

No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention

BackgroundAudit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key ‘active ingredients.’DiscussionGiven the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the ‘business as usual’ approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature.SummaryWe offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.

A systematic review of the use of theory in randomized controlled trials of audit and feedback

BackgroundAudit and feedback is one of the most widely used and promising interventions in implementation research, yet also one of the most variably effective. Understanding this variability has been limited in part by lack of attention to the theoretical and conceptual basis underlying audit and feedback. Examining the extent of theory use in studies of audit and feedback will yield better understanding of the causal pathways of audit and feedback effectiveness and inform efforts to optimize this important intervention.MethodsA total of 140 studies in the 2012 Cochrane update on audit and feedback interventions were independently reviewed by two investigators. Variables were extracted related to theory use in the study design, measurement, implementation or interpretation. Theory name, associated reference, and the location of theory use as reported in the study were extracted. Theories were organized by type (e.g., education, diffusion, organization, psychology), and theory utilization was classified into seven categories (justification, intervention design, pilot testing, evaluation, predictions, post hoc, other).ResultsA total of 20 studies (14%) reported use of theory in any aspect of the study design, measurement, implementation or interpretation. In only 13 studies (9%) was a theory reportedly used to inform development of the intervention. A total of 18 different theories across educational, psychological, organizational and diffusion of innovation perspectives were identified. Rogers’ Diffusion of Innovations and Bandura’s Social Cognitive Theory were the most widely used (3.6% and 3%, respectively).ConclusionsThe explicit use of theory in studies of audit and feedback was rare. A range of theories was found, but not consistency of theory use. Advancing our understanding of audit and feedback will require more attention to theoretically informed studies and intervention design.

A Scoping Review of the Use of Theory in Studies of Knowledge Translation

Background. Advancing the science of knowledge translation (KT) in occupational therapy is critical. Explicit application of theory can advance this science; yet, how theory is applied and the degree to which it can guide research remain poorly defined. Purpose. To understand how theory is applied within KT research. Methods. A scoping review was conducted to examine and summarize the extent, range, and nature of the application of three specific KT theories: Diffusion of Innovations, Promoting Action on Research Implementation in Health Services framework, and Theory of Planned Behaviour. Findings. Theory use was seen most frequently in medicine and nursing. Only 3 of 90 articles were in rehabilitation. Five approaches to theory application were found, the most common being the use of to predict success of KT (57/90). Implications. In-depth study of the importance and methods of theory application in KT research is needed, in particular in occupational therapy.

A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems

BackgroundImplementing new practices requires changes in the behaviour of relevant actors, and this is facilitated by understanding of the determinants of current and desired behaviours. The Theoretical Domains Framework (TDF) was developed by a collaboration of behavioural scientists and implementation researchers who identified theories relevant to implementation and grouped constructs from these theories into domains. The collaboration aimed to provide a comprehensive, theory-informed approach to identify determinants of behaviour. The first version was published in 2005, and a subsequent version following a validation exercise was published in 2012. This guide offers practical guidance for those who wish to apply the TDF to assess implementation problems and support intervention design. It presents a brief rationale for using a theoretical approach to investigate and address implementation problems, summarises the TDF and its development, and describes how to apply the TDF to achieve implementation objectives. Examples from the implementation research literature are presented to illustrate relevant methods and practical considerations.MethodsResearchers from Canada, the UK and Australia attended a 3-day meeting in December 2012 to build an international collaboration among researchers and decision-makers interested in the advancing use of the TDF. The participants were experienced in using the TDF to assess implementation problems, design interventions, and/or understand change processes. This guide is an output of the meeting and also draws on the authors’ collective experience. Examples from the implementation research literature judged by authors to be representative of specific applications of the TDF are included in this guide.ResultsWe explain and illustrate methods, with a focus on qualitative approaches, for selecting and specifying target behaviours key to implementation, selecting the study design, deciding the sampling strategy, developing study materials, collecting and analysing data, and reporting findings of TDF-based studies. Areas for development include methods for triangulating data, e.g. from interviews, questionnaires and observation and methods for designing interventions based on TDF-based problem analysis.ConclusionsWe offer this guide to the implementation community to assist in the application of the TDF to achieve implementation objectives. Benefits of using the TDF include the provision of a theoretical basis for implementation studies, good coverage of potential reasons for slow diffusion of evidence into practice and a method for progressing from theory-based investigation to intervention.

Preferred methods and messengers for delivering physical activity information to people with spinal cord injury: a focus group study.

OBJECTIVE To explore the perceptions of people with spinal cord injury (SCI) regarding preferred messengers and methods for obtaining physical activity (PA) information. DESIGN Using a phenomenological approach and interviewing techniques, five focus groups discussed PA information delivery methods and messengers. PARTICIPANTS Sixteen community-dwelling adults with SCI (62.5% tetraplegia, 37.5% paraplegia; at least one-year postinjury) whose PA levels ranged from sedentary to regularly active. RESULTS Content analyses revealed that the preferred media for obtaining PA information were passive sources (e.g., Internet, DVDs, newsletters). The preferred messengers were peers and health service providers. There were diverse perspectives about the value and types of PA messages to share with people in the acute, rehabilitation, and postdischarge stages. CONCLUSIONS The methods and messengers identified in this study illustrate the need for interdisciplinary engagement among various program and health care providers to work together to effectively deliver PA information to all individuals with SCI. People will be receptive to different messages, from different channels, at different times.

User-centered design and the development of patient decision aids: protocol for a systematic review

BackgroundProviding patient-centered care requires that patients partner in their personal health-care decisions to the full extent desired. Patient decision aids facilitate processes of shared decision-making between patients and their clinicians by presenting relevant scientific information in balanced, understandable ways, helping clarify patients’ goals, and guiding decision-making processes. Although international standards stipulate that patients and clinicians should be involved in decision aid development, little is known about how such involvement currently occurs, let alone best practices. This systematic review consisting of three interlinked subreviews seeks to describe current practices of user involvement in the development of patient decision aids, compare these to practices of user-centered design, and identify promising strategies.Methods/designA research team that includes patient and clinician representatives, decision aid developers, and systematic review method experts will guide this review according to the Cochrane Handbook and PRISMA reporting guidelines. A medical librarian will hand search key references and use a peer-reviewed search strategy to search MEDLINE, EMBASE, PubMed, Web of Science, the Cochrane Library, the ACM library, IEEE Xplore, and Google Scholar. We will identify articles across all languages and years describing the development or evaluation of a patient decision aid, or the application of user-centered design or human-centered design to tools intended for patient use. Two independent reviewers will assess article eligibility and extract data into a matrix using a structured pilot-tested form based on a conceptual framework of user-centered design. We will synthesize evidence to describe how research teams have included users in their development process and compare these practices to user-centered design methods. If data permit, we will develop a measure of the user-centeredness of development processes and identify practices that are likely to be optimal.DiscussionThis systematic review will provide evidence of current practices to inform approaches for involving patients and other stakeholders in the development of patient decision aids. We anticipate that the results will help move towards the establishment of best practices for the development of patient-centered tools and, in turn, help improve the experiences of people who face difficult health decisions.Systematic review registrationPROSPERO CRD42014013241

Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review

BackgroundSystematic reviews consistently indicate that interventions to change healthcare professional (HCP) behaviour are haphazardly designed and poorly specified. Clarity about methods for designing and specifying interventions is needed. The objective of this review was to identify published methods for designing interventions to change HCP behaviour.MethodsA search of MEDLINE, Embase, and PsycINFO was conducted from 1996 to April 2015. Using inclusion/exclusion criteria, a broad screen of abstracts by one rater was followed by a strict screen of full text for all potentially relevant papers by three raters. An inductive approach was first applied to the included studies to identify commonalities and differences between the descriptions of methods across the papers. Based on this process and knowledge of related literatures, we developed a data extraction framework that included, e.g. level of change (e.g. individual versus organization); context of development; a brief description of the method; tasks included in the method (e.g. barrier identification, component selection, use of theory).Results3966 titles and abstracts and 64 full-text papers were screened to yield 15 papers included in the review, each outlining one design method. All of the papers reported methods developed within a specific context. Thirteen papers included barrier identification and 13 included linking barriers to intervention components; although not the same 13 papers. Thirteen papers targeted individual HCPs with only one paper targeting change across individual, organization, and system levels. The use of theory and user engagement were included in 13/15 and 13/15 papers, respectively.ConclusionsThere is an agreement across methods of four tasks that need to be completed when designing individual-level interventions: identifying barriers, selecting intervention components, using theory, and engaging end-users. Methods also consist of further additional tasks. Examples of methods for designing the organisation and system-level interventions were limited. Further analysis of design tasks could facilitate the development of detailed guidelines for designing interventions.

A scoping review of classification schemes of interventions to promote and integrate evidence into practice in healthcare

BackgroundMany models and frameworks are currently used to classify or describe knowledge translation interventions to promote and integrate evidence into practice in healthcare.MethodsWe performed a scoping review of intervention classifications in public health, clinical medicine, nursing, policy, behaviour science, improvement science and psychology research published to May 2013 by searching MEDLINE, PsycINFO, CINAHL and the grey literature. We used five stages to map the literature: identifying the research question; identifying relevant literature; study selection; charting the data; collating, summarizing, and reporting results.ResultsWe identified 51 diverse classification schemes, including 23 taxonomies, 15 frameworks, 8 intervention lists, 3 models and 2 other formats. Most documents were public health based, 55% included a literature or document review, and 33% were theory based.ConclusionsThis scoping review provides an overview of schemes used to classify interventions which can be used for evaluation, comparison and validation of existing and emerging models. The collated taxonomies can guide authors in describing interventions; adequate descriptions of interventions will advance the science of knowledge translation in healthcare.

Administration of the Canadian Occupational Performance Measure: Effect on practice:

Background. The Canadian Occupational Performance Measure (COPM) is recommended as a systematic approach to identify issues and determine client progress in occupational therapy, yet little empirical evidence is available that supports this practice. Purpose. To determine if COPM administration was associated with changes in eight dimensions of occupational therapy practice. Methods. Twenty-four occupational therapists on eight geriatric rehabilitation sites completed a before-and-after study with a repeated baseline. The eight practice dimensions were assessed after three months of usual care (no COPM use) and after three months of intervention (COPM use) using chart stimulated recall (CSR) interviews and chart audit. Findings. Mean practice scores for CSR interviews indicated a statistically significant practice improvement (p < .0001) across the eight dimensions, including knowledge of client perspective, clinical decision making, clinician ability to articulate outcomes, and documentation. Chart audit indicated that COPM use resulted in identifying more occupation-focused issues. Implications. COPM administration could improve occupational therapy practice.

WhatisKT wiki: a case study of a platform for knowledge translation terms and definitions — descriptive analysis

BackgroundMore than a hundred terms, often with unclear definitions and varying emphases, are used by health research and practice communities across the world who are interested in getting the best possible evidence applied (e.g., knowledge translation, implementation science, diffusion of innovations, and technology transfer). This makes finding published evidence difficult and can result in reduced, misinterpreted, or challenging interactions among professionals. Open dialogue and interaction among various professionals is needed to achieve consolidation of vocabulary. We use case report methods to describe how we sought to build an online tool to present the range of terms and facilitate the dialogue process across groups and disciplines interested in harnessing research evidence for healthcare.MethodsWe used a wiki platform from Wikispaces to present the problem of terminology and make a case and opportunity for collaboration on usage. Wikis are web sites where communities of users can collaborate online to build content and discuss progress. We gathered terms related to getting research into practice, sought published definitions, and posted these on the wiki (WhatisKT http://whatiskt.wikispaces.com/). We built the wiki in mid-2008 and promoted it through various groups and publications. This report describes the content of the site, our promotion efforts, use of the site, and how the site was used for collaboration up to the end of 2011.ResultsThe WhatisKT wiki site now includes more than 120 pages. Traffic to the site has increased substantially from an average of 200 monthly visits in 2008 to 1700 in 2011. Visitors from 143 countries viewed the wiki in 2011, compared with 12 countries in 2008. However, most use has been limited to short term accesses of about 40 seconds per visit, and discussion of consolidation and solidifying terminology is conspicuously absent.ConclusionsAlthough considerable interest exists in the terms and definitions related to getting research into practice based on increasing numbers of accesses, use of the WhatisKT wiki site for anything beyond quick lookups was minimal. Additional efforts must be directed towards increasing the level of interaction among the members of the site to encourage collaboration on term use.