Maureen Dobbins

A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies

BackgroundA knowledge broker (KB) is a popular knowledge translation and exchange (KTE) strategy emerging in Canada to promote interaction between researchers and end users, as well as to develop capacity for evidence-informed decision making. A KB provides a link between research producers and end users by developing a mutual understanding of goals and cultures, collaborates with end users to identify issues and problems for which solutions are required, and facilitates the identification, access, assessment, interpretation, and translation of research evidence into local policy and practice. Knowledge-brokering can be carried out by individuals, groups and/or organizations, as well as entire countries. In each case, the KB is linked with a group of end users and focuses on promoting the integration of the best available evidence into policy and practice-related decisions.MethodsA KB intervention comprised one of three KTE interventions evaluated in a randomized controlled trial.ResultsKB activities were classified into the following categories: initial and ongoing needs assessments; scanning the horizon; knowledge management; KTE; network development, maintenance, and facilitation; facilitation of individual capacity development in evidence informed decision making; and g) facilitation of and support for organizational change.ConclusionAs the KB role developed during this study, central themes that emerged as particularly important included relationship development, ongoing support, customized approaches, and opportunities for individual and organizational capacity development. The novelty of the KB role in public health provides a unique opportunity to assess the need for and reaction to the role and its associated activities. Future research should include studies to evaluate the effectiveness of KBs in different settings and among different health care professionals, and to explore the optimal preparation and training of KBs, as well as the identification of the personality characteristics most closely associated with KB effectiveness. Studies should also seek to better understand which combination of KB activities are associated with optimal evidence-informed decision making outcomes, and whether the combination changes in different settings and among different health care decision makers.

A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies

ContextSignificant resources and time are invested in the production of research knowledge. The primary objective of this randomized controlled trial was to evaluate the effectiveness of three knowledge translation and exchange strategies in the incorporation of research evidence into public health policies and programs.MethodsThis trial was conducted with a national sample of public health departments in Canada from 2004 to 2006. The three interventions, implemented over one year in 2005, included access to an online registry of research evidence; tailored messaging; and a knowledge broker. The primary outcome assessed the extent to which research evidence was used in a recent program decision, and the secondary outcome measured the change in the sum of evidence-informed healthy body weight promotion policies or programs being delivered at health departments. Mixed-effects models were used to test the hypotheses.FindingsOne hundred and eight of 141 (77%) health departments participated in this study. No significant effect of the intervention was observed for primary outcome (p < 0.45). However, for public health policies and programs (HPPs), a significant effect of the intervention was observed only for tailored, targeted messages (p < 0.01). The treatment effect was moderated by organizational research culture (e.g., value placed on research evidence in decision making).ConclusionThe results of this study suggest that under certain conditions tailored, targeted messages are more effective than knowledge brokering and access to an online registry of research evidence. Greater emphasis on the identification of organizational factors is needed in order to implement strategies that best meet the needs of individual organizations.Trial RegistrationThe trial registration number and title are as follows: ISRCTN35240937 -- Is a knowledge broker more effective than other strategies in promoting evidence-based physical activity and healthy body weight programming?

A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel?

BackgroundThe study of implementing research findings into practice is rapidly growing and has acquired many competing names (e.g., dissemination, uptake, utilization, translation) and contributing disciplines. The use of multiple terms across disciplines pose barriers to communication and progress for applying research findings. We sought to establish an inventory of terms describing this field and how often authors use them in a collection of health literature published in 2006.MethodsWe refer to this field as knowledge translation (KT). Terms describing aspects of KT and their definitions were collected from literature, the internet, reports, textbooks, and contact with experts. We compiled a database of KT and other articles by reading 12 healthcare journals representing multiple disciplines. All articles published in these journals in 2006 were categorized as being KT or not. The KT articles (all KT) were further categorized, if possible, for whether they described KT projects or implementations (KT application articles), or presented the theoretical basis, models, tools, methods, or techniques of KT (KT theory articles). Accuracy was checked using duplicate reading. Custom designed software determined how often KT terms were used in the titles and abstracts of articles categorized as being KT.ResultsA total of 2,603 articles were assessed, and 581 were identified as KT articles. Of these, 201 described KT applications, and 153 included KT theory. Of the 100 KT terms collected, 46 were used by the authors in the titles or abstracts of articles categorized as being KT. For all 581 KT articles, eight terms or term variations used by authors were highly discriminating for separating KT and non-KT articles (p < 0.001): implementation, adoption, quality improvement, dissemination, complex intervention (with multiple endings), implementation (within three words of) research, and complex intervention. More KT terms were associated with KT application articles (n = 13) and KT theory articles (n = 18).ConclusionsWe collected 100 terms describing KT research. Authors used 46 of them in titles and abstracts of KT articles. Of these, approximately half discriminated between KT and non-KT articles. Thus, the need for consolidation and consistent use of fewer terms related to KT research is evident.

The effectiveness of knowledge translation strategies used in public health: a systematic review.

BackgroundLiterature related to the effectiveness of knowledge translation (KT) strategies used in public health is lacking. The capacity to seek, analyze, and synthesize evidence-based information in public health is linked to greater success in making policy choices that have the best potential to yield positive outcomes for populations. The purpose of this systematic review is to identify the effectiveness of KT strategies used to promote evidence-informed decision making (EIDM) among public health decision makers.MethodsA search strategy was developed to identify primary studies published between 2000–2010. Studies were obtained from multiple electronic databases (CINAHL, Medline, EMBASE, and the Cochrane Database of Systematic Reviews). Searches were supplemented by hand searching and checking the reference lists of included articles. Two independent review authors screened studies for relevance, assessed methodological quality of relevant studies, and extracted data from studies using standardized tools.ResultsAfter removal of duplicates, the search identified 64, 391 titles related to KT strategies. Following title and abstract review, 346 publications were deemed potentially relevant, of which 5 met all relevance criteria on full text screen. The included publications were of moderate quality and consisted of five primary studies (four randomized controlled trials and one interrupted time series analysis). Results were synthesized narratively. Simple or single KT strategies were shown in some circumstances to be as effective as complex, multifaceted ones when changing practice including tailored and targeted messaging. Multifaceted KT strategies led to changes in knowledge but not practice. Knowledge translation strategies shown to be less effective were passive and included access to registries of pre-processed research evidence or print materials. While knowledge brokering did not have a significant effect generally, results suggested that it did have a positive effect on those organizations that at baseline perceived their organization to place little value on evidence-informed decision making.ConclusionsNo singular KT strategy was shown to be effective in all contexts. Conclusions about interventions cannot be taken on their own without considering the characteristics of the knowledge that was being transferred, providers, participants and organizations.

Information transfer: what do decision makers want and need from researchers?

PurposeThe purpose of this study was to undertake a systematic assessment of the need for research-based information by decision-makers working in community-based organizations. It is part of a more comprehensive knowledge transfer and exchange strategy that seeks to understand both the content required and the format/methods by which such information should be presented.MethodsThis was a cross-sectional telephone survey. Questions covered current practices, research use, and demographic information, as well as preferences for receiving research information. Three types of organizations participated: Childrens Treatment Centres of Ontario (CTCs); Ontario Community Care Access Centres (CCACs); and District Health Councils (DHCs). The analysis used descriptive statistics and analyses of variance (ANOVA) to describe and explore variations across organizations.ResultsThe participation rate was 70%. The highest perception of barriers to the use of research information was reported by the CCAC respondents, followed by CTCs and DHCs. The CTCs and DHCs reported greater use of research evidence in planning decisions as compared to the CCACs. Four sources of information transfer were consistently identified. These were websites, health-related research journals, electronic mail, and conferences and workshops. Preferred formats for receiving information were executive summaries, abstracts, and original articles.ConclusionThere were a number of similarities across organization type with respect to perceived barriers to research transfer, as well as the types of activities the organizations engaged in to promote research use in decision-making. These findings support the importance of developing interactive, collaborative knowledge transfer strategies, as well as the need to foster relationships with health care decision-makers, practitioners and policymakers.

Factors affecting the utilization of systematic reviews. A study of public health decision makers.

OBJECTIVE To determine the extent to which public health decision makers used five systematic reviews to make policy decisions, and to determine which characteristics predict their use. METHODS This cross-sectional follow-up study of public health decision makers in Ontario collected primary data using a telephone survey and a short, self-administered organizational demographics questionnaire completed by the administrative assistant for each Medical Officer of Health. Independent variables included characteristics of the innovation, organization, environment, and individual. Data were entered into a computerized database developed specifically for this study, and multiple logistic regression analysis was conducted. RESULTS The participation rate was very high, with 85% of public health units and 96% of available decision makers completing the survey. In addition, 63% of respondents stated they had used at least one of the systematic reviews in the previous 2 years to make a decision. The most important predictors of use were ones position, expecting to use a review in the future, and perceptions that the reviews were easy to use and that they overcame the barrier of limited critical appraisal skills. CONCLUSIONS Utilization of the systematic reviews in Ontario was very high. The utilization rates found in this study were significantly higher than those reported in previous utilization studies. Ones position was found to be the strongest predictor of use, identifying program managers and directors as the most appropriate audience for systematic reviews.

Deliberative dialogues as a mechanism for knowledge translation and exchange in health systems decision-making.

Models that describe the key features and intended effects of specific knowledge translation and exchange (KTE) interventions are much less prominent than models that provide a more general understanding of KTE. Our aim was to develop a model in order to describe the key features and intended effects of deliberative dialogues used as a KTE strategy and to understand how deliberative dialogues can support evidence-informed policymaking. By using critical interpretive synthesis, we identified 17 papers representing four fields of enquiry and integrated our findings into a model. The key features described in the model are: 1) an appropriate (i.e., conducive to the particular dialogue) meeting environment; 2) an appropriate mix of participants; and, 3) an appropriate use of research evidence. These features combine to create three types of intended effects: 1) short-term individual-level; 3) medium-term community/organizational-level; and, 3) long-term system-level. The concept of capacity building helps to explain the relationship between features and effects. The model is a useful contribution to the KTE field because it is a practical tool that could be used to guide the development and evaluation of deliberative dialogues in order to understand more about achieving particular outcomes in relation to specific issues or contexts.

An optimal search filter for retrieving systematic reviews and meta-analyses.

BackgroundHealth-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters.MethodsThis analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter.ResultsNineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened.ConclusionsThe health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.

Building capacity for evidence informed decision making in public health: a case study of organizational change

BackgroundCore competencies for public health in Canada require proficiency in evidence informed decision making (EIDM). However, decision makers often lack access to information, many workers lack knowledge and skills to conduct systematic literature reviews, and public health settings typically lack infrastructure to support EIDM activities. This research was conducted to explore and describe critical factors and dynamics in the early implementation of one public health units strategic initiative to develop capacity to make EIDM standard practice.MethodsThis qualitative case study was conducted in one public health unit in Ontario, Canada between 2008 and 2010. In-depth information was gathered from two sets of semi-structured interviews and focus groups (n = 27) with 70 members of the health unit, and through a review of 137 documents. Thematic analysis was used to code the key informant and document data.ResultsThe critical factors and dynamics for building EIDM capacity at an organizational level included: clear vision and strong leadership, workforce and skills development, ability to access research (library services), fiscal investments, acquisition and development of technological resources, a knowledge management strategy, effective communication, a receptive organizational culture, and a focus on change management.ConclusionWith leadership, planning, commitment and substantial investments, a public health department has made significant progress, within the first two years of a 10-year initiative, towards achieving its goal of becoming an evidence informed decision making organization.

What implementation interventions increase cancer screening rates? a systematic review

BackgroundAppropriate screening may reduce the mortality and morbidity of colorectal, breast, and cervical cancers. However, effective implementation strategies are warranted if the full benefits of screening are to be realized. As part of a larger agenda to create an implementation guideline, we conducted a systematic review to evaluate interventions designed to increase the rate of breast, cervical, and colorectal cancer (CRC) screening. The interventions considered were: client reminders, client incentives, mass media, small media, group education, one-on-one education, reduction in structural barriers, reduction in out-of-pocket costs, provider assessment and feedback interventions, and provider incentives. Our primary outcome, screening completion, was calculated as the overall median post-intervention absolute percentage point (PP) change in completed screening tests.MethodsOur first step was to conduct an iterative scoping review in the research area. This yielded three relevant high-quality systematic reviews. Serving as our evidentiary foundation, we conducted a formal update. Randomized controlled trials and cluster randomized controlled trials, published between 2004 and 2010, were searched in MEDLINE, EMBASE and PSYCHinfo.ResultsThe update yielded 66 studies new eligible studies with 74 comparisons. The new studies ranged considerably in quality. Client reminders, small media, and provider audit and feedback appear to be effective interventions to increase the uptake of screening for three cancers. One-on-one education and reduction of structural barriers also appears effective, but their roles with CRC and cervical screening, respectively, are less established. More study is required to assess client incentives, mass media, group education, reduction of out-of-pocket costs, and provider incentive interventions.ConclusionThe new evidence generally aligns with the evidence and conclusions from the original systematic reviews. This review served as the evidentiary foundation for an implementation guideline. Poor reporting, lack of precision and consistency in defining operational elements, and insufficient consideration of context and differences among populations are areas for additional research.