Kara DeCorby

A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies

BackgroundA knowledge broker (KB) is a popular knowledge translation and exchange (KTE) strategy emerging in Canada to promote interaction between researchers and end users, as well as to develop capacity for evidence-informed decision making. A KB provides a link between research producers and end users by developing a mutual understanding of goals and cultures, collaborates with end users to identify issues and problems for which solutions are required, and facilitates the identification, access, assessment, interpretation, and translation of research evidence into local policy and practice. Knowledge-brokering can be carried out by individuals, groups and/or organizations, as well as entire countries. In each case, the KB is linked with a group of end users and focuses on promoting the integration of the best available evidence into policy and practice-related decisions.MethodsA KB intervention comprised one of three KTE interventions evaluated in a randomized controlled trial.ResultsKB activities were classified into the following categories: initial and ongoing needs assessments; scanning the horizon; knowledge management; KTE; network development, maintenance, and facilitation; facilitation of individual capacity development in evidence informed decision making; and g) facilitation of and support for organizational change.ConclusionAs the KB role developed during this study, central themes that emerged as particularly important included relationship development, ongoing support, customized approaches, and opportunities for individual and organizational capacity development. The novelty of the KB role in public health provides a unique opportunity to assess the need for and reaction to the role and its associated activities. Future research should include studies to evaluate the effectiveness of KBs in different settings and among different health care professionals, and to explore the optimal preparation and training of KBs, as well as the identification of the personality characteristics most closely associated with KB effectiveness. Studies should also seek to better understand which combination of KB activities are associated with optimal evidence-informed decision making outcomes, and whether the combination changes in different settings and among different health care decision makers.

A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies

ContextSignificant resources and time are invested in the production of research knowledge. The primary objective of this randomized controlled trial was to evaluate the effectiveness of three knowledge translation and exchange strategies in the incorporation of research evidence into public health policies and programs.MethodsThis trial was conducted with a national sample of public health departments in Canada from 2004 to 2006. The three interventions, implemented over one year in 2005, included access to an online registry of research evidence; tailored messaging; and a knowledge broker. The primary outcome assessed the extent to which research evidence was used in a recent program decision, and the secondary outcome measured the change in the sum of evidence-informed healthy body weight promotion policies or programs being delivered at health departments. Mixed-effects models were used to test the hypotheses.FindingsOne hundred and eight of 141 (77%) health departments participated in this study. No significant effect of the intervention was observed for primary outcome (p < 0.45). However, for public health policies and programs (HPPs), a significant effect of the intervention was observed only for tailored, targeted messages (p < 0.01). The treatment effect was moderated by organizational research culture (e.g., value placed on research evidence in decision making).ConclusionThe results of this study suggest that under certain conditions tailored, targeted messages are more effective than knowledge brokering and access to an online registry of research evidence. Greater emphasis on the identification of organizational factors is needed in order to implement strategies that best meet the needs of individual organizations.Trial RegistrationThe trial registration number and title are as follows: ISRCTN35240937 -- Is a knowledge broker more effective than other strategies in promoting evidence-based physical activity and healthy body weight programming?

Realist synthesis: illustrating the method for implementation research

BackgroundRealist synthesis is an increasingly popular approach to the review and synthesis of evidence, which focuses on understanding the mechanisms by which an intervention works (or not). There are few published examples of realist synthesis. This paper therefore fills a gap by describing, in detail, the process used for a realist review and synthesis to answer the question ‘what interventions and strategies are effective in enabling evidence-informed healthcare?’ The strengths and challenges of conducting realist review are also considered.MethodsThe realist approach involves identifying underlying causal mechanisms and exploring how they work under what conditions. The stages of this review included: defining the scope of the review (concept mining and framework formulation); searching for and scrutinising the evidence; extracting and synthesising the evidence; and developing the narrative, including hypotheses.ResultsBased on key terms and concepts related to various interventions to promote evidence-informed healthcare, we developed an outcome-focused theoretical framework. Questions were tailored for each of four theory/intervention areas within the theoretical framework and were used to guide development of a review and data extraction process. The search for literature within our first theory area, change agency, was executed and the screening procedure resulted in inclusion of 52 papers. Using the questions relevant to this theory area, data were extracted by one reviewer and validated by a second reviewer. Synthesis involved organisation of extracted data into evidence tables, theming and formulation of chains of inference, linking between the chains of inference, and hypothesis formulation. The narrative was developed around the hypotheses generated within the change agency theory area.ConclusionsRealist synthesis lends itself to the review of complex interventions because it accounts for context as well as outcomes in the process of systematically and transparently synthesising relevant literature. While realist synthesis demands flexible thinking and the ability to deal with complexity, the rewards include the potential for more pragmatic conclusions than alternative approaches to systematic reviewing. A separate publication will report the findings of the review.

An optimal search filter for retrieving systematic reviews and meta-analyses.

BackgroundHealth-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters.MethodsThis analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter.ResultsNineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened.ConclusionsThe health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.

A realist review of interventions and strategies to promote evidence-informed healthcare: A focus on change agency

BackgroundChange agency in its various forms is one intervention aimed at improving the effectiveness of the uptake of evidence. Facilitators, knowledge brokers and opinion leaders are examples of change agency strategies used to promote knowledge utilization. This review adopts a realist approach and addresses the following question: What change agency characteristics work, for whom do they work, in what circumstances and why?MethodsThe literature reviewed spanned the period 1997-2007. Change agency was operationalized as roles that are aimed at effecting successful change in individuals and organizations. A theoretical framework, developed through stakeholder consultation formed the basis for a search for relevant literature. Team members, working in sub groups, independently themed the data and developed chains of inference to form a series of hypotheses regarding change agency and the role of change agency in knowledge use.Results24, 478 electronic references were initially returned from search strategies. Preliminary screening of the article titles reduced the list of potentially relevant papers to 196. A review of full document versions of potentially relevant papers resulted in a final list of 52 papers. The findings add to the knowledge of change agency as they raise issues pertaining to how change agents’ function, how individual change agent characteristics effect evidence-informed health care, the influence of interaction between the change agent and the setting and the overall effect of change agency on knowledge utilization. Particular issues are raised such as how accessibility of the change agent, their cultural compatibility and their attitude mediate overall effectiveness. Findings also indicate the importance of promoting reflection on practice and role modeling. The findings of this study are limited by the complexity and diversity of the change agency literature, poor indexing of literature and a lack of theory-driven approaches.ConclusionThis is the first realist review of change agency. Though effectiveness evidence is weak, change agent roles are evolving, as is the literature, which requires more detailed description of interventions, outcomes measures, the context, intensity, and levels at which interventions are implemented in order to understand how change agent interventions effect evidence-informed health care.

A knowledge management tool for public health: health-evidence.ca

BackgroundThe ultimate goal of knowledge translation and exchange (KTE) activities is to facilitate incorporation of research knowledge into program and policy development decision making. Evidence-informed decision making involves translation of the best available evidence from a systematically collected, appraised, and analyzed body of knowledge. Knowledge management (KM) is emerging as a key factor contributing to the realization of evidence-informed public health decision making. The goal of health-evidence.ca is to promote evidence-informed public health decision making through facilitation of decision maker access to, retrieval, and use of the best available synthesized research evidence evaluating the effectiveness of public health interventions.MethodsThe systematic reviews that populate health evidence.ca are identified through an extensive search (1985-present) of 7 electronic databases: MEDLINE, EMBASE, CINAHL, PsycINFO, Sociological Abstracts, BIOSIS, and SportDiscus; handsearching of over 20 journals; and reference list searches of all relevant reviews. Reviews are assessed for relevance and quality by two independent reviewers. Commonly-used public health terms are used to assign key words to each review, and project staff members compose short summaries highlighting results and implications for policy and practice.ResultsAs of June 2010, there are 1913 reviews in the health-evidence.ca registry in 21 public health and health promotion topic areas. Of these, 78% have been assessed as being of strong or moderate methodological quality. Health-evidence.ca receives approximately 35,000 visits per year, 20,596 of which are unique visitors, representing approximately 100 visits per day. Just under half of all visitors return to the site, with the average user spending six minutes and visiting seven pages per visit. Public health nurses, program managers, health promotion workers, researchers, and program coordinators are among the largest groups of registered users, followed by librarians, dieticians, medical officers of health, and nutritionists. The majority of users (67%) access the website from direct traffic (e.g., have the health-evidence.ca webpage bookmarked, or type it directly into their browser).ConclusionsConsistent use of health-evidence.ca and particularly the searching for reviews that correspond with current public health priorities illustrates that health-evidence.ca may be playing an important role in achieving evidence-informed public health decision making.

Knowledge brokering in public health: a tale of two studies

OBJECTIVES A Knowledge Broker is one approach for facilitating the integration of evidence-informed decision making in public health practice. In this paper, the findings from two studies investigating a Knowledge Broker intervention as a means of enhancing capacity for evidence-informed decision making are presented. Contextual factors that facilitate this strategy are also identified. STUDY DESIGN This paper describes work done through a single mixed-methods study (randomized controlled trial with a qualitative component) and a case study. METHODS The Health Evidence team conducted two studies examining Knowledge Broker impact in Canadian public health departments. The effectiveness of knowledge translation strategies of varying intensities for promoting the use of research evidence in decisions related to child obesity prevention were explored via a randomized controlled trial with a fundamental descriptive component (2003-2007). In a case study (2010-2013), the authors partnered with three health departments to develop and implement tailored strategies targeted at the organization. Knowledge Brokers worked with designated staff in these studies via one-on-one consultations, small group meetings, and/or workshops and presentations. The Knowledge Broker role was assessed by analysing data from close-ended surveys, interviews, organizational documents, and reflective journals. RESULTS In this paper, the authors focus on findings from the qualitative analysis of implementing the Knowledge Broker role in both studies and explore several contextual factors that impacted study outcomes. Knowledge Brokers were shown to enhance individual capacity by improving knowledge and skill in searching for, critically appraising, and applying research evidence to practice-based issues. Organizational capacity was also enhanced with strong management support and policies. Effective Knowledge Broker attributes included both expertise in research methodology and public health, as well as intangible traits such as approachability and patience. Finally, optimal positioning and ways of working were identified, including the importance of in-person meetings and neutrality of the Knowledge Broker. CONCLUSIONS Knowledge brokering is a potentially promising knowledge translation strategy for public health, though additional feasibility and cost-effectiveness data are still needed. The research presented here further highlights the importance of context and adopting a tailored approach to implement a Knowledge Broker strategy.

Tools to support evidence-informed public health decision making

BackgroundPublic health professionals are increasingly expected to engage in evidence-informed decision making to inform practice and policy decisions. Evidence-informed decision making involves the use of research evidence along with expertise, existing public health resources, knowledge about community health issues, the local context and community, and the political climate. The National Collaborating Centre for Methods and Tools has identified a seven step process for evidence-informed decision making. Tools have been developed to support public health professionals as they work through each of these steps. This paper provides an overview of tools used in three Canadian public health departments involved in a study to develop capacity for evidence-informed decision making.MethodsAs part of a knowledge translation and exchange intervention, a Knowledge Broker worked with public health professionals to identify and apply tools for use with each of the steps of evidence-informed decision making. The Knowledge Broker maintained a reflective journal and interviews were conducted with a purposive sample of decision makers and public health professionals. This paper presents qualitative analysis of the perceived usefulness and usability of the tools.ResultsTools were used in the health departments to assist in: question identification and clarification; searching for the best available research evidence; assessing the research evidence for quality through critical appraisal; deciphering the ‘actionable message(s)’ from the research evidence; tailoring messages to the local context to ensure their relevance and suitability; deciding whether and planning how to implement research evidence in the local context; and evaluating the effectiveness of implementation efforts. Decision makers provided descriptions of how the tools were used within the health departments and made suggestions for improvement. Overall, the tools were perceived as valuable for advancing and sustaining evidence-informed decision making.ConclusionTools are available to support the process of evidence-informed decision making among public health professionals. The usability and usefulness of these tools for advancing and sustaining evidence-informed decision making are discussed, including recommendations for the tools’ application in other public health settings beyond this study. Knowledge and awareness of these tools may assist other health professionals in their efforts to implement evidence-informed practice.

The Effect of General Surgery Clerkship Rotation on the Attitude of Medical Students Towards General Surgery as a Future Career

BACKGROUND Literature suggests declining interest in General Surgery (GS) and other surgical specialties, with fewer Canadian medical residency applicants identifying a surgical specialty as their first choice. Although perceptions of surgical careers may begin before enrollment in clerkship, clerkship itself provides the most concentrated environment for perceptions to evolve. Most students develop perceptions about specialties during their clinical clerkships. This study examines the immediate impact of GS clerkship on student attitudes toward GS as a career, and on preferences towards GS compared with other specialties. METHODS A pre-post design involved 61 McMaster clinical clerks. Two instruments were used to collect data from students over the course of clerkship (2008-2009). Paired comparison (PC) compared ranking of career choices before and after clerkship. Semantic differential (SD) measured attitudes toward GS and variables that may have affected attitudes before and after clerkship. Analyses used SPSS 16.0 (SPSS Inc., Chicago, IL). RESULTS Clerks ranked preferences for GS changed substantially after clerkship, moving from the 10th to the 5th position compared with other specialties. Ranks of surgical subspecialties also changed, though GS demonstrated the largest improvement. SD results were consistent with PC, showing improved attitudes after rotation, with differences both statistically and practically significant (t = 3.81, p < 0.000, effect size = 0.23). Results indicated that attitudes toward all areas related to GS clerkship (attending physicians, surgical residents, ward nurses, scrub nurses, workload, knowledge achieved, technical skills acquired) improved significantly except attitude toward technical skills acquired. CONCLUSIONS Clinical clerkship at McMaster was a positive experience and significantly enhanced preferences towards GS and attitudes towards GS as a career. Medical schools should foster positive interaction between clinical clerks and staff (including attending surgeons and nurses), ensure that teaching hospital staff provide a positive experience for clerks, and should provide opportunities to learn basic technical skills during GS clerkship.

Facilitating access to pre-processed research evidence in public health

BackgroundEvidence-informed decision making is accepted in Canada and worldwide as necessary for the provision of effective health services. This process involves: 1) clearly articulating a practice-based issue; 2) searching for and accessing relevant evidence; 3) appraising methodological rigor and choosing the most synthesized evidence of the highest quality and relevance to the practice issue and setting that is available; and 4) extracting, interpreting, and translating knowledge, in light of the local context and resources, into practice, program and policy decisions. While the public health sector in Canada is working toward evidence-informed decision making, considerable barriers, including efficient access to synthesized resources, exist.MethodsIn this paper we map to a previously developed 6 level pyramid of pre-processed research evidence, relevant resources that include public health-related effectiveness evidence. The resources were identified through extensive searches of both the published and unpublished domains.ResultsMany resources with public health-related evidence were identified. While there were very few resources dedicated solely to public health evidence, many clinically focused resources include public health-related evidence, making tools such as the pyramid, that identify these resources, particularly helpful for public health decisions makers. A practical example illustrates the application of this model and highlights its potential to reduce the time and effort that would be required by public health decision makers to address their practice-based issues.ConclusionsThis paper describes an existing hierarchy of pre-processed evidence and its adaptation to the public health setting. A number of resources with public health-relevant content that are either freely accessible or requiring a subscription are identified. This will facilitate easier and faster access to pre-processed, public health-relevant evidence, with the intent of promoting evidence-informed decision making. Access to such resources addresses several barriers identified by public health decision makers to evidence-informed decision making, most importantly time, as well as lack of knowledge of resources that house public health-relevant evidence.