Monika Kastner

What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review

BackgroundA knowledge synthesis attempts to summarize all pertinent studies on a specific question, can improve the understanding of inconsistencies in diverse evidence, and can identify gaps in research evidence to define future research agendas. Knowledge synthesis activities in healthcare have largely focused on systematic reviews of interventions. However, a wider range of synthesis methods has emerged in the last decade addressing different types of questions (e.g., realist synthesis to explore mediating mechanisms and moderators of interventions). Many different knowledge synthesis methods exist in the literature across multiple disciplines, but locating these, particularly for qualitative research, present challenges. There is a need for a comprehensive manual for synthesis methods (quantitative/qualitative or mixed), outlining how these methods are related, and how to match the most appropriate knowledge synthesis method to answer a research question. The objectives of this scoping review are to: 1) conduct a systematic search of the literature for knowledge synthesis methods across multi-disciplinary fields; 2) compare and contrast the different knowledge synthesis methods; and, 3) map out the specific steps to conducting the knowledge syntheses to inform the development of a knowledge synthesis methods manual/tool.MethodsWe will search relevant electronic databases (e.g., MEDLINE, CINAHL), grey literature, and discipline-based listservs. The scoping review will consider all study designs including qualitative and quantitative methodologies (excluding economic analysis or clinical practice guideline development), and identify knowledge synthesis methods across the disciplines of health, education, sociology, and philosophy. Two reviewers will pilot-test the screening criteria and data abstraction forms, and will independently screen the literature and abstract the data. A three-step synthesis process will be used to map the literature to our objectives.DiscussionThis project represents the first attempt to broadly and systematically identify, define and classify knowledge synthesis methods (i.e., less traditional knowledge synthesis methods). We anticipate that our results will lead to an accepted taxonomy for less traditional knowledge synthesis methods, and to the development and implementation of a methods manual for these reviews which will be relevant to a wide range of knowledge users, including researchers, funders, and journal editors.

Gaps in anaphylaxis management at the level of physicians, patients, and the community: a systematic review of the literature.

To cite this article: Kastner M, Harada L, Waserman S. Gaps in anaphylaxis management at the level of physicians, patients, and the community: a systematic review of the literature. Allergy 2010; 65: 435–444.

Anaphylaxis-related deaths in Ontario: a retrospective review of cases from 1986 to 2011

BackgroundExamining deaths caused by anaphylaxis may help identify factors that may decrease the risk of these unfortunate events. However, information on fatal anaphylaxis is limited. The objectives of our study were to examine all cases of fatal anaphylaxis in Ontario to determine cause of death, associated features, co factors and trends in mortality. The identification of these factors is important for developing effective strategies to overcome gaps in monitoring and treatment of patients with food allergies and risk for anaphylaxis.MethodsThis was a retrospective case-series analysis of all causes of anaphylaxis-related deaths using data from the Ontario Coroner’s database between 1986 and 2011. Quantitative data (e.g. demographic) were analyzed using descriptive statistics and frequency analysis using SPSS. Qualitative data were analyzed using content analysis of grounded theory methodology.ResultsWe found 92 deaths in the last 26 years related to anaphylaxis. Causes of death, in order of decreasing frequency, included food (40 cases), insect venom (30 cases), iatrogenic (16 cases), and idiopathic (6 cases). Overall, there appears to be a decline in the frequency of food related deaths, but an increase in iatrogenic causes of fatalities. We found factors associated with fatal anaphylaxis included: delayed epinephrine administration, asthma, allergy to peanut, food ingestion outside the home, and teenagers with food allergies.ConclusionsOur findings indicate the need to improve epinephrine auto-injector use in acute reactions, particularly for teens and asthmatics with food allergies. In addition, education can be improved among food service workers and food industry in order to help food allergic patients avoid potentially fatal allergens. The increasing trend in iatrogenic related anaphylaxis is concerning, and requires monitoring and more investigation.

A Scoping Review of Strategies for the Prevention of Hip Fracture in Elderly Nursing Home Residents

Background Elderly nursing home residents are at increased risk of hip fracture; however, the efficacy of fracture prevention strategies in this population is unclear. Objective We performed a scoping review of randomized controlled trials of interventions tested in the long-term care (LTC) setting, examining hip fracture outcomes. Methods We searched for citations in 6 respective electronic searches, supplemented by hand searches. Two reviewers independently reviewed all citations and full-text papers; consensus was achieved on final inclusion. Data was abstracted in duplicate. Findings We reviewed 22,349 abstracts or citations and 949 full-text papers. Data from 20 trials were included: 7 - vitamin D (n = 12,875 participants), 2 - sunlight exposure (n = 522), 1 - alendronate (n = 327), 1 - fluoride (n = 460), 4 – exercise or multimodal interventions (n = 8,165), and 5 - hip protectors (n = 2,594). Vitamin D, particularly vitamin D3 ≥800 IU orally daily, reduced hip fracture risk. Hip protectors reduced hip fractures in included studies, although a recent large study not meeting inclusion criteria was negative. Fluoride and sunlight exposure did not significantly reduce hip fractures. Falls were reduced in three studies of exercise or multimodal interventions, with one study suggesting reduced hip fractures in a secondary analysis. A staff education and risk assessment strategy did not significantly reduce falls or hip fractures. In a study underpowered for fracture outcomes, alendronate did not significantly reduce hip fractures in LTC. Conclusions The intervention with the strongest evidence for reduction of hip fractures in LTC is Vitamin D supplementation; more research on other interventions is needed.

Diagnostic Test Systematic Reviews: Bibliographic search filters ("Clinical Queries") for diagnostic accuracy studies perform well

BACKGROUND Systematic reviews of health care topics are valuable summaries of all pertinent studies on focused questions. However, finding all relevant primary studies for systematic reviews remains challenging. OBJECTIVES To determine the performance of the Clinical Queries sensitive search filter for diagnostic accuracy studies for retrieving studies for systematic reviews. METHODS We compared the yield of the sensitive Clinical Queries diagnosis search filter for MEDLINE and EMBASE to retrieve studies in diagnostic accuracy systematic reviews reported in ACP Journal Club in 2006. RESULTS Twelve of 22 diagnostic accuracy reviews (452 included studies) met the inclusion criteria. After excluding 11 studies not in MEDLINE or EMBASE, 95% of articles (417 of 441) were captured by the sensitive Clinical Queries diagnosis search filter (MEDLINE and EMBASE combined). Of 24 studies not retrieved by the filter, 22 were not diagnostic accuracy studies. Reanalysis of the Clinical Queries filter without these 22 nondiagnosis articles increased its performance to 99% (417 of 419). We found no substantive impact of the two articles missed by the Clinical Queries filter on the conclusions of the systematic reviews in which they were cited. CONCLUSION The sensitive Clinical Queries diagnostic search filter captured 99% of articles and 100% of substantive articles indexed in MEDLINE and EMBASE in diagnostic accuracy systematic reviews.

Guideline uptake is influenced by six implementability domains for creating and communicating guidelines: a realist review

OBJECTIVES To identify factors associated with the implementability of clinical practice guidelines (CPGs) and to determine what characteristics improve their uptake. STUDY DESIGN AND SETTING We conducted a realist review, which involved searching multiple sources (eg, databases, experts) to determine what about guideline implementability works, for whom, and under what circumstances. Two sets of reviewers independently screened abstracts and extracted data from 278 included studies. Analysis involved the development of a codebook of definitions, validation of data, and development of hierarchical narratives to explain guideline implementability. RESULTS We found that guideline implementability is associated with two broad goals in guideline development: (1) creation of guideline content, which involves addressing the domains of stakeholder involvement in CPGs, evidence synthesis, considered judgment (eg, clinical applicability), and implementation feasibility and (2) the effective communication of this content, which involves domains related to fine-tuning the CPGs message (using simple, clear, and persuasive language) and format. CONCLUSION Our work represents a comprehensive and interdisciplinary effort toward better understanding, which attributes of guidelines have the potential to improve uptake in clinical practice. We also created codebooks and narratives of key concepts, which can be used to create tools for developing better guidelines to promote better care.

The capture–mark–recapture technique can be used as a stopping rule when searching in systematic reviews

OBJECTIVE Researchers have no empirically based search stopping rule when looking for potentially relevant articles for inclusion in systematic reviews. We tested a stopping strategy based on capture-mark-recapture (CMR; i.e., the Horizon Estimate) statistical modeling to estimate the total number of articles in the domain of clinical decision support tools for osteoporosis disease management using four large bibliographic databases (Medline, EMBASE, CINAHL, and EBM reviews). STUDY DESIGN AND SETTING Retrospective evaluation of the Horizon Estimate using a systematic review of randomized controlled trials (RCTs) at two levels of article screening: title and abstract (1,246 potentially relevant articles) and full text (42 potentially relevant articles). RESULTS The CMR model suggests that the total number of potential articles was 1,838 for the first level of screening, and 49 for the full-text level. The four databases provided 68% of known articles for the first level of screening and 81% for full-text screening. CONCLUSIONS The CMR technique can be used in systematic reviews to estimate the closeness to capturing the total body of literature on a given topic. More studies are needed to objectively determine the usefulness of Horizon Estimates as a stopping rule strategy for systematic review searching.

Systematic Review and Meta-study Synthesis of Qualitative Studies Evaluating Facilitators and Barriers to Participation in Colorectal Cancer Screening

Screening reduces the incidence, morbidity, and mortality of colorectal cancer, yet participation tends to be low. We undertook a systematic review and meta-study synthesis of qualitative studies to identify facilitators and barriers to colorectal cancer screening participation. We searched major bibliographic databases for records published in all languages from inception to February 2015. Included primary studies that elicited views and perceptions towards colorectal cancer screening were appraised for relevance and quality. We used a two-stage synthesis to create an interpretation of colorectal cancer screening decisions grounded in primary studies; a thematic analysis to group themes and systematically compare studies and a meta-synthesis to generate an expanded theory of colorectal cancer screening participation. Ninety-four studies were included. The decision to participate in colorectal cancer screening depended on an individuals awareness of colorectal cancer screening. Awareness affected views of cancer, attitudes towards colorectal cancer screening modalities, and motivation for screening. Factors mediating awareness included public education to address misconceptions, primary care physician efforts to recommend screening, and the influence of friends and family. Specific barriers to participation in populations with lower participation rates included language barriers, logistical challenges to attending screening tests, and cultural beliefs. This study identifies key barriers, facilitators, and mediators to colorectal cancer screening participation. Cancer Epidemiol Biomarkers Prev; 25(6); 907–17. ©2016 AACR.

Usability evaluation of a clinical decision support tool for osteoporosis disease management

BackgroundOsteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines are available, patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions and a series of focus groups were used to develop a functional multifaceted tool that can support clinical decision-making in osteoporosis disease management at the point of care. The objective of our study was to assess how well the prototype met functional goals and usability needs.MethodsWe conducted a usability study for each component of the tool--the Best Practice Recommendation Prompt (BestPROMPT), the Risk Assessment Questionnaire (RAQ), and the Customised Osteoporosis Education (COPE) sheet--using the framework described by Kushniruk and Patel. All studies consisted of one-on-one sessions with a moderator using a standardised worksheet. Sessions were audio- and video-taped and transcribed verbatim. Data analysis consisted of a combination of qualitative and quantitative analyses.ResultsIn study 1, physicians liked that the BestPROMPT can provide customised recommendations based on risk factors identified from the RAQ. Barriers included lack of time to use the tool, the need to alter clinic workflow to enable point-of-care use, and that the tool may disrupt the real reason for the visit. In study 2, patients completed the RAQ in a mean of 6 minutes, 35 seconds. Of the 42 critical incidents, 60% were navigational and most occurred when the first nine participants were using the stylus pen; no critical incidents were observed with the last six participants that used the touch screen. Patients thought that the RAQ questions were easy to read and understand, but they found it difficult to initiate the questionnaire. Suggestions for improvement included improving aspects of the interface and navigation. The results of study 3 showed that most patients were able to understand and describe sections of the COPE sheet, and all considered discussing the information with their physicians. Suggestions for improvement included simplifying the language and improving the layout.ConclusionsFindings from the three studies informed changes to the tool and confirmed the importance of usability testing on all end users to reduce errors, and as an important step in the development process of knowledge translation interventions.

A scoping review identifies multiple emerging knowledge synthesis methods, but few studies operationalize the method

OBJECTIVES To systematically identify, define, and classify emerging knowledge synthesis methods through a scoping review. STUDY DESIGN AND SETTING MEDLINE, CINAHL, EMBASE, PsycINFO, the Cochrane Methodology Register, the Cochrane Database of Systematic Reviews, Social Sciences Abstracts, Library and Information Science Abstracts, Philosophers Index, and Education Resources Information Center were searched to identify articles reporting emerging knowledge synthesis methods across the disciplines of health, education, sociology, and philosophy. Two reviewers independently selected studies and abstracted data for each article. RESULTS In total, 409 articles reporting on 25 knowledge synthesis methods were included after screening of 17,962 titles and abstracts and 1,010 potentially relevant full-text articles. Most of the included articles were an application of the method (83.9%); only 3.7% were seminal articles that fully described the method (i.e., operationalized the steps). Most of the included articles were published after 2005. The methods were most commonly used across the fields of nursing, health care science and services, and health policy. CONCLUSION We found a lack of guidance on how to select a knowledge synthesis method. We propose convening an international group of leaders in the knowledge synthesis field to help clarify emerging approaches to knowledge synthesis.