Roland Grad

A Randomized Trial of the Effectiveness of On-demand versus Computer-triggered Drug Decision Support in Primary Care

OBJECTIVES Prescribing alerts generated by computerized drug decision support (CDDS) may prevent drug-related morbidity. However, the vast majority of alerts are ignored because of clinical irrelevance. The ability to customize commercial alert systems should improve physician acceptance because the physician can select the circumstances and types of drug alerts that are viewed. We tested the effectiveness of two approaches to medication alert customization to reduce prevalence of prescribing problems: on-physician-demand versus computer-triggered decision support. Physicians in each study condition were able to preset levels that triggered alerts. DESIGN This was a cluster trial with 28 primary care physicians randomized to either automated or on-demand CDDS in the MOXXI drug management system for 3,449 of their patients seen over the next 6 months. MEASUREMENTS The CDDS generated alerts for prescribing problems that could be customized by severity level. Prescribing problems included dosing errors, drug-drug, age, allergy, and disease interactions. Physicians randomized to on-demand activated the drug review when they considered it clinically relevant, whereas physicians randomized to computer-triggered decision support viewed all alerts for electronic prescriptions in accordance with the severity level they selected for both prevalent and incident problems. Data from administrative claims and MOXXI were used to measure the difference in the prevalence of prescribing problems at the end of follow-up. RESULTS During follow-up, 50% of the physicians receiving computer-triggered alerts modified the alert threshold (n = 7), and 21% of the physicians in the alert-on-demand group modified the alert level (n = 3). In the on-demand group 4,445 prescribing problems were identified, 41 (0.9%) were seen by requested drug review, and in 31 problems (75.6%) the prescription was revised. In comparison, 668 (10.3%) of the 6,505 prescribing problems in the computer-triggered group were seen, and 81 (12.1%) were revised. The majority of alerts were ignored because the benefit was judged greater than the risk, the interaction was known, or the interaction was considered clinically not important (computer-triggered: 75.8% of 585 ignored alerts; on-demand: 90% of 10 ignored alerts). At the end of follow-up, there was a significant reduction in therapeutic duplication problems in the computer-triggered group (odds ratio 0.55; p = 0.02) but no difference in the overall prevalence of prescribing problems. CONCLUSION Customization of computer-triggered alert systems is more useful in detecting and resolving prescribing problems than on-demand review, but neither approach was effective in reducing prescribing problems. New strategies are needed to maximize the use of drug decision support systems to reduce drug-related morbidity.

Impact of clinical information-retrieval technology on physicians: A literature review of quantitative, qualitative and mixed methods studies

PURPOSE This paper appraises empirical studies examining the impact of clinical information-retrieval technology on physicians and medical students. METHODS The world literature was reviewed up to February 2004. Two reviewers independently identified studies by scrutinising 3368 and 3249 references from bibliographic databases. Additional studies were retrieved by hand searches, and by searching ISI Web of Science for citations of articles. Six hundred and five paper-based articles were assessed for relevance. Of those, 40 (6.6%) were independently appraised by two reviewers for relevance and methodological quality. These articles were quantitative, qualitative or of mixed methods, and 26 (4.3%) were retained for further analysis. For each retained article, two teams used content analysis to review extracted textual material (quantitative results and qualitative findings). RESULTS Observational studies suggest that nearly one-third of searches using information-retrieval technology may have a positive impact on physicians. Two experimental and three laboratory studies do not reach consensus in support of a greater impact of this technology compared with other sources of information, notably printed educational material. Clinical information-retrieval technology may affect physicians, and further research is needed to examine its impact in everyday practice.

Combining classifiers for robust PICO element detection

BackgroundFormulating a clinical information need in terms of the four atomic parts which are Population/Problem, Intervention, Comparison and Outcome (known as PICO elements) facilitates searching for a precise answer within a large medical citation database. However, using PICO defined items in the information retrieval process requires a search engine to be able to detect and index PICO elements in the collection in order for the system to retrieve relevant documents.MethodsIn this study, we tested multiple supervised classification algorithms and their combinations for detecting PICO elements within medical abstracts. Using the structural descriptors that are embedded in some medical abstracts, we have automatically gathered large training/testing data sets for each PICO element.ResultsCombining multiple classifiers using a weighted linear combination of their prediction scores achieves promising results with an f-measure score of 86.3% for P, 67% for I and 56.6% for O.ConclusionsOur experiments on the identification of PICO elements showed that the task is very challenging. Nevertheless, the performance achieved by our identification method is competitive with previously published results and shows that this task can be achieved with a high accuracy for the P element but lower ones for I and O elements.

Diagnosis and management of asthma in preschoolers: A Canadian Thoracic Society and Canadian Paediatric Society position paper.

Asthma often starts before six years of age. However, there remains uncertainty as to when and how a preschool-age child with symptoms suggestive of asthma can be diagnosed with this condition. This delays treatment and contributes to both short- and long-term morbidity. Members of the Canadian Thoracic Society Asthma Clinical Assembly partnered with the Canadian Paediatric Society to develop a joint working group with the mandate to develop a position paper on the diagnosis and management of asthma in preschoolers. In the absence of lung function tests, the diagnosis of asthma should be considered in children one to five years of age with frequent (≥8 days/month) asthma-like symptoms or recurrent (≥2) exacerbations (episodes with asthma-like signs). The diagnosis requires the objective document of signs or convincing parent-reported symptoms of airflow obstruction (improvement in these signs or symptoms with asthma therapy), and no clinical suspicion of an alternative diagnosis. The characteristic feature of airflow obstruction is wheezing, commonly accompanied by difficulty breathing and cough. Reversibility with asthma medications is defined as direct observation of improvement with short-acting ß2-agonists (SABA) (with or without oral corticosteroids) by a trained health care practitioner during an acute exacerbation (preferred method). However, in children with no wheezing (or other signs of airflow obstruction) on presentation, reversibility may be determined by convincing parental report of a symptomatic response to a three-month therapeutic trial of a medium dose of inhaled corticosteroids with as-needed SABA (alternative method), or as-needed SABA alone (weaker alternative method). The authors provide key messages regarding in whom to consider the diagnosis, terms to be abandoned, when to refer to an asthma specialist and the initial management strategy. Finally, dissemination plans and priority areas for research are identified.

Four levels of outcomes of information-seeking: A mixed methods study in primary health care

Primary health care practitioners routinely search for information within electronic knowledge resources. We proposed four levels of outcomes of information-seeking: situational relevance, cognitive impact, information use, and patient health outcomes. Our objective was to produce clinical vignettes for describing and testing these levels. We conducted a mixed methods study combining a quantitative longitudinal study and a qualitative multiple case study. Participants were 10 nurses, 10 medical residents, and 10 pharmacists. They had access to an online resource, and did 793 searches for treatment recommendations. Using the Information Assessment Method (IAM), participants rated their searches for each of the four levels. Rated searches were examined in interviews guided by log reports and a think-aloud protocol. Cases were defined as clearly described searches where clinical information was used for a specific patient. For each case, interviewees described the four levels of outcomes. Quantitative and qualitative data were merged into clinical vignettes. We produced 130 clinical vignettes. Specifically, 46 vignettes (35.4%) corresponded to clinical situations where information use was associated with one or more than one type of positive patient health outcome: increased patient knowledge (n = 28), avoidance of unnecessary or inappropriate intervention (n = 25), prevention of disease or health deterioration (n = 9), health improvement (n = 6), and increased patient satisfaction (n = 3). Results suggested information use was associated with perceived benefits for patients. This may encourage clinicians to search for information more often when they feel the need. Results supported the four proposed levels of outcomes, which can be transferable to other information-seeking contexts.

Physicians' assessment of the value of clinical information: Operationalization of a theoretical model

Inspired by the acquisition–cognition–application model (T. Saracevic & K.B. Kantor, 1997), we developed a tool called the Information Assessment Method to more clearly understand how physicians use clinical information. In primary healthcare, we conducted a naturalistic and longitudinal study of searches for clinical information. Forty-one family physicians received a handheld computer with the Information Assessment Method linked to one commercial electronic knowledge resource. Over an average of 320 days, 83% of 2,131 searches for clinical information were rated using the Information Assessment Method. Searches to address a clinical question, as well as the retrieval of relevant clinical information, were positively associated with the use of that information for a specific patient. Searches done out of curiosity were negatively associated with the use of clinical information. We found significant associations between specific types of cognitive impact and information use for a specific patient. For example, when the physician reported “My practice was changed and improved” as a result of this clinical information, the odds that information was used for a specific patient increased threefold. Our findings provide empirical data to support the applicability of the acquisition-cognition-application model, as operationalized through the Information Assessment Method, in primary healthcare. Capturing the use of research-based information in medicine opens the door to further study of the relationships between clinical information and health outcomes.

Increasing the Detection and Response to Adherence Problems with Cardiovascular Medication in Primary Care through Computerized Drug Management Systems: A Randomized Controlled Trial

Background. Adherence with antihypertensive and lipid-lowering therapy is poor, resulting in an almost 2-fold increase in hospitalization. Treatment side effects, cost, and complexity are common reasons for nonadherence, and physicians are often unaware of these potentially modifiable problems. Objective. To determine if a cardiovascular medication tracking and nonadherence alert system, incorporated into a computerized health record system, would increase drug profile review by primary care physicians, increase the likelihood of therapy change, and improve adherence with antihypertensive and lipid-lowering drugs. Methods. There were 2293 primary care patients prescribed lipid-lowering or antihypertensive drugs who were randomized to the adherence tracking and alert system or active medication list alone to determine if the intervention increased drug profile review, changes in cardiovascular drug treatment, and refill adherence in the first 6 months. An intention to treat analysis was conducted using generalized estimating equations to account for clustering within physician. Results. Overall, medication adherence was below 80% for 36.3% of patients using lipid-lowering drugs and 40.8% of patients using antihypertensives at the start of the trial. There was a significant increase in drug profile review in the intervention compared to the control group (44.5% v. 35.5%; P < 0.001), a nonsignificant increase in drug discontinuations due to side effects (2.3% v. 2.0%; P = 0.61), and a reduction in therapy increases (28.5% v. 29.1%; P = 0.86). There was no significant change in refill adherence after 6 months of follow-up. Conclusion. An adherence tracking and alert system increases drug review but not therapy changes or adherence in prevalent users of cardiovascular drug treatment. Targeting incident users where adverse treatment effects are more common and combining adherence tracking and alert tools with motivational interventions provided by multidisciplinary primary care teams may improve the effectiveness of the intervention.

Patients’ perspective of barriers and facilitators to taking long-term controller medication for asthma: a novel taxonomy

BackgroundAlthough asthma morbidity can be prevented through long-term controller medication, most patients with persistent asthma do not take their daily inhaled corticosteroid. The objective of this study was to gather patients’ insights into barriers and facilitators to taking long-term daily inhaled corticosteroids as basis for future knowledge translation interventions.MethodsWe conducted a collective qualitative case study. We interviewed 24 adults, adolescents, or parents of children, with asthma who had received a prescription of long-term inhaled corticosteroids in the previous year. The one-hour face-to-face interviews revolved around patients’ perceptions of asthma, use of asthma medications, current self-management, prior changes in self-management, as well as patient-physician relationship. We sought barriers and facilitators to optimal asthma management. Interviews were transcribed verbatim and transcripts were analyzed using a thematic approach.ResultsPatients were aged 2–76 years old and 58% were female. Nine patients were followed by an asthma specialist (pulmonologist or allergist), 13 patients by family doctors or pediatricians, and two patients had no regular follow-up. Barriers and facilitators to long-term daily inhaled corticosteroids were classified into the following loci of responsibility and its corresponding domains: (1) patient (cognition; motivation, attitudes and preferences; practical implementation; and parental support); (2) patient-physician interaction (communication and patient-physician relationship); and (3) health care system (resources and services). Patients recognized that several barriers and facilitators fell within their own responsibility. They also underlined the crucial impact (positive or negative) on their adherence of the quality of patient-physician interaction and health care system accessibility.ConclusionsWe identified a close relationship between reported barriers and facilitators to adherence to long-term daily controller medication for asthma within three loci of responsibility. As such, patients’ adherence must be approached as a multi-level phenomenon; moreover, interventions targeting the patient, the patient-physician interaction, and the health care system are recommended. The present study offers a potential taxonomy of barriers and facilitators to adherence to long-term daily inhaled corticosteroids therapy that, once validated, may be used for planning a knowledge translation intervention and may be applicable to other chronic conditions.

Decision boxes for clinicians to support evidence-based practice and shared decision making: the user experience

BackgroundThis project engages patients and physicians in the development of Decision Boxes, short clinical topic summaries covering medical questions that have no single best answer. Decision Boxes aim to prepare the clinician to communicate the risks and benefits of the available options to the patient so they can make an informed decision together.MethodsSeven researchers (including four practicing family physicians) selected 10 clinical topics relevant to primary care practice through a Delphi survey. We then developed two one-page prototypes on two of these topics: prostate cancer screening with the prostate-specific antigen test, and prenatal screening for trisomy 21 with the serum integrated test. We presented the prototypes to purposeful samples of family physicians distributed in two focus groups, and patients distributed in four focus groups. We used the User Experience Honeycomb to explore barriers and facilitators to the communication design used in Decision Boxes. All discussions were transcribed, and three researchers proceeded to thematic content analysis of the transcriptions. The coding scheme was first developed from the Honeycomb’s seven themes (valuable, usable, credible, useful, desirable, accessible, and findable), and included new themes suggested by the data. Prototypes were modified in light of our findings.ResultsThree rounds were necessary for a majority of researchers to select 10 clinical topics. Fifteen physicians and 33 patients participated in the focus groups. Following analyses, three sections were added to the Decision Boxes: introduction, patient counseling, and references. The information was spread to two pages to try to make the Decision Boxes less busy and improve users’ first impression. To try to improve credibility, we gave more visibility to the research institutions involved in development. A statement on the boxes’ purpose and a flow chart representing the shared decision-making process were added with the intent of clarifying the tool’s purpose. Information about the risks and benefits according to risk levels was added to the Decision Boxes, to try to ease the adaptation of the information to individual patients.ConclusionResults will guide the development of the eight remaining Decision Boxes. A future study will evaluate the effect of Decision Boxes on the integration of evidence-based and shared decision making principles in clinical practice.

A reflective learning framework to evaluate CME effects on practice reflection

Introduction: The importance of reflective practice is recognized by the adoption of a reflective learning model in continuing medical education (CME), but little is known about how to evaluate reflective learning in CME. Reflective learning seldom is defined in terms of specific cognitive processes or observable performances. Competency‐based evaluation rarely is used for evaluating CME effects. To bridge this gap, reflective learning was defined operationally in a reflective learning framework (RLF). The operationalization supports observations, documentation, and evaluation of reflective learning performances in CME, and in clinical practice. In this study, the RLF was refined and validated as physician performance was evaluated in a CME e‐learning activity. Methods: Qualitative multiple‐case study wherein 473 practicing family physicians commented on research‐based synopses after reading and rating them as an on‐line CME learning activity. These comments formed 2029 cases from which cognitive tasks were extracted as defined by the RLF with the use of a thematic analysis. Frequencies of cognitive tasks were compared in a cross‐case analysis. Results: Four RLF cognitive processes and 12 tasks were supported. Reflective learning was defined as 4 interrelated cognitive processes: Interpretation, Validation, Generalization, and Change, which were specified by 3 observable cognitive tasks, respectively. These 12 tasks and related characteristics were described in an RLF codebook for future use. Discussion: Reflective learning performances of family physicians were evaluated. The RLF and its codebook can be used for integrating reflective learning into CME curricula and for developing competency‐based assessment. Future research on potential uses of the RLF should involve participation of CME stakeholders.