Eric Tham

Informing the design of clinical decision support services for evaluation of children with minor blunt head trauma in the emergency department

Integration of clinical decision support services (CDSS) into electronic health records (EHRs) may be integral to widespread dissemination and use of clinical prediction rules in the emergency department (ED). However, the best way to design such services to maximize their usefulness in such a complex setting is poorly understood. We conducted a multi-site cross-sectional qualitative study whose aim was to describe the sociotechnical environment in the ED to inform the design of a CDSS intervention to implement the Pediatric Emergency Care Applied Research Network (PECARN) clinical prediction rules for children with minor blunt head trauma. Informed by a sociotechnical model consisting of eight dimensions, we conducted focus groups, individual interviews and workflow observations in 11 EDs, of which 5 were located in academic medical centers and 6 were in community hospitals. A total of 126 ED clinicians, information technology specialists, and administrators participated. We clustered data into 19 categories of sociotechnical factors through a process of thematic analysis and subsequently organized the categories into a sociotechnical matrix consisting of three high-level sociotechnical dimensions (workflow and communication, organizational factors, human factors) and three themes (interdisciplinary assessment processes, clinical practices related to prediction rules, EHR as a decision support tool). Design challenges that emerged from the analysis included the need to use structured data fields to support data capture and re-use while maintaining efficient care processes, supporting interdisciplinary communication, and facilitating family-clinician interaction for decision-making.

Standards for health information technology to ensure adolescent privacy

Privacy and security of health information is a basic expectation of patients. Despite the existence of federal and state laws safeguarding the privacy of health information, health information systems currently lack the capability to allow for protection of this information for minors. This policy statement reviews the challenges to privacy for adolescents posed by commercial health information technology systems and recommends basic principles for ideal electronic health record systems. This policy statement has been endorsed by the Society for Adolescent Health and Medicine.

Sustaining and Spreading the Reduction of Adverse Drug Events in a Multicenter Collaborative

OBJECTIVES: Adverse drug events (ADEs) occur more frequently in pediatric patients than adults. ADEs frequently cause serious harm to children and increase the cost of care. The purpose of this study was to decrease ADEs by targeting the entire medication-delivery system for all high-risk medications. METHODS: Thirteen freestanding childrens hospitals participated in this ADE collaborative. An advisory panel developed a change package of interventions that consisted of standardization of medication-ordering (eg, consensus-based protocols and order sets and high-alert medication protocols), reliable medication-dispensing processes (eg, automated dispensing cabinets and redesign of floor stock procedures), reliable medication-administration processes (eg, safe pump use and reducing interruptions), improvement of patient safety culture (eg, safety-culture changes and reduction of staff intimidation), and clinical decision support (eg, increase ADE detection and redesign care systems). ADE rates were compared from the 3-month baseline period to quarters of the 12-month intervention phase. ADE rates were categorized further as opioid related and other medication related. RESULTS: From baseline to the final quarter, the collaborative resulted in a 42% decrease in total ADEs, a 51% decrease in opioid-related ADEs, and a 41% decrease in other medication ADEs. CONCLUSION: A pediatric collaborative that targeted the medication-delivery system decreased the rate of ADEs at participating institutions.

A Trigger Tool to Detect Harm in Pediatric Inpatient Settings

OBJECTIVES: An efficient and reliable process for measuring harm due to medical care is needed to advance pediatric patient safety. Several pediatric studies have assessed the use of trigger tools in varying inpatient environments. Using the Institute for Healthcare Improvement’s adult-focused Global Trigger Tool as a model, we developed and pilot tested a trigger tool that would identify the most common causes of harm in pediatric inpatient environments. METHODS: After formal training, 6 academic children’s hospitals used this novel pediatric trigger tool to review 100 randomly selected inpatient records per site from patients discharged during the month of February 2012. RESULTS: From the 600 patient charts evaluated, 240 harmful events (“harms”) were identified, resulting in a rate of 40 harms per 100 patients admitted and 54.9 harms per 1000 patient days across the 6 hospitals. At least 1 harm was identified in 146 patients (24.3% of patients). Of the 240 total events, 108 (45.0%) were assessed to have been potentially or definitely preventable. The most common patient harms were intravenous catheter infiltrations/burns, respiratory distress, constipation, pain, and surgical complications. CONCLUSIONS: Consistent with earlier rates of all-cause harm in adult hospitals, harm occurs at high rates in hospitalized children. Availability and use of an all-cause harm identification tool will establish the epidemiology of harm and will provide a consistent approach to assessing the effect of interventions on harms in hospitalized children.

Development of an Electronic Pediatric All-Cause Harm Measurement Tool Using a Modified Delphi Method.

Objectives To have impact on reducing harm in pediatric inpatients, an efficient and reliable process for harm detection is needed. This work describes the first step toward the development of a pediatric all-cause harm measurement tool by recognized experts in the field. Methods An international group of leaders in pediatric patient safety and informatics were charged with developing a comprehensive pediatric inpatient all-cause harm measurement tool using a modified Delphi technique. The process was conducted in 5 distinct steps: (1) literature review of triggers (elements from a medical record that assist in identifying patient harm) for inclusion; (2) translation of triggers to likely associated harm, improving the ability for expert prioritization; (3) 2 applications of a modified Delphi selection approach with consensus criteria using severity and frequency of harm as well as detectability of the associated trigger as criteria to rate each trigger and associated harm; (4) developing specific trigger logic and relevant values when applicable; and (5) final vetting of the entire trigger list for pilot testing. Results Literature and expert panel review identified 108 triggers and associated harms suitable for consideration (steps 1 and 2). This list was pared to 64 triggers and their associated harms after the first of the 2 independent expert reviews. The second independent expert review led to further refinement of the trigger package, resulting in 46 items for inclusion (step 3). Adding in specific trigger logic expanded the list. Final review and voting resulted in a list of 51 triggers (steps 4 and 5). Conclusions Application of a modified Delphi method on an expert-constructed list of 108 triggers, focusing on severity and frequency of harms as well as detectability of triggers in an electronic medical record, resulted in a final list of 51 pediatric triggers. Pilot testing this list of pediatric triggers to identify all-cause harm for pediatric inpatients is the next step to establish the appropriateness of each trigger for inclusion in a global pediatric safety measurement tool.

Electronic prescribing in pediatrics

This policy statement identifies the potential value of electronic prescribing (e-prescribing) systems in improving quality and reducing harm in pediatric health care. On the basis of limited but positive pediatric data and on the basis of federal statutes that provide incentives for the use of e-prescribing systems, the American Academy of Pediatrics recommends the adoption of e-prescribing systems with pediatric functionality. The American Academy of Pediatrics also recommends a set of functions that technology vendors should provide when e-prescribing systems are used in environments in which children receive care.

Use of Traumatic Brain Injury Prediction Rules With Clinical Decision Support

The investigators provide data from a multicenter trial regarding whether implementation of prediction rules safely decreases computed tomography use in children with minor head trauma. OBJECTIVES: We determined whether implementing the Pediatric Emergency Care Applied Research Network (PECARN) traumatic brain injury (TBI) prediction rules and providing risks of clinically important TBIs (ciTBIs) with computerized clinical decision support (CDS) reduces computed tomography (CT) use for children with minor head trauma. METHODS: Nonrandomized trial with concurrent controls at 5 pediatric emergency departments (PEDs) and 8 general EDs (GEDs) between November 2011 and June 2014. Patients were <18 years old with minor blunt head trauma. Intervention sites received CDS with CT recommendations and risks of ciTBI, both for patients at very low risk of ciTBI (no Pediatric Emergency Care Applied Research Network rule factors) and those not at very low risk. The primary outcome was the rate of CT, analyzed by site, controlling for time trend. RESULTS: We analyzed 16 635 intervention and 2394 control patients. Adjusted for time trends, CT rates decreased significantly (P < .05) but modestly (2.3%–3.7%) at 2 of 4 intervention PEDs for children at very low risk. The other 2 PEDs had small (0.8%–1.5%) nonsignificant decreases. CT rates did not decrease consistently at the intervention GEDs, with low baseline CT rates (2.1%–4.0%) in those at very low risk. The control PED had little change in CT use in similar children (from 1.6% to 2.9%); the control GED showed a decrease in the CT rate (from 7.1% to 2.6%). For all children with minor head trauma, intervention sites had small decreases in CT rates (1.7%–6.2%). CONCLUSIONS: The implementation of TBI prediction rules and provision of risks of ciTBIs by using CDS was associated with modest, safe, but variable decreases in CT use. However, some secular trends were also noted.

Use of a remote clinical decision support service for a multicenter trial to implement prediction rules for children with minor blunt head trauma

OBJECTIVE To evaluate the architecture, integration requirements, and execution characteristics of a remote clinical decision support (CDS) service used in a multicenter clinical trial. The trial tested the efficacy of implementing brain injury prediction rules for children with minor blunt head trauma. MATERIALS AND METHODS We integrated the Epic(®) electronic health record (EHR) with the Enterprise Clinical Rules Service (ECRS), a web-based CDS service, at two emergency departments. Patterns of CDS review included either a delayed, near-real-time review, where the physician viewed CDS recommendations generated by the nursing assessment, or a real-time review, where the physician viewed recommendations generated by their own documentation. A backstopping, vendor-based CDS triggered with zero delay when no recommendation was available in the EHR from the web-service. We assessed the execution characteristics of the integrated system and the source of the generated recommendations viewed by physicians. RESULTS The ECRS mean execution time was 0.74 ±0.72 s. Overall execution time was substantially different at the two sites, with mean total transaction times of 19.67 and 3.99 s. Of 1930 analyzed transactions from the two sites, 60% (310/521) of all physician documentation-initiated recommendations and 99% (1390/1409) of all nurse documentation-initiated recommendations originated from the remote web service. DISCUSSION The remote CDS system was the source of recommendations in more than half of the real-time cases and virtually all the near-real-time cases. Comparisons are limited by allowable variation in user workflow and resolution of the EHR clock. CONCLUSION With maturation and adoption of standards for CDS services, remote CDS shows promise to decrease time-to-trial for multicenter evaluations of candidate decision support interventions.

Development, Evaluation and Implementation of Chief Complaint Groupings to Activate Data Collection: A Multi-Center Study of Clinical Decision Support for Children with Head Trauma

BACKGROUND Overuse of cranial computed tomography scans in children with blunt head trauma unnecessarily exposes them to radiation. The Pediatric Emergency Care Applied Research Network (PECARN) blunt head trauma prediction rules identify children who do not require a computed tomography scan. Electronic health record (EHR) based clinical decision support (CDS) may effectively implement these rules but must only be provided for appropriate patients in order to minimize excessive alerts. OBJECTIVES To develop, implement and evaluate site-specific groupings of chief complaints (CC) that accurately identify children with head trauma, in order to activate data collection in an EHR. METHODS As part of a 13 site clinical trial comparing cranial computed tomography use before and after implementation of CDS, four PECARN sites centrally developed and locally implemented CC groupings to trigger a clinical trial alert (CTA) to facilitate the completion of an emergency department head trauma data collection template. We tested and chose CC groupings to attain high sensitivity while maintaining at least moderate specificity. RESULTS Due to variability in CCs available, identical groupings across sites were not possible. We noted substantial variability in the sensitivity and specificity of seemingly similar CC groupings between sites. The implemented CC groupings had sensitivities greater than 90% with specificities between 75-89%. During the trial, formal testing and provider feedback led to tailoring of the CC groupings at some sites. CONCLUSIONS CC groupings can be successfully developed and implemented across multiple sites to accurately identify patients who should have a CTA triggered to facilitate EHR data collection. However, CC groupings will necessarily vary in order to attain high sensitivity and moderate-to-high specificity. In future trials, the balance between sensitivity and specificity should be considered based on the nature of the clinical condition, including prevalence and morbidity, in addition to the goals of the intervention being considered.

Assessing the similarity of surface linguistic features related to epilepsy across pediatric hospitals

Objective The constant progress in computational linguistic methods provides amazing opportunities for discovering information in clinical text and enables the clinical scientist to explore novel approaches to care. However, these new approaches need evaluation. We describe an automated system to compare descriptions of epilepsy patients at three different organizations: Cincinnati Children’s Hospital, the Children’s Hospital Colorado, and the Children’s Hospital of Philadelphia. To our knowledge, there have been no similar previous studies. Materials and methods In this work, a support vector machine (SVM)-based natural language processing (NLP) algorithm is trained to classify epilepsy progress notes as belonging to a patient with a specific type of epilepsy from a particular hospital. The same SVM is then used to classify notes from another hospital. Our null hypothesis is that an NLP algorithm cannot be trained using epilepsy-specific notes from one hospital and subsequently used to classify notes from another hospital better than a random baseline classifier. The hypothesis is tested using epilepsy progress notes from the three hospitals. Results We are able to reject the null hypothesis at the 95% level. It is also found that classification was improved by including notes from a second hospital in the SVM training sample. Discussion and conclusion With a reasonably uniform epilepsy vocabulary and an NLP-based algorithm able to use this uniformity to classify epilepsy progress notes across different hospitals, we can pursue automated comparisons of patient conditions, treatments, and diagnoses across different healthcare settings.