Craig W. Johnson

Interruptions in a Level One Trauma Center: A Case Study

BACKGROUND The emergency department has been characterized as interrupt-driven. Government agencies and patient safety organizations recognize that interruptions contribute to medical errors. The purpose of this study was to observe, record, and contextualize activities and interruptions experienced by physicians and Registered Nurses (RNs) working in a Level One Trauma Center. METHODS DESIGN A case study that relied on an ethnographic study design using the shadowing method. SUBJECTS A convenience sample of physicians and RNs, each with at least 6 months of experience in the Emergency Department (ED), were asked to participate. In these kinds of detailed qualitative investigations, it is quite common to have a small sample size. Ethical approval: Approval was obtained from institutional ethic committees prior to initiating the study. Community consent was obtained from the ED staff through in-service education. SETTING All observations were made in the trauma section of the ED of a tertiary teaching hospital. The hospital is situated in a major medical center in the Gulf Coast region of the United States of America (USA). FINDINGS Five attending ED physicians were observed for a total of 29h, 31min. Eight RNs were shadowed for a total of 40 h, 9min. Interruptions and activities were categorized using the Hybrid Method to Categorize Interruptions and Activities (HyMCIA). Registered Nurses received slightly more interruptions per hour than physicians. People, pagers, and telephones were identified as mediums through which interruptions were delivered. The physical environment was found to contribute to interruptions in workflow because of physical design and when supplies were not available. Physicians and RNs usually returned to the original, interrupted activity more often than leaving the activity unfinished. CONCLUSION This research provides an enhanced understanding of interruptions in workflow in the ED, the identification of work constraints, and the need to develop interventions to manage interruptions. It is crucial that interruptions be delivered in such a way that there is minimal negative impact on performance. The significance and importance of the interruption must always be weighed against the negative impact that it has on smooth, efficient workflow.

A concept analysis of the phenomenon interruption.

An interruption was found to have no consistent definition in either healthcare or nonhealthcare literature. Walker and Avants 8-step method of concept analysis was used to clarify, define, and develop a conceptual model of interruption. The analysis led to the identification of 5 defining attributes that include (1) a human experience; (2) an intrusion of a secondary, unplanned, and unexpected task; (3) discontinuity; (4) externally or internally initiated; and (5) situated within a context. Use of the defining attributes will be extended to form a category of interruption within a taxonomy of activity.

Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer

Consumers increasingly consult the Internet for breast cancer information. Concerned about accuracy, multiple organizations developed quality criteria for online content. However, the effectiveness of these tools is unknown. The authors determined whether existing quality criteria can identify inaccurate breast cancer information online.

Towards a hybrid method to categorize interruptions and activities in healthcare

OBJECTIVE Interruptions are known to have a negative impact on activity performance. Understanding how an interruption contributes to human error is limited because there is not a standard method for analyzing and classifying interruptions. Qualitative data are typically analyzed by either a deductive or an inductive method. Both methods have limitations. In this paper, a hybrid method was developed that integrates deductive and inductive methods for the categorization of activities and interruptions recorded during an ethnographic study of physicians and registered nurses in a Level One Trauma Center. Understanding the effects of interruptions is important for designing and evaluating informatics tools in particular as well as improving healthcare quality and patient safety in general. METHOD The hybrid method was developed using a deductive a priori classification framework with the provision of adding new categories discovered inductively in the data. The inductive process utilized line-by-line coding and constant comparison as stated in Grounded Theory. RESULTS The categories of activities and interruptions were organized into a three-tiered hierarchy of activity. Validity and reliability of the categories were tested by categorizing a medical error case external to the study. No new categories of interruptions were identified during analysis of the medical error case. CONCLUSIONS Findings from this study provide evidence that the hybrid model of categorization is more complete than either a deductive or an inductive method alone. The hybrid method developed in this study provides the methodical support for understanding, analyzing, and managing interruptions and workflow.

Usability of quality measures for online health information: Can commonly used technical quality criteria be reliably assessed?

PURPOSE Many criteria have been developed to rate the quality of online health information. To effectively evaluate quality, consumers must use quality criteria that can be reliably assessed. However, few instruments have been validated for inter-rater agreement. Therefore, we assessed the degree to which two raters could reliably assess 22 popularly cited quality criteria on a sample of 42 complementary and alternative medicine Web sites. METHODS We determined the degree of inter-rater agreement by calculating the percentage agreement, Cohens kappa, and prevalence- and bias-adjusted kappa (PABAK). RESULTS Our un-calibrated analysis showed poor inter-rater agreement on eight of the 22 quality criteria. Therefore, we created operational definitions for each of the criteria, decreased the number of assessment choices and defined where to look for the information. As a result 18 of the 22 quality criteria were reliably assessed (inter-rater agreement > or = 0.6). CONCLUSIONS We conclude that even with precise definitions, some commonly used quality criteria cannot be reliably assessed. However, inter-rater agreement can be improved with precise operational definitions.

Evaluation of a problem-specific SBAR tool to improve after-hours nurse-physician phone communication: a randomized trial.

BACKGROUND After-hours telephone communications are common in patient management. Patterns of communication of key information during after-hours phone calls were evaluated, and the utility of problem-specific Situation, Background, Assessment, Recommendation (SBAR) forms in improving this communication was assessed. METHODS In a randomized trial using a simulated on-call setting, 20 nurses called physicians regarding six cases adapted from inpatient records and based on the six most common reasons for after-hours nurse-physician communication. Three of the cases were handled without the SBAR forms (control cases), and three cases were handled with the forms (SBAR cases). Two cue types of communication were evaluated: situation cues, which conveyed the patients situation (for example, a patient is confused), and background cues, which conveyed problem-specific data indicated on the SBAR forms (for example, the patient has a low sodium level). RESULTS Ninety-two phone calls were analyzed (43 SBAR/49 controls). Most of the nurses reported the situation cues (SBAR 88%, control 84%, p = .60) but not the background cues. There was a trend toward fewer background cues communicated in the SBAR cases (14% versus 31%, p = .08). In 14% of the cases, on average, nurses omitted information or reported wrong information regarding the background cue. Physicians asked questions that resulted in the communication of the cues in a minority of the cases when the background cues were not originally provided by the nurses (SBAR 6%, control 16%, p = .39). CONCLUSIONS In after-hours phone communication between physicians and nurses, significant information was often not communicated and physicians did not elicit the necessary information. Simply providing an SBAR-based form did not ensure complete communication of key information.

Personal background preparation survey for early identification of nursing students at risk for attrition

During 2004 and 2005 orientations, all 187 and 188 new matriculates, respectively, in two southwestern U.S. nursing schools completed Personal Background and Preparation Surveys (PBPS) in the first predictive validity study of a diagnostic and prescriptive instrument for averting adverse academic status events (AASE) among nursing or health science professional students. One standard deviation increases in PBPS risks (p < 0.05) multiplied odds of first-year or second-year AASE by approximately 150%, controlling for school affiliation and underrepresented minority student (URMS) status. AASE odds one standard deviation above mean were 216% to 250% those one standard deviation below mean. Odds of first-year or second-year AASE for URMS one standard deviation above the 2004 PBPS mean were 587% those for non-URMS one standard deviation below mean. The PBPS consistently and significantly facilitated early identification of nursing students at risk for AASE, enabling proactive targeting of interventions for risk amelioration and AASE or attrition prevention.

Does Telephone Follow-up Predict Patient Satisfaction and Readmission?

Nursing telephone calls after hospital discharge are commonly adopted as a tool to improve patient satisfaction and continuity of care. Previous research, however, has been inconclusive on the impact of telephone follow-up. The purpose of this study was to comparatively examine patients who received telephone follow-up for response differences on a mail satisfaction survey and 30-day readmission rates for a large health system in southeast Texas. Telephone follow-up, patient satisfaction, and administrative billing data from 2008 to 2009 were retrospectively examined across 10 nursing units that routinely performed calls after patient discharge. Patients eligible to receive a nursing call (N = 10,559) were categorized based on responses to nursing questions or if no contact was made. Logistic regression was used to evaluate whether call data significantly predicted survey response and 30-day readmission rates. Nonparametric analysis was used to evaluate whether survey ratings varied between groups. Completion of telephone follow-up was a significant (P <  0.01) predictor of patient response to the mail survey, with 62% more patients returning surveys after contact. Completion of a nursing call with a patient who reported a physician appointment was a significant predictor (P  =  0.04) of lower 30-day readmissions. Readmission rates were 10.8% for patients who did not receive telephone follow-up compared to 9.5% for patients who received a call and who had a scheduled physician appointment. Mean nursing and overall satisfaction scores varied minimally between groups and telephone follow-up was not a significant predictor of patient satisfaction. Telephone follow-up shows significant predictive value for mail survey response and 30-day readmission rates but does not correlate with patient satisfaction scores in the hospital setting.

Keywords and vocabulary acquisition: Some words of caution about words of assistance

Consistent results of two experiments with relatively technical, native language vocabulary, showed that effectiveness of keyword methods depended upon whether meanings of words to be learned were abstract or concrete and whether comprehension was assessed immediately or after a delay. Keywords bearing acoustical similarities to vocabulary items whose meanings were presented as sentences consistently facilitated students’ retention of the meanings of concrete items on immediate posttests. However, in contrast to recent research on foreign language vocabulary having simpler definitions, these experiments showed that it may be difficult to use the keyword method to aid long-term retention with moderately complex. abstract, native language vocabulary.

Searching for cancer-related information online: Unintended retrieval of complementary and alternative medicine information

PURPOSE The Web is an important source of health information for consumers. Use of complementary and alternative medicine (CAM) is also increasing. Therefore, we studied the likelihood that consumers will incidentally encounter CAM information while searching the Web and the factors that influence retrieval of CAM information. METHODS We evaluated results retrieved by 10 cancer-related searches on six common search engines. RESULTS Of 1121 search results, 16.2% displayed CAM information. Sponsored (i.e., paid) results were more likely to display CAM information than non-sponsored results (38% versus 7.5%, p < 0.001). In Overture and Google, sponsored results accounted for 51% and 39% of results on the first page. These search engines also retrieved more CAM web pages. Search engines distinguished sponsored and non-sponsored results, but disclosure statements describing the differences were confusing. Cancer type used as the search keyword did not influence the number of CAM web pages retrieved. However, synonyms of cancer differed in their retrieval of CAM web pages (p < 0.001). Consistent with prior studies of Web search engine overlap, we found that 28% of CAM results were retrieved by two or more search engines. CONCLUSIONS Clinicians should help consumers recognize sponsored results and encourage search engines to clearly explain sponsored results.