Timothy C. Guetterman

Integrating Quantitative and Qualitative Results in Health Science Mixed Methods Research Through Joint Displays

PURPOSE Mixed methods research is becoming an important methodology to investigate complex health-related topics, yet the meaningful integration of qualitative and quantitative data remains elusive and needs further development. A promising innovation to facilitate integration is the use of visual joint displays that bring data together visually to draw out new insights. The purpose of this study was to identify exemplar joint displays by analyzing the various types of joint displays being used in published articles. METHODS We searched for empirical articles that included joint displays in 3 journals that publish state-of-the-art mixed methods research. We analyzed each of 19 identified joint displays to extract the type of display, mixed methods design, purpose, rationale, qualitative and quantitative data sources, integration approaches, and analytic strategies. Our analysis focused on what each display communicated and its representation of mixed methods analysis. RESULTS The most prevalent types of joint displays were statistics-by-themes and side-by-side comparisons. Innovative joint displays connected findings to theoretical frameworks or recommendations. Researchers used joint displays for convergent, explanatory sequential, exploratory sequential, and intervention designs. We identified exemplars for each of these designs by analyzing the inferences gained through using the joint display. Exemplars represented mixed methods integration, presented integrated results, and yielded new insights. CONCLUSIONS Joint displays appear to provide a structure to discuss the integrated analysis and assist both researchers and readers in understanding how mixed methods provides new insights. We encourage researchers to use joint displays to integrate and represent mixed methods analysis and discuss their value.

Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial.

OBJECTIVES To assess advanced communication skills among second-year medical students exposed either to a computer simulation (MPathic-VR) featuring virtual humans, or to a multimedia computer-based learning module, and to understand each groups experiences and learning preferences. METHODS A single-blinded, mixed methods, randomized, multisite trial compared MPathic-VR (N=210) to computer-based learning (N=211). Primary outcomes: communication scores during repeat interactions with MPathic-VRs intercultural and interprofessional communication scenarios and scores on a subsequent advanced communication skills objective structured clinical examination (OSCE). Multivariate analysis of variance was used to compare outcomes. SECONDARY OUTCOMES student attitude surveys and qualitative assessments of their experiences with MPathic-VR or computer-based learning. RESULTS MPathic-VR-trained students improved their intercultural and interprofessional communication performance between their first and second interactions with each scenario. They also achieved significantly higher composite scores on the OSCE than computer-based learning-trained students. Attitudes and experiences were more positive among students trained with MPathic-VR, who valued its providing immediate feedback, teaching nonverbal communication skills, and preparing them for emotion-charged patient encounters. CONCLUSIONS MPathic-VR was effective in training advanced communication skills and in enabling knowledge transfer into a more realistic clinical situation. PRACTICE IMPLICATIONS MPathic-VRs virtual human simulation offers an effective and engaging means of advanced communication training.

The diverse vocational experiences of five individuals returning to work after severe brain injury: A qualitative inquiry.

Abstract Objective: The researchers explored the return-to-work experiences of five adults with severe traumatic brain injuries (TBIs) and those associated with them by performing a qualitative, multiple case study investigation involving in-depth, semi-structured interviews. Selection of this qualitative methodology allowed for personal, individualized accounts of adults with TBI returning to work. Specifically, this methodology promoted accurate representation of the idiosyncratic nature of each participant’s experiences. Methods: The researchers asked individuals to participate based on the diversity of their vocational experiences following TBI. Results: Four of the five participants had returned to their pre-injury jobs. Two were subsequently fired and, at the time of research participation, were unemployed. One participant never returned to paid employment; however, he had held two volunteer positions for several years post-injury. Salient content from interview transcripts allowed for the identification of five to eight themes pertinent to each case. Conclusions: Interpretation of the themes led to three main conjectures about return-to-work experiences following TBI: (a) job satisfaction may relate more to involvement in productive activities than monetary compensation; (b) adults with TBI can be successful in holding and maintaining positions with high cognitive demands; and (c) individualized job modifications and strategies are likely necessary for adults with TBI to succeed vocationally.

Reflections on the Adaptive Designs Accelerating Promising Trials Into Treatments (ADAPT-IT) Process-Findings from a Qualitative Study.

Abstract The context for this study was the Adaptive Designs Advancing Promising Treatments Into Trials (ADAPT-IT) project, which aimed to incorporate flexible adaptive designs into pivotal clinical trials and to conduct an assessment of the trial development process. Little research provides guidance to academic institutions in planning adaptive trials. The purpose of this qualitative study was to explore the perspectives and experiences of stakeholders as they reflected back about the interactive ADAPT-IT adaptive design development process, and to understand their perspectives regarding lessons learned about the design of the trials and trial development. The authors conducted semi-structured interviews with 10 key stakeholders, and observations of the process. They employed qualitative thematic text data analysis to reduce the data into themes about the ADAPT-IT project and adaptive clinical trials. The qualitative analysis revealed four themes: education of the project participants, how the process evolved with participant feedback, procedures that could enhance the development of other trials, and education of the broader research community. While participants became more likely to consider flexible adaptive designs, additional education is needed to both understand the adaptive methodology and articulate it when planning trials.

How Do Resuscitation Teams at Top-Performing Hospitals for In-Hospital Cardiac Arrest Succeed?: A Qualitative Study

Background: In-hospital cardiac arrest (IHCA) is common, and outcomes vary substantially across US hospitals, but reasons for these differences are largely unknown. We set out to better understand how top-performing hospitals organize their resuscitation teams to achieve high survival rates for IHCA. Methods: We calculated risk-standardized IHCA survival to discharge rates across American Heart Association Get With The Guidelines–Resuscitation registry hospitals between 2012 and 2014. We identified geographically and academically diverse hospitals in the top, middle, and bottom quartiles of survival for IHCA and performed a qualitative study that included site visits with in-depth interviews of clinical and administrative staff at 9 hospitals. With the use of thematic analysis, data were analyzed to identify salient themes of perceived performance by informants. Results: Across 9 hospitals, we interviewed 158 individuals from multiple disciplines including physicians (17.1%), nurses (45.6%), other clinical staff (17.1%), and administration (20.3%). We identified 4 broad themes related to resuscitation teams: (1) team design, (2) team composition and roles, (3) communication and leadership during IHCA, and (4) training and education. Resuscitation teams at top-performing hospitals demonstrated the following features: dedicated or designated resuscitation teams; participation of diverse disciplines as team members during IHCA; clear roles and responsibilities of team members; better communication and leadership during IHCA; and in-depth mock codes. Conclusions: Resuscitation teams at hospitals with high IHCA survival differ from non–top-performing hospitals. Our findings suggest core elements of successful resuscitation teams that are associated with better outcomes and form the basis for future work to improve IHCA.

What Matters Most? A Mixed Methods Study of Critical Aspects of a Home-Based Palliative Program

Background: Home-based palliative care programs have shown value in improving quality of care and lowering costs for seriously ill patients. It is unknown what specific elements of these programs matter most to patients and caregivers. Aim: To identify what services are critical and why they matter to patients in a home-based palliative program. Setting/Participants: A mixed methods study of 18 participants in the At Home Support (AHS) program in Southeast Michigan. Measurements: Two semistructured interviews were conducted for each participant, one while enrolled in AHS and another 3 months after the program ended to elicit the impact of AHS on their care. Qualitative theme data were merged with quantitative data on demographics, social and financial resources, symptoms, medical conditions, functional status, and utilization of health care while in AHS. Results: Four major themes of critical services reported by distinct populations of participants were described—medical support, endorsed by nearly every participant; emotional and spiritual support, endorsed by those with serious illness and symptom burden; practical assistance, endorsed by those with functional disability and isolation; and social services, endorsed by those in poverty. Medical monitoring was also described as critical but only by healthier participants. Conclusion: This study presents a conceptual model of the critical services in home-based palliative care and why these services are important to high-risk patients. This model may be used to guide further research and evaluation work on the benefits of home-based palliative care.

Two Methodological Approaches to the Integration of Mixed Methods and Case Study Designs: A Systematic Review:

Case study has a tradition of collecting multiple forms of data—qualitative and quantitative—to gain a more complete understanding of the case. Case study integrates well with mixed methods, which seeks a more complete understanding through the integration of qualitative and quantitative research. We identify and characterize “mixed methods–case study designs” as mixed methods studies with a nested case study and “case study–mixed methods designs” as case studies with nested mixed methods. Based on a review of published research integrating mixed methods and case study designs, we describe key methodological features and discuss four exemplar interdisciplinary studies.

Contemporary Approaches to Mixed Methods–Grounded Theory Research: A Field-Based Analysis:

Key scholars have lauded benefits of integrating mixed methods and grounded theory—or mixed methods–grounded theory (MM-GT)—yet there have been few attempts to ascertain in what ways researchers use MM-GT. Our aim was to systematically, but not exhaustively, examine applications of MM-GT and offer procedural guidelines. We identified 61 empirical MM-GT articles and developed a codebook for analysis. MM-GT was widely used across disciplines. Most published MM-GT provided little methodological detail regarding grounded theory, mixed methods, and their integration; theoretical development was noticeably absent; and the majority followed a convergent mixed methods design. This inquiry contributes to emerging discussions regarding the ways in which MM-GT can or should be used to more fully realize the potential of this approach.

Development of a self-rated mixed methods skills assessment: The national institutes of health mixed methods research training program for the health sciences

Introduction: Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a self-rated mixed methods skills assessment and provide validity evidence. The instrument taps six research domains: “Research question,” “Design/approach,” “Sampling,” “Data collection,” “Analysis,” and “Dissemination.” Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. Methods: We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using the Cronbach alpha to assess reliability and an analysis of variance that compared a mixed methods experience index with assessment scores to assess criterion relatedness. Results: Internal consistency reliability was high for the total set of items (0.95) and adequate (≥0.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (eg, published a mixed methods article) rated themselves as more skilled, which was statistically significant across the research domains. Discussion: This self-rated mixed methods assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning.

Initial Results of the Early Auditory Referral-Primary Care (EAR-PC) Study

INTRODUCTION Hearing loss (HL) is the second most common disability in the U.S., yet is clinically underdiagnosed. To manage its common adverse psychosocial and cognitive outcomes, early identification of HL must be improved. METHODS A feasibility study conducted to increase screening for HL and referral of patients aged ≥55 years arriving at two family medicine clinics. Eligible patients were asked to complete a self-administered consent form and the Hearing Handicap Inventory (HHI). Independently, clinicians received a brief educational program after which an electronic clinical prompt (intervention) alerted them (blinded to HHI results) to screen for HL during applicable patient visits. Pre- and post-intervention differences were analyzed to assess the proportion of patients referred to audiology and those diagnosed with HL (primary outcomes) and the audiology referral appropriateness (secondary outcome). Referral rates for those who screened positive for HL on the HHI were compared with those who scored negatively. RESULTS There were 5,520 eligible patients during the study period, of which 1,236 (22.4%) consented. After the interventions implementation, audiology referral rates increased from 1.2% to 7.1% (p<0.001). Overall, 293 consented patients (24%) completed the HHI and scored >10, indicating probable HL. Of these 293 patients, 28.0% were referred to audiology versus only 7.4% with scores <10 (p<0.001). Forty-two of the 54 referred patients seen by audiology were diagnosed with HL (78%). Overall, the diagnosis of HL on problem lists increased from 90 of 4,815 patients (1.9%) at baseline to 163 of 5,520 patients (3.0%, p<0.001) over only 8 months. CONCLUSIONS The electronic clinical prompt significantly increased audiology referrals for at-risk patients for HL in two family medicine clinics. Larger-scale studies are needed to address the U.S. Preventive Services Task Force call to assess the long-term impact of HL screening in community populations.