Christine Marquez

Characteristics of Successful and Failed Mentoring Relationships: A Qualitative Study Across Two Academic Health Centers

Purpose To explore the mentor–mentee relationship with a focus on determining the characteristics of effective mentors and mentees and understanding the factors influencing successful and failed mentoring relationships. Method The authors completed a qualitative study through the Departments of Medicine at the University of Toronto Faculty of Medicine and the University of California, San Francisco, School of Medicine between March 2010 and January 2011. They conducted individual, semistructured interviews with faculty members from different career streams and ranks and analyzed transcripts of the interviews, drawing on grounded theory. Results The authors completed interviews with 54 faculty members and identified a number of themes, including the characteristics of effective mentors and mentees, actions of effective mentors, characteristics of successful and failed mentoring relationships, and tactics for successful mentoring relationships. Successful mentoring relationships were characterized by reciprocity, mutual respect, clear expectations, personal connection, and shared values. Failed mentoring relationships were characterized by poor communication, lack of commitment, personality differences, perceived (or real) competition, conflicts of interest, and the mentor’s lack of experience. Conclusions Successful mentorship is vital to career success and satisfaction for both mentors and mentees. Yet challenges continue to inhibit faculty members from receiving effective mentorship. Given the importance of mentorship on faculty members’ careers, future studies must address the association between a failed mentoring relationship and a faculty member’s career success, how to assess different approaches to mediating failed mentoring relationships, and how to evaluate strategies for effective mentorship throughout a faculty member’s career.

Usability evaluation of a clinical decision support tool for osteoporosis disease management

BackgroundOsteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines are available, patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions and a series of focus groups were used to develop a functional multifaceted tool that can support clinical decision-making in osteoporosis disease management at the point of care. The objective of our study was to assess how well the prototype met functional goals and usability needs.MethodsWe conducted a usability study for each component of the tool--the Best Practice Recommendation Prompt (BestPROMPT), the Risk Assessment Questionnaire (RAQ), and the Customised Osteoporosis Education (COPE) sheet--using the framework described by Kushniruk and Patel. All studies consisted of one-on-one sessions with a moderator using a standardised worksheet. Sessions were audio- and video-taped and transcribed verbatim. Data analysis consisted of a combination of qualitative and quantitative analyses.ResultsIn study 1, physicians liked that the BestPROMPT can provide customised recommendations based on risk factors identified from the RAQ. Barriers included lack of time to use the tool, the need to alter clinic workflow to enable point-of-care use, and that the tool may disrupt the real reason for the visit. In study 2, patients completed the RAQ in a mean of 6 minutes, 35 seconds. Of the 42 critical incidents, 60% were navigational and most occurred when the first nine participants were using the stylus pen; no critical incidents were observed with the last six participants that used the touch screen. Patients thought that the RAQ questions were easy to read and understand, but they found it difficult to initiate the questionnaire. Suggestions for improvement included improving aspects of the interface and navigation. The results of study 3 showed that most patients were able to understand and describe sections of the COPE sheet, and all considered discussing the information with their physicians. Suggestions for improvement included simplifying the language and improving the layout.ConclusionsFindings from the three studies informed changes to the tool and confirmed the importance of usability testing on all end users to reduce errors, and as an important step in the development process of knowledge translation interventions.

Mapping barriers and intervention activities to behaviour change theory for Mobilization of Vulnerable Elders in Ontario (MOVE ON), a multi-site implementation intervention in acute care hospitals

BackgroundAs evidence-informed implementation interventions spread, they need to be tailored to address the unique needs of each setting, and this process should be well documented to facilitate replication. To facilitate the spread of the Mobilization of Vulnerable Elders in Ontario (MOVE ON) intervention, the aim of the current study is to develop a mapping guide that links identified barriers and intervention activities to behaviour change theory.MethodsFocus groups were conducted with front line health-care professionals to identify perceived barriers to implementation of an early mobilization intervention targeted to hospitalized older adults. Participating units then used or adapted intervention activities from an existing menu or developed new activities to facilitate early mobilization. A thematic analysis was performed on the focus group data, emphasizing concepts related to barriers to behaviour change. A behaviour change theory, the ‘capability, opportunity, motivation-behaviour (COM-B) system’, was used as a taxonomy to map the identified barriers to their root causes. We also mapped the behaviour constructs and intervention activities to overcome these.ResultsA total of 46 focus groups were conducted across 26 hospital inpatient units in Ontario, Canada, with 261 participants. The barriers were conceptualized at three levels: health-care provider (HCP), patient, and unit. Commonly mentioned barriers were time constraints and workload (HCP), patient clinical acuity and their perceived ‘sick role’ (patient), and lack of proper equipment and human resources (unit level). Thirty intervention activities to facilitate early mobilization of older adults were implemented across hospitals; examples of unit-developed intervention activities include the ‘mobility clock’ communication tool and the use of staff champions. A mapping guide was created with barriers and intervention activities matched though the lens of the COM-B system.ConclusionsWe used a systematic approach to develop a guide, which maps barriers, intervention activities, and behaviour change constructs in order to tailor an implementation intervention to the local context. This approach allows implementers to identify potential strategies to overcome local-level barriers and to document adaptations.

Determinants of implementation of maternal health guidelines in Kosovo: mixed methods study.

BackgroundOne of the challenges to implementing clinical practice guidelines is the need to adapt guidelines to the local context and identify barriers to their uptake. Several models of framework are available to consider for use in guideline adaptation.MethodsWe completed a multiphase study to explore the implementation of maternal health guidelines in Kosovo, focusing on determinants of uptake and methods to contextualize for local use. The study involved a survey, individual interviews, focus groups, and a consensus meeting with relevant stakeholders, including clinicians (obstetricians, midwives), managers, researchers, and policy makers from the national Ministry of Health and the World Health Organization office in Pristina, Kosovo.ResultsParticipants identified several important barriers to implementation. First, lack of communication between clinicians and ministry representatives was seen as leading to duplication of effort in creating or adapting guidelines, as well as substantial mistrust between clinicians and policy makers. Second, there was a lack of communication across clinical groups that provide obstetric care and a lack of integration across the entire healthcare system, including rural and urban centers. This fragmentation was thought to have directly resulted from the war in 1998 – 1999. Third, the conflict substantially and adversely affected the healthcare infrastructure in Kosovo, which has resulted in an inability to monitor quality of care across the country. Furthermore, the impact on infrastructure has affected the ability to access required medications consistently and to smoothly transfer patients from rural to urban centers. Another issue raised during this project was the appropriateness of including guideline recommendations perceived to be ‘aspirational’.ConclusionsImplementing clinical practice guidelines in low- and middle-income countries (LMICs) requires consideration of several specific barriers. Particularly pertinent to this study were the effects of recent conflict and the resulting fragmentation of healthcare and communication strategies among relevant stakeholders. However, as Kosovo rebuilds and invests in infrastructure after the conflict, there is a tremendous opportunity to create comprehensive, thoughtful strategies to monitor and improve quality of care. To avoid duplication of effort, it may be beneficial for LMICs to share information on assessing barriers as well as on guideline implementation strategies.

The development of an online decision support tool for organizational readiness for change

BackgroundMuch importance has been placed on assessing readiness for change as one of the earliest steps of implementation, but measuring it can be a complex and daunting task. Organizations and individuals struggle with how to reliably and accurately measure readiness for change. Several measures have been developed to help organizations assess readiness, but these are often underused due to the difficulty of selecting the right measure. In response to this challenge, we will develop and test a prototype of a decision support tool that is designed to guide individuals interested in implementation in the selection of an appropriate readiness assessment measure for their setting.MethodsA multi-phase approach will be used to develop the decision support tool. First, we will identify key measures for assessing organizational readiness for change from a recently completed systematic review. Included measures will be those developed for healthcare settings (e.g., acute care, public health, mental health) and that have been deemed valid and reliable. Second, study investigators and field experts will engage in a mapping exercise to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a stakeholder panel will be recruited and consulted to determine the feasibility and relevance of the selected measures using a modified Delphi process. Fourth, findings from the mapping exercise and stakeholder consultation will inform the development of a decision support tool that will guide users in appropriately selecting change readiness measures. Fifth, the tool will undergo usability testing.DiscussionOur proposed decision support tool will address current challenges in the field of organizational change readiness by aiding individuals in selecting a valid and reliable assessment measure that is relevant to user needs and practice settings. We anticipate that implementers and researchers who use our tool will be more likely to conduct readiness for change assessments in their settings when planning for implementation. This, in turn, may contribute to more successful implementation outcomes. We will test this tool in a future study to determine its efficacy and impact on implementation processes.

A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis

BackgroundOsteoporosis affects over 200 million people worldwide at a high cost to healthcare systems, yet gaps in management still exist. In response, we developed a multi-component osteoporosis knowledge translation (Op-KT) tool involving a patient-initiated risk assessment questionnaire (RAQ), which generates individualized best practice recommendations for physicians and customized education for patients at the point of care. The objective of this study was to evaluate the effectiveness of the Op-KT tool for appropriate disease management by physicians.MethodsThe Op-KT tool was evaluated using an interrupted time series design. This involved multiple assessments of the outcomes 12 months before (baseline) and 12 months after tool implementation (52 data points in total). Inclusion criteria were family physicians and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). Primary outcomes were the initiation of appropriate osteoporosis screening and treatment. Analyses included segmented linear regression modeling and analysis of variance.ResultsThe Op-KT tool was implemented in three family practices in Ontario, Canada representing 5 family physicians with 2840 age eligible patients (mean age 67 years; 76% women). Time series regression models showed an overall increase from baseline in the initiation of screening (3.4%; P < 0.001), any osteoporosis medications (0.5%; P = 0.006), and calcium or vitamin D (1.2%; P = 0.001). Improvements were also observed at site level for all the three sites considered, but these results varied across the sites. Of 351 patients who completed the RAQ unprompted (mean age 64 years, 77% women), the mean time for completing the RAQ was 3.43 minutes, and 56% had any disease management addressed by their physician. Study limitations included the inherent susceptibility of our design compared with a randomized trial.ConclusionsThe multicomponent Op-KT tool significantly increased osteoporosis investigations in three family practices, and highlights its potential to facilitate patient self-management. Next steps include wider implementation and evaluation of the tool in primary care.

The perceived organizational impact of the gender gap across a Canadian department of medicine and proposed strategies to combat it: a qualitative study

BackgroundDespite the gender parity existing in medical schools for over three decades, women remain underrepresented in academic medical centers, particularly in senior ranks and in leadership roles. This has consequences for patient care, education, research, and workplace culture within healthcare organizations. This study was undertaken to explore the perspectives of faculty members at a single department of medicine on the impact of the existing gender gap on organizational effectiveness and workplace culture, and to identify systems-based strategies to mitigate the gap.MethodsThe study took place at a large university department of medicine in Toronto, Canada, with six affiliated hospitals. In this qualitative study, semi-structured individual interviews were conducted between May and September 2016 with full-time faculty members who held clinical and university-based appointments. Transcripts of the interviews were analyzed using thematic analysis. Three authors independently reviewed the transcripts to determine a preliminary list of codes and establish a coding framework. A modified audit consensus coding approach was applied; a single analyst reviewed all the transcripts and a second analyst audited 20% of the transcripts in each round of coding. Following each round, inter-rater reliability was determined, discrepancies were resolved through discussion, and modifications were made as needed to the coding framework. The analysis revealed faculty members’ perceptions of the gender gap, potential contributing factors, organizational impacts, and possible solutions to bridge the gap.ResultsOf the 43 full-time faculty members who participated in the survey (29 of whom self-identified as female), most participants were aware of the existing gender gap within academic medicine. Participants described social exclusion, reinforced stereotypes, and unprofessional behaviors as consequences of the gap on organizational effectiveness and culture. They suggested improvements in (1) the processes for recruitment, hiring, and promotion; (2) inclusiveness of the work environment; (3) structures for mentorship; and (4) ongoing monitoring of the gap.ConclusionThe existing gender gap in academic medicine may have negative consequences for organizational effectiveness and workplace culture but many systems-based strategies to mitigate the gap exist. Although these solutions warrant rigorous evaluation, they are feasible to institute within most healthcare organizations immediately.

Enhancing the uptake of systematic reviews of effects: what is the best format for health care managers and policy-makers? A mixed-methods study

BackgroundSystematic reviews are infrequently used by health care managers (HCMs) and policy-makers (PMs) in decision-making. HCMs and PMs co-developed and tested novel systematic review of effects formats to increase their use.MethodsA three-phased approach was used to evaluate the determinants to uptake of systematic reviews of effects and the usability of an innovative and a traditional systematic review of effects format. In phase 1, survey and interviews were conducted with HCMs and PMs in four Canadian provinces to determine perceptions of a traditional systematic review format. In phase 2, systematic review format prototypes were created by HCMs and PMs via Conceptboard©. In phase 3, prototypes underwent usability testing by HCMs and PMs.ResultsTwo hundred two participants (80 HCMs, 122 PMs) completed the phase 1 survey. Respondents reported that inadequate format (Mdn = 4; IQR = 4; range = 1–7) and content (Mdn = 4; IQR = 3; range = 1–7) influenced their use of systematic reviews. Most respondents (76%; n = 136/180) reported they would be more likely to use systematic reviews if the format was modified. Findings from 11 interviews (5 HCMs, 6 PMs) revealed that participants preferred systematic reviews of effects that were easy to access and read and provided more information on intervention effectiveness and less information on review methodology. The mean System Usability Scale (SUS) score was 55.7 (standard deviation [SD] 17.2) for the traditional format; a SUS score < 68 is below average usability. In phase 2, 14 HCMs and 20 PMs co-created prototypes, one for HCMs and one for PMs. HCMs preferred a traditional information order (i.e., methods, study flow diagram, forest plots) whereas PMs preferred an alternative order (i.e., background and key messages on one page; methods and limitations on another). In phase 3, the prototypes underwent usability testing with 5 HCMs and 7 PMs, 11 out of 12 participants co-created the prototypes (mean SUS score 86 [SD 9.3]).ConclusionsHCMs and PMs co-created prototypes for systematic review of effects formats based on their needs. The prototypes will be compared to a traditional format in a randomized trial.

Supporting the implementation of stroke quality-based procedures (QBPs): a mixed methods evaluation to identify knowledge translation activities, knowledge translation interventions, and determinants of implementation across Ontario

BackgroundIn 2013, Health Quality Ontario introduced stroke quality-based procedures (QBPs) to promote use of evidence-based practices for patients with stroke in Ontario hospitals. The study purpose was to: (a) describe the knowledge translation (KT) interventions used to support stroke QBP implementation, (b) assess differences in the planned and reported KT interventions by region, and (c) explore determinants perceived to have affected outcomes.MethodsA mixed methods approach was used to evaluate: activities, KT interventions, and determinants of stroke QBP implementation. In Phase 1, a document review of regional stroke network work plans was conducted to capture the types of KT activities planned at a regional level; these were mapped to the knowledge to action framework. In Phase 2, we surveyed Ontario hospital staff to identify the KT interventions used to support QBP implementation at an organizational level. Phase 3 involved qualitative interviews with staff to elucidate deeper understanding of survey findings.ResultsOf the 446 activities identified in the document review, the most common were ‘dissemination’ (24.2%; n = 108), ‘implementation’ (22.6%; n = 101), ‘implementation planning’ (15.0%; n = 67), and ‘knowledge tools’ (10.5%; n = 47). Based on survey data (n = 489), commonly reported KT interventions included: staff educational meetings (43.1%; n = 154), champions (41.5%; n = 148), and staff educational materials (40.6%; n = 145). Survey participants perceived stroke QBP implementation to be successful (median = 5/7; interquartile range = 4–6; range = 1–7; n = 335). Forty-four people (e.g., managers, senior leaders, regional stroke network representatives, and frontline staff) participated in interviews/focus groups. Perceived facilitators to QBP implementation included networks and collaborations with external organizations, leadership engagement, and hospital prioritization of stroke QBP. Perceived barriers included lack of funding, size of the hospital (i.e., too small), lack of resources (i.e., staff and time), and simultaneous implementation of other QBPs.ConclusionsInformation on the types of activities and KT interventions used to support stroke QBP implementation and the key determinants influencing uptake of stroke QBPs can be used to inform future activities including the development and evaluation of interventions to address barriers and leverage facilitators.