Katherine Woolf

Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysis

Objective To determine whether the ethnicity of UK trained doctors and medical students is related to their academic performance. Design Systematic review and meta-analysis. Data sources Online databases PubMed, Scopus, and ERIC; Google and Google Scholar; personal knowledge; backwards and forwards citations; specific searches of medical education journals and medical education conference abstracts. Study selection The included quantitative reports measured the performance of medical students or UK trained doctors from different ethnic groups in undergraduate or postgraduate assessments. Exclusions were non-UK assessments, only non-UK trained candidates, only self reported assessment data, only dropouts or another non-academic variable, obvious sampling bias, or insufficient details of ethnicity or outcomes. Results 23 reports comparing the academic performance of medical students and doctors from different ethnic groups were included. Meta-analyses of effects from 22 reports (n=23 742) indicated candidates of “non-white” ethnicity underperformed compared with white candidates (Cohen’s d=−0.42, 95% confidence interval −0.50 to −0.34; P<0.001). Effects in the same direction and of similar magnitude were found in meta-analyses of undergraduate assessments only, postgraduate assessments only, machine marked written assessments only, practical clinical assessments only, assessments with pass/fail outcomes only, assessments with continuous outcomes only, and in a meta-analysis of white v Asian candidates only. Heterogeneity was present in all meta-analyses. Conclusion Ethnic differences in academic performance are widespread across different medical schools, different types of exam, and in undergraduates and postgraduates. They have persisted for many years and cannot be dismissed as atypical or local problems. We need to recognise this as an issue that probably affects all of UK medical and higher education. More detailed information to track the problem as well as further research into its causes is required. Such actions are necessary to ensure a fair and just method of training and of assessing current and future doctors.

Easing the transition from student to doctor: How can medical schools help prepare their graduates for starting work?

Background: In 2000/1, a survey found that 42% of newly qualified UK doctors felt their medical training had not prepared them well for starting work. Aim: To determine factors associated with preparedness. Methods: A questionnaire to all 5143 newly qualified doctors in May 2005. Results: The response rate was 2062/4784 = 43.1%. 15% of respondents felt poorly prepared by medical school for starting work. There were no associations between gender or graduate entry status and preparedness. The personality traits of conscientiousness (r = 0.14; p < 0.001) and extraversion (r = 0.15; p < 0.001) were associated with high preparedness. Neuroticism was associated with low preparedness (r = -0.16; p < 0.001). Respondents who had done shadowing attachments were more likely to feel prepared (58.6% vs 48.5% felt prepared; χ2 = 4.0; p = 0.05), as were graduates of problem based learning courses (61.3% vs 56.1%; χ2 = 5.0; p = 0.03). Preparedness correlated with agreement with the statements ‘My teaching was relevant to real life as a doctor’ (rho = 0.36; p < 0.001), and ‘As a house officer I found it easy to get help when I needed it’ (rho = 0.29; p < 0.001). Conclusions: Improvements in the preparedness of UK medical school graduates may be due to increased relevance of undergraduate teaching to life as a junior doctor and increased support in the workplace.

Ethnic stereotypes and the underachievement of UK medical students from ethnic minorities: qualitative study.

Objective To explore ethnic stereotypes of UK medical students in the context of academic underachievement of medical students from ethnic minorities. Design Qualitative study using semistructured one to one interviews and focus groups. Setting A London medical school. Participants 27 year 3 medical students and 25 clinical teachers, purposively sampled for ethnicity and sex. Methods Data were analysed using the theory of stereotype threat (a psychological phenomenon thought to negatively affect the performance of people from ethnic minorities in educational contexts) and the constant comparative method. Results Participants believed the student-teacher relationship was vital for clinical learning. Teachers had strong perceptions about “good” clinical students (interactive, keen, respectful), and some described being aggressive towards students whom they perceived as quiet, unmotivated, and unwilling. Students had equally strong perceptions about “good” clinical teachers (encouraging, interested, interactive, non-aggressive). Students and teachers had concordant and well developed perceptions of the “typical” Asian clinical medical student who was considered over-reliant on books, poor at communicating with patients, too quiet during clinical teaching sessions, and unmotivated owing to being pushed into studying medicine by ambitious parents. Stereotypes of the “typical” white student were less well developed: autonomous, confident, and outgoing team player. Direct discrimination was not reported. Conclusions Asian clinical medical students may be more likely than white students to be perceived stereotypically and negatively, which may reduce their learning by jeopardising their relationships with teachers. The existence of a negative stereotype about their group also raises the possibility that underperformance of medical students from ethnic minorities may be partly due to stereotype threat. It is recommended that clinical teachers be given opportunities and training to encourage them to get to know their students as individuals and thus foster positive educational relationships with them.

Construct-level predictive validity of educational attainment and intellectual aptitude tests in medical student selection: meta-regression of six UK longitudinal studies

BackgroundMeasures used for medical student selection should predict future performance during training. A problem for any selection study is that predictor-outcome correlations are known only in those who have been selected, whereas selectors need to know how measures would predict in the entire pool of applicants. That problem of interpretation can be solved by calculating construct-level predictive validity, an estimate of true predictor-outcome correlation across the range of applicant abilities.MethodsConstruct-level predictive validities were calculated in six cohort studies of medical student selection and training (student entry, 1972 to 2009) for a range of predictors, including A-levels, General Certificates of Secondary Education (GCSEs)/O-levels, and aptitude tests (AH5 and UK Clinical Aptitude Test (UKCAT)). Outcomes included undergraduate basic medical science and finals assessments, as well as postgraduate measures of Membership of the Royal Colleges of Physicians of the United Kingdom (MRCP(UK)) performance and entry in the Specialist Register. Construct-level predictive validity was calculated with the method of Hunter, Schmidt and Le (2006), adapted to correct for right-censorship of examination results due to grade inflation.ResultsMeta-regression analyzed 57 separate predictor-outcome correlations (POCs) and construct-level predictive validities (CLPVs). Mean CLPVs are substantially higher (.450) than mean POCs (.171). Mean CLPVs for first-year examinations, were high for A-levels (.809; CI: .501 to .935), and lower for GCSEs/O-levels (.332; CI: .024 to .583) and UKCAT (mean = .245; CI: .207 to .276). A-levels had higher CLPVs for all undergraduate and postgraduate assessments than did GCSEs/O-levels and intellectual aptitude tests. CLPVs of educational attainment measures decline somewhat during training, but continue to predict postgraduate performance. Intellectual aptitude tests have lower CLPVs than A-levels or GCSEs/O-levels.ConclusionsEducational attainment has strong CLPVs for undergraduate and postgraduate performance, accounting for perhaps 65% of true variance in first year performance. Such CLPVs justify the use of educational attainment measure in selection, but also raise a key theoretical question concerning the remaining 35% of variance (and measurement error, range restriction and right-censorship have been taken into account). Just as in astrophysics, ‘dark matter’ and ‘dark energy’ are posited to balance various theoretical equations, so medical student selection must also have its ‘dark variance’, whose nature is not yet properly characterized, but explains a third of the variation in performance during training. Some variance probably relates to factors which are unpredictable at selection, such as illness or other life events, but some is probably also associated with factors such as personality, motivation or study skills.

The hidden medical school: A longitudinal study of how social networks form, and how they relate to academic performance

Background: UK medical schools typically have over 300 students per year, making it impossible for students to know all the others well. Aims: This longitudinal cohort study measured the formation of medical student social networks and their relationship to grades. Method: In November 2009, 215/317 (68%) Year 2 UCL medical students reported their friendships with others in their year, by questionnaire. Multiple regression assessed the relationship between friendships, exam results and background variables (obtained from student records), with permutation testing to assess statistical significance. Results: Students of the same sex, the same ethnic group, and in the same tutor and small groups (to which they were randomly assigned at the start of medical school) were socially closer. Taking into account absolute difference in Year 1 grades, Year 2 pairs who were socially closer in November 2009 had more similar May 2010 grades. Individual student variables did not predict similarity in 2010 grades after taking friendships into account. Conclusions: The results suggest that medical students chose friends of the same sex and ethnic group as themselves; but random allocation of students to tutor groups also influenced friendships. Most importantly, friendships related to subsequent exam performance, suggesting friendship may influence learning.

The educational background and qualifications of UK medical students from ethnic minorities

BackgroundUK medical students and doctors from ethnic minorities underperform in undergraduate and postgraduate examinations. Although it is assumed that white (W) and non-white (NW) students enter medical school with similar qualifications, neither the qualifications of NW students, nor their educational background have been looked at in detail. This study uses two large-scale databases to examine the educational attainment of W and NW students.MethodsAttainment at GCSE and A level, and selection for medical school in relation to ethnicity, were analysed in two separate databases. The 10th cohort of the Youth Cohort Study provided data on 13,698 students taking GCSEs in 1999 in England and Wales, and their subsequent progression to A level. UCAS provided data for 1,484,650 applicants applying for admission to UK universities and colleges in 2003, 2004 and 2005, of whom 52,557 applied to medical school, and 23,443 were accepted.ResultsNW students achieve lower grades at GCSE overall, although achievement at the highest grades was similar to that of W students. NW students have higher educational aspirations, being more likely to go on to take A levels, especially in science and particularly chemistry, despite relatively lower achievement at GCSE. As a result, NW students perform less well at A level than W students, and hence NW students applying to university also have lower A-level grades than W students, both generally, and for medical school applicants. NW medical school entrants have lower A level grades than W entrants, with an effect size of about -0.10.ConclusionThe effect size for the difference between white and non-white medical school entrants is about B0.10, which would mean that for a typical medical school examination there might be about 5 NW failures for each 4 W failures. However, this effect can only explain a portion of the overall effect size found in undergraduate and postgraduate examinations of about -0.32.

Without proper research funding, how can medical education be evidence based?

We can no longer leave research into medical education to chance

Sex differences in medico-legal action against doctors: a systematic review and meta-analysis

BackgroundThe relationship between male sex and poor performance in doctors remains unclear, with high profile studies showing conflicting results. Nevertheless, it is an important first step towards understanding the causes of poor performance in doctors. This article aims to establish the robustness of the association between male sex and poor performance in doctors, internationally and over time.MethodsThe electronic databases MEDLINE, EMBASE, and PsycINFO were searched from inception to January 2015. Backward and forward citation searching was performed. Journals that yielded the majority of the eligible articles and journals in the medical education field were electronically searched, along with the conference and poster abstracts from two of the largest international medical education conferences. Studies reporting original data, written in English or French, examining the association between sex and medico-legal action against doctors were included. Two reviewers independently extracted study characteristics and outcome data from the full texts of the studies meeting the eligibility criteria. Study quality was assessed using the Newcastle-Ottawa scale. A random effect meta-analysis model was used to summarize and assess the effect of doctors’ sex on medico-legal action. Extracted outcomes included disciplinary action by a medical regulatory board, malpractice experience, referral to a medical regulatory body, complaints received by a healthcare complaints body, criminal cases, and medico-legal matter with a medical defence organisation.ResultsOverall, 32 reports examining the association between doctors’ sex and medico-legal action were included in the systematic review (n=4,054,551), of which 27 found that male doctors were more likely to have experienced medico-legal action. 19 reports were included in the meta-analysis (n=3,794,486, including 20,666 cases). Results showed male doctors had nearly two and a half times the odds of being subject to medico-legal action than female doctors. Heterogeneity was present in all meta-analyses.ConclusionMale doctors are more likely to have had experienced medico-legal actions compared to female doctors. This finding is robust internationally, across outcomes of varying severity, and over time.

Even one star at A level could be "too little, too late" for medical student selection.

BackgroundMore and more medical school applicants in England and Wales are gaining the maximum grade at A level of AAA, and the UK Government has now agreed to pilot the introduction of a new A* grade. This study assessed the likely utility of additional grades of A* or of A**.MethodsStatistical analysis of university selection data collected by the Universities and Colleges Admissions Service (UCAS), consisting of data from 1,484,650 applicants to UCAS for the years 2003, 2004 and 2005, of whom 23,628 were medical school applicants, and of these 14,510 were medical school entrants from the UK, aged under 21, and with three or four A level results. The main outcome measure was the number of points scored by applicants in their best three A level subjects.ResultsCensored normal distributions showed a good fit to the data using maximum likelihood modelling. If it were the case that A* grades had already been introduced, then at present about 11% of medical school applicants and 18% of entrants would achieve the maximum score of 3 A*s. Projections for the years 2010, 2015 and 2020 suggest that about 26%, 35% and 46% of medical school entrants would have 3 A* grades.ConclusionAlthough A* grades at A level will help in medical student selection, within a decade, a third of medical students will gain maximum grades. While revising the A level system there is a strong argument, as proposed in the Tomlinson Report, for introducing an A** grade.

The specialty choices of graduates from Brighton and Sussex medical School: a longitudinal cohort study

BackgroundSince 2007 junior doctors in the UK have had to make major career decisions at a point when previously many had not yet chosen a specialty. This study examined when doctors in this new system make specialty choices, which factors influence choices, and whether doctors who choose a specialty they were interested in at medical school are more confident in their choice than those doctors whose interests change post-graduation.MethodsTwo cohorts of students in their penultimate year at one medical school (n = 227/239) were asked which specialty interested them as a career. Two years later, 210/227 were sent a questionnaire measuring actual specialty chosen, confidence, influence of perceptions of the specialty and experiences on choice, satisfaction with medicine, personality, self-efficacy, and demographics. Medical school and post-graduation choices in the same category were deemed ‘stable’. Predictors of stability, and of not having chosen a specialty, were calculated using bootstrapped logistic regression. Differences between specialties on questionnaire factors were analysed.Results50% responded (n = 105/277; 44% of the 239 Year 4 students). 65% specialty choices were ‘stable’. Factors univariately associated with stability were specialty chosen, having enjoyed the specialty at medical school or since starting work, having first considered the specialty earlier. A regression found doctors who chose psychiatry were more likely to have changed choice than those who chose general practice. Confidence in the choice was not associated with stability. Those who chose general practice valued lifestyle factors. A psychiatry choice was associated with needing a job and using one’s intellect to help others. The decision to choose surgical training tended to be made early. Not having applied for specialty training was associated with being lower on agreeableness and conscientiousness.ConclusionMedical school experiences are important in specialty choice but experiences post-graduation remain significant, particularly in some specialties (psychiatry in our sample). Career guidance is important at medical school and should be continued post-graduation, with senior clinicians supported in advising juniors. Careers advice in the first year post-graduation may be particularly important, especially for specialties which have difficulty recruiting or are poorly represented at medical school.