Sandra B. Sexson

Blinded, multi-center validation of EEG and rating scales in identifying ADHD within a clinical sample

Previous validation studies of attention deficit/hyperactivity disorder (ADHD) assessment by rating scales or EEG have provided Class-IV evidence per standards of the American Academy of Neurology. To investigate clinical applications, we collected Class-I evidence, namely from a blinded, prospective, multi-center study of a representative clinical sample categorized with a clinical standard. Participating males (101) and females (58) aged 6 to 18 had presented to one of four psychiatric and pediatric clinics because of the suspected presence of attention and behavior problems. DSM-IV diagnosis was performed by clinicians assisted with a semi-structured clinical interview. EEG (theta/beta ratio) and ratings scales (Conners Rating Scales-Revised and ADHD Rating Scales-IV) were collected separately in a blinded protocol. ADHD prevalence in the clinical sample was 61%, whereas the remainder had other childhood/adolescent disorders or no diagnosis. Comorbidities were observed in 66% of ADHD patients and included mood, anxiety, disruptive, and learning disorders at rates similar to previous findings. EEG identified ADHD with 87% sensitivity and 94% specificity. Rating scales provided sensitivity of 38-79% and specificity of 13-61%. While parent or teacher identification of ADHD by rating scales was reduced in accuracy when applied to a diverse clinical sample, theta/beta ratio changes remained consistent with the clinicians ADHD diagnosis. Because theta/beta ratio changes do not identify comorbidities or alternative diagnoses, the results do not support the use of EEG as a stand-alone diagnostic and should be limited to the interpretation that EEG may complement a clinical evaluation for ADHD.

Relationship between resident-in-training examination in psychiatry and subsequent certification examination performances

ObjectiveThis study analyzed the relationship between performance on The American College of Psychiatrists’ Psychiatry Resident-In-Training Examination (PRITE) and the ABPN Part 1 examination.MethodsPearson correlation coefficients were used to examine the relationship between performance on the 2002 PRITE and the 2003 Part 1 examination for 297 examinees.ResultsThe correlation between the PRITE global psychiatry and the Part 1 psychiatry scores was 0.59, and the correlation between the PRITE global neurology and the Part 1 neurology scores was 0.39.ConclusionAlthough the PRITE and the Part 1 examination have different purposes and are developed independently, the significant correlations between scores on the two tests support the use of PRITE results to guide preparation for the Part 1 examination. Guidelines for PRITE scores associated with poor performance on the Part 1 examination are provided.

Improving child and adolescent psychiatry education for medical students: An inter-organizational collaborative action plan

ObjectiveA new Child and Adolescent Psychiatry in Medical Education (CAPME) Task Force, sponsored by the Association for Directors of Medical Student Education in Psychiatry (ADMSEP), has created an inter-organizational partnership between child and adolescent psychiatry (CAP) educators and medical student educators in psychiatry. This paper outlines the task force design and strategic plan to address the longstanding dearth of CAP training for medical students.MethodThe CAPME ADMSEP Task Force, formed in 2010, identified common challenges to teaching CAP among ADMSEP’s CAPME Task Force members, utilizing focus-group discussions and a needs-assessment survey. The Task Force was organized into five major sections, with inter-organizational action plans to address identified areas of need, such as portable modules and development of benchmark CAP competencies.ResultsThe authors predict that all new physicians, regardless of specialty, will be better trained in CAP. Increased exposure may also improve recruitment into this underserved area.

US Medical Licensing Exam Scores and Performance on the Psychiatry Resident In-Training Examination

ObjectiveThis study explores relationships between US Medical Licensing Examination (USMLE) and Psychiatry Resident In-Training Examination (PRITE) scores over a 10-year period at a university-affiliated program.MethodsFor all MD general psychiatry residents who matriculated from 2003 to 2012 (n = 51), we extracted three-digit first-attempt and passing USMLE Step 1 and Step 2 clinical knowledge (CK) scores and PRITE percentile scores, stratified by global psychiatry and neurology scores, for postgraduate year (PGY)-1, 2, 3, and 4. A mixed model repeated measures analysis was performed to assess the association between USMLE and PRITE scores, adjusting for age, sex, and US medical graduate versus IMG status. Multiple linear regression models of USMLE and PGY-1 PRITE scores were also constructed.ResultsUSMLE Steps 1 and 2 CK scores were significant predictors of PRITE psychiatry and neurology scores, both in PGY-1 as well as across all years of training (p < 0.01 for each).ConclusionGiven that PRITE scores are a significant predictor of success on the ABPN written examination, USMLE scores may be an important quantitative predictor of performance during residency.

Clinical Skills Verification in General Psychiatry: Recommendations of the ABPN Task Force on Rater Training

ObjectiveThe American Board of Psychiatry and Neurology (ABPN) announced in 2007 that general psychiatry training programs must conduct Clinical Skills Verification (CSV), consisting of observed clinical interviews and case presentations during residency, as one requirement to establish graduates’ eligibility to sit for the written certification examination. To facilitate implementation of these requirements, the ABPN convened a task force to prepare training materials for faculty and programs to guide them in the CSV process. This article reviews the specific requirements for the CSV experience within general residency programs, and briefly describes the recommendations of the task force for faculty training and program implementation.MethodsMaterials prepared by the ABPN Task Force include background information on the intent of the observed interview, a literature review on assessment methods, aids to train faculty in direct observation of clinical work, directions for effective feedback, notes regarding special issues for cross-cultural trainees, clarification of performance standards, and recommendations for structuring and conducting the assessments.ResultsRecommendations of the task force include the use of a variety of clinical settings for CSV assessments, flexibility in the duration of CSV interviews, use of formative and summative feedback after each CSV assessment, and frequent use of the CSV across all years of training. Formal faculty training is recommended to help establish performance parameters, increase inter-rater reliability, and improve the quality of feedback.ConclusionsThe implementation of the CSV process provides psychiatry training programs with an excellent opportunity to assess how interviewing skills are taught and evaluated. In the process, psychiatry educators have an opportunity to establish performance parameters that will guide the training of residents in patient interaction and evaluation.

Comparing and Contrasting the Use of Problem-Based Learning in Child and Adolescent Psychiatry Programs

ObjectiveProblem-based learning (PBL) is one of the core components of medical education. To facilitate the spread and use of PBL in child and adolescent psychiatry (CAP) fellowship training, a special interest study group (SISG) was formed at the American Academy of Child and Adolescent Psychiatry (AACAP). Different approaches to the implementation of PBL between programs represented at the SISG are compared in this report.MethodsThe authors distributed a survey to SISG participants after the 2015 annual AACAP meeting, which gathered information about the different approaches programs use to implement PBL in graduate medical education.ResultsSix CAP training programs responded to the survey, providing descriptions of the structure and content of PBL seminars. Programs chose to include a wide variety of topics in PBL courses and approach course organization in a number of ways. To the degree that PBL draws from identified reference texts, programs were similar in selecting definitive textbooks, practice parameters, and seminal articles.ConclusionsThis small pilot study is intended to provide a snapshot of the state of PBL implementation in CAP fellowship programs. It reflects that programs can incorporate PBL in a variety of ways, tailored to the needs of the institution. Future directions of research include assessment of resident satisfaction with PBL, impact on resident education, and identifying successful methods of implementation of PBL.

Practical Applications for Maintenance of Certification Products in Child and Adolescent Residency Training

ObjectiveThe authors evaluated whether Maintenance of Certification (MOC) Performance-in-Practice products in training increases trainee knowledge of MOC processes and is viewed by trainees as a useful activity.MethodsSix child and adolescent psychiatry fellowships used MOC products in continuity clinics to assess their usefulness as training tools. Two surveys assessed initial knowledge of MOC and usefulness of the activity.ResultsForty-one fellows completed the initial survey. A majority of first-year fellows indicated lack of awareness of MOC in contrast to a majority of second-year fellows who indicated some awareness. Thirty-five fellows completed the second survey. A majority of first- and second-year fellows found the activity easy to execute and would change something about their practice as a result.ConclusionsUsing MOC products in training appears to be a useful activity that may assist training programs in teaching the principles of self- and peer-learning.

Guidelines for the general psychiatry application process and for inter-residency transitions.

Selecting a psychiatry program is a seminal event. There is often not enough guidance about this process. The American Association of Directors of Psychiatric Residency Training (AADPRT) recognized that this was a high-stakes process and that there was the opportunity to provide input about the process and promoting fairness and consistency, which could help provide the best opportunity for applicants to select where they will train and for programs to accept trainees who are well qualified for what a program offers and will best fit into the learning environment. A workgroup created guidelines included herein for the application process to begin general psychiatry training and to transition from one program to another, including transfer from one General Psychiatry program into another and entry into Child and Adolescent Psychiatry Residencies as well as subspecialty fellowships in psychiatry.

Preparing Trainees for Integrated Care: Triple Board and the Postpediatric Portal Program

Training combining the disciplines of pediatrics, psychiatry, and child and adolescent psychiatry dates back to World War II, but formal combined programs began more than 3 decades ago as the Triple Board Program and 10 years ago as the Postpediatric Portal Program (PPPP). Triple board training was rigorously examined as a pilot program and ongoing surveys suggest that it provides successful training of physicians who can pass the required board examinations and contribute to clinical, academic, and administrative/advocacy endeavors. As evidence grows showing the value of integrated care, physicians with combined training will offer a unique perspective for developing systems.

Directing Child and Adolescent Psychiatry Training for Residents

Directing child and adolescent psychiatry (CAP) training for residents is a complex and challenging administrative task that encompasses the broad creativity of the orchestral conductor, the social and interpersonal effectiveness of the best politician, and the orientation to details of the finest accountant. This article examines these roles in detail, recognizing the leadership, administrative, and managerial achievements of the successful child and adolescent program director. Resources for optimizing the chances for success in each of these areas, and the common pitfalls to avoid, are identified and discussed. The article concludes with suggestions for CAP training directors to influence medical student education. Although challenging and sometimes frustrating, the role of the program director in CAP training is almost always exciting and rewarding.