Matthew Mintz

Psychometric validation of the rhinitis control assessment test: a brief patient-completed instrument for evaluating rhinitis symptom control.

BACKGROUND Allergic rhinitis is common, but a validated tool for comprehensive assessment of disease control is not available. OBJECTIVE To develop a simple patient-completed instrument (the Rhinitis Control Assessment Test [RCAT]) to help detect problems with control of rhinitis symptoms. METHODS During a visit to an allergy specialist, 410 patients with allergic rhinitis completed a Total Nasal Symptom Score (TNSS) assessment and the 26-item developmental RCAT. Physicians also completed a global assessment of rhinitis symptom control for each patient. RESULTS Stepwise regression methods identified 6 items from the developmental RCAT (frequency of nasal congestion, sneezing, and watery eyes; sleep interference; activity avoidance; and self-assessed control) that were most predictive of the allergists global rating of rhinitis symptom control. A summated rating scale from these 6 items showed good convergent validity (r > 0.70) with scale scores from the TNSS. The discriminant validity of the 6-item scale was demonstrated as mean RCAT scale scores differed significantly across groups of patients differing in physician-rated disease severity (F = 54.4), TNSS severity (F = 193.8), and physician-recommended change in therapy (F = 50.6) (P < .001 for all). CONCLUSIONS The RCAT, a 6-item patient-completed instrument, has satisfactory psychometric properties and seems to be a valid tool for assessing control of allergic rhinitis. Further validation studies will provide confirmation.

Predicting risk of airflow obstruction in primary care: Validation of the lung function questionnaire (LFQ)

The Lung Function Questionnaire (LFQ) is being developed as a case finding tool to identify patients who are appropriate for spirometry testing to confirm the diagnosis of chronic obstructive pulmonary disease (COPD). The cross-sectional study reported herein was conducted to validate the LFQ, to identify item-response scales associated with the best accuracy, and to determine the impact on accuracy of the addition of another item on activity limitations (AL). Patients >or= 40 years old seen at 2 primary care offices completed the LFQ, a demographic questionnaire followed by spirometry. Of the 837 evaluable patients, 18.6% had airflow obstruction (forced expiratory volume in 1 s/forced vital capacity [FEV(1)/FVC] < 0.70). The 5 items (age, wheeze, dyspnea, smoking, and cough) previously identified in initial LFQ development predicted airflow obstruction and showed good evidence of screening accuracy. Screening accuracy was significantly better with 5-point ordinal item-response scales (78%) than binary (yes/no) item-response scales (74%)(p < 0.05). Screening accuracy was good regardless of whether airflow obstruction was defined as FEV(1)/FVC < 0.70 or FEV(1)/FVC < 0.70 and FEV(1) < 80% of predicted. Based on <or=18 was selected to suggest presence of airflow obstruction with area under the receiver operating characteristic curve 0.652; sensitivity 82.6%; specificity 47.8%; 54.3% correctly classified. While the specificity of LFQ is low, its high sensitivity suggests that it can serve to identify patients who should be further assessed using spirometry. Our results confirm the screening accuracy of the LFQ, a simple and effective tool to facilitate early recognition and diagnosis of COPD.

Development of the Lung Function Questionnaire (LFQ) to identify airflow obstruction.

Objective: To describe the item-selection and item-reduction for the Lung Function Questionnaire (LFQ), being developed to help clinicians identify patients appropriate for diagnostic evaluation for chronic obstructive pulmonary disease (COPD) using spirometry. Methods: Item selection and reduction were based on information from 387 ≥40-year-old respondents to the third National Health and Nutrition Examination Survey who had self-reported chronic bronchitis. Item reduction involved stepwise logistic regression. The accuracy of the final subset of items for identifying individuals with airflow obstruction (forced expiratory volume in one second/forced vital capacity <0.70) versus those without it was assessed with receiver operating characteristic analysis. Content and face validity were assessed using focus groups of primary care physicians (n = 16) and interviews with COPD patients (n = 16). Results: The model with all five items (age; smoking history; the presence of wheeze, dyspnea, and phlegm) compared with models with combinations of fewer items had the highest classification accuracy (area under the curve [AUC] = 0.720) with sensitivity and specificity of 73.2% and 58.2%, respectively. The presence of three or more factors yielded the highest AUC, a result suggesting that three or more affirmative answers is the most appropriate criterion indicating presence of airflow obstruction. Conclusions: The five-item LFQ retained sufficient accuracy, sensitivity, and specificity in identifying individuals with COPD for further validation testing.

Survey of handheld computing among medical students

The purpose of this study was to identify trends in the utilization and acceptance of handheld computers (personal digital assistants) among medical students during preclinical and clinical training. We surveyed 366 medical students and collected information on computer expertise, current handheld computer use, predicted future use, and user acceptance. Handheld computers were primarily used for personal applications by students during their preclinical training and as drug references and clinical calculators during their clinical training. In the future, all participants predicted they would use handheld computers at significantly higher rates and on a broader range of medical applications. The adoption of handheld computing was independent of user satisfaction. Those with more clinical experience were less satisfied with handheld computers, suggesting that the expectations of the more experienced users were not met. The lack of institutional support was seen as a key limitation.

Assessment of asthma control in primary care

Abstract Objective: To determine the prevalence of uncontrolled asthma in patients who are visiting their primary care provider for any reason. Research design and methods: This multisite, cross-sectional survey was conducted between January 25 and May 2, 2008. Participants aged ≥18 years were recruited from 35 primary care provider sites. Eligible participants presented to the office for any acute medical, routine, follow-up, or nonmedical reason; had a self-reported physician diagnosis of asthma; used medication to treat asthma in the past year; and had no history of COPD. They completed the Asthma Control Test† (ACT) and provided information including demographics, health behaviors, medical history, and asthma medication use. Uncontrolled asthma was defined as ACT score ≤19. † Asthma Control Test is a trademark of QualityMetric, Inc., Lincoln, RI, USA. Results: The overall weighted prevalence of uncontrolled asthma in 2238 patients in primary care was 58% (95% confidence interval [CI], 0.56–0.60). Among asthma patients seeking care for a respiratory complaint, 72% (95% CI, 0.68–0.75) had uncontrolled asthma compared to 48% (95% CI, 0.45–0.51) of asthma patients presenting for a non-respiratory reason. Conclusions: At the population level, over half of patients with asthma under primary care management had uncontrolled asthma at the time of an office visit. Surprisingly, nearly 50% of patients with asthma who presented for office visits not associated with respiratory-related complaints had uncontrolled asthma. The study results may be influenced by a seasonal effect of upper respiratory infections and by the insurance status of the study respondents. However identifying patients with uncontrolled asthma is important and remains a challenge. Therefore, health care providers should consider evaluating asthma control on a regular basis, regardless of reason for visit.

Letters of Recommendation: Rating, Writing, and Reading by Clerkship Directors of Internal Medicine

Background: Letters of Recommendations (LORs) are used for applications to medical school and graduate medical education, but how they are used by current internal medicine educators is unknown. Description: In 2006, the Clerkship Directors of Internal Medicine conducted its annual, voluntary survey, and one section pertained to LORs. Survey items were categorized into questions regarding rating, writing, and reading LORs with answers on 3- to 5-point scales. Evaluation: The response rate for the 110 institution members was 75%. When rating LORs, the most important factor was depth of understanding of the trainee (98% essential or important), followed by a numerical comparison to other students (94%), grade distribution (92%), and summary statement (91%). Although most (78%) agreed that reading LORs in general were important for trainee selection, few agreed that this was because of the ability to discern marginal performance (31%) or predict future performance (25%). Conclusions: LORs remain an important part of the application process for medical school and internal medicine residency. Letter writers should convey a great depth of understanding of the applicant, provide a numerical comparison with other students (including a denominator), and give a specific summary statement.

Do Attending Physicians, Nurses, Residents, and Medical Students Agree on What Constitutes Medical Student Abuse?

Background Whether attending physicians, residents, nurses, and medical students agree on what constitutes medical student abuse, its severity, or influencing factors is unknown. Method We surveyed 237 internal medicine attending physicians, residents, medical students, and nurses at 13 medical schools after viewing five vignettes depicting potentially abusive behaviors. Results The majority of each group felt the belittlement, ethnic insensitivity, and sexual harassment scenarios represented abuse but that excluding a student from participating in a procedure did not. Only a majority of attending physicians considered the negative feedback scenario as abuse. Medical students rated abuse severity significantly lower than other groups in the belittlement scenario (p < .05). Respondents who felt abused as students were more likely to rate behaviors as abusive (p < .05). Conclusions The groups generally agree on what constitutes abuse, but attending physicians and those abused as students may perceive more behaviors as abusive.

Qualitative Development of the Rhinitis Control Assessment Test (RCAT), an Instrument for Evaluating Rhinitis Symptom Control

AbstractBackground: Effective management of allergic rhinitis requires ongoing monitoring of its control. This article describes the qualitative phase of development of a patient-completed instrument, the Rhinitis Control Assessment Test (RCAT), designed to assist patients and providers in the detection of problems with rhinitis symptom control. Objective: To identify concepts to be measured and to develop initial questionnaire items to be tested further in the next phase of development. Methods: A literature review and input from patient focus groups were utilized to generate concepts to be measured in the draft questionnaire. The draft items were subjected to cognitive testing to ensure that the items were understood by patients and to eliminate ambiguity as well as to select an optimal recall period and meaningful response scales. Patients aged ≥18 years self-reporting a rhinitis diagnosis who had experienced rhinitis symptoms in the past 12 months were eligible for participation in the focus groups (n=39) and the cognitive interviews (n=23). Results: This qualitative process yielded a draft instrument with 26 items assessing five constructs of rhinitis symptom control: frequency and bother-someness of nasal and non-nasal symptoms, symptom impact, activity interference, symptom control, and medication use. A five-point Likert response scale and a 1-week recall period for each item were adopted based on patient input. Conclusion: The qualitative phase of development of the RCAT produced constructs and items for an instrument that is anticipated to facilitate accurate assessment of rhinitis control and improve the quality of care for patients with allergic rhinitis.

Acting on Reflection: the Effect of Reflection on Students’ Clinical Performance on a Standardized Patient Examination

BackgroundLittle evidence exists to support the value of reflection in the clinical setting.ObjectiveTo determine whether reflecting and revisiting the “patient” during a standardized patient (SP) examination improves junior medical students’ performance and to analyze students’ perceptions of its value.DesignStudents completed a six-encounter clinical skills examination, writing a guided assessment after each encounter to trigger reflection. SPs evaluated the students with Medical Skills and Patient Satisfaction checklists. During the last three encounters, students could opt to revisit the SP and be reevaluated with identical checklists.ParticipantsOne hundred and forty-nine third year medical students.MeasurementsChanges in scores in the Medical Skills and Patient Satisfaction checklists between first visit and revisit were tested separately per case as well as across cases.ResultsOn the medical skills and patient satisfaction checklists, mean revisit scores across cases were significantly higher than mean first visit scores [12.6 vs 12.2 (pooled SD = 2.4), P = .0001; 31.2 vs 31.0 (pooled SD = 3.5), P = .0001)]. Sixty-five percent of the time, students rated “reflect–revisit” positively, 34% neutrally, and 0.4% negatively. Five themes were identified in the positive comments: enhancement of (1) medical decision making, (2) patient education/counseling, (3) student satisfaction/confidence, (4) patient satisfaction/confidence, and (5) clinical realism.ConclusionsOffering third year medical students the option to reflect and revisit an SP during a clinical skills examination produced a small but nontrivial increase in clinical performance. Students perceived the reflect–revisit experience as enhancing patient-centered practices (counseling, education) as well as their own medical decision making and clinical confidence.

Perspective: are we teaching racial profiling? The dangers of subjective determinations of race and ethnicity in case presentations.

Physicians make subjective visual assessments concerning the race and/or ethnicity of their patients and document these assessments in patient histories every day. Medical students learn this practice through textbooks and the example set by their educators. Although physicians may believe that they are helping their patients, the practice of using visual clues concerning race and/or ethnicity to determine whether a patient is at risk of certain diseases lacks scientific rigor and may put the patient at significant risk of receiving substandard medical care. The authors argue that if the patients race or ethnicity is of critical importance, the data should be collected through more objective, scientifically rigorous means, such as genetic testing. In this article, the authors call for the widespread transformation of the way medical schools teach tomorrows physicians about the role of race and ethnicity in taking medical histories, and they challenge physicians to change their current practices.