John McAna

Predicting risk of hospitalisation or death: a retrospective population-based analysis

Objectives Develop predictive models using an administrative healthcare database that provide information for Patient-Centred Medical Homes to proactively identify patients at risk of hospitalisation for conditions that may be impacted through improved patient care. Design Retrospective healthcare utilisation analysis with multivariate logistic regression models. Data A population-based longitudinal database of residents served by the Emilia-Romagna, Italy, health service in the years 2004–2012 including demographic information and utilisation of health services by 3 726 380 people aged ≥18 years. Outcome measures Models designed to predict risk of hospitalisation or death in 2012 for problems that are potentially avoidable were developed and evaluated using the area under the receiver operating curve C-statistic, in terms of their sensitivity, specificity and positive predictive value, and for calibration to assess performance across levels of predicted risk. Results Among the 3 726 380 adult residents of Emilia-Romagna at the end of 2011, 449 163 (12.1%) were hospitalised in 2012; 4.2% were hospitalised for the selected conditions or died in 2012 (3.6% hospitalised, 1.3% died). The C-statistic for predicting 2012 outcomes was 0.856. The model was well calibrated across categories of predicted risk. For those patients in the highest predicted risk decile group, the average predicted risk was 23.9% and the actual prevalence of hospitalisation or death was 24.2%. Conclusions We have developed a population-based model using a longitudinal administrative database that identifies the risk of hospitalisation for residents of the Emilia-Romagna region with a level of performance as high as, or higher than, similar models. The results of this model, along with profiles of patients identified as high risk are being provided to the physicians and other healthcare professionals associated with the Patient Centred Medical Homes to aid in planning for care management and interventions that may reduce their patients’ likelihood of a preventable, high-cost hospitalisation.

The Impact of the Risk Evaluation Mitigation Strategy for Erythropoiesis-Stimulating Agents on Their Use and the Incidence of Stroke in Medicare Subjects with Chemotherapy-Induced Anemia with Lung and/or Breast Cancers

Erythropoiesis-stimulating agents (ESAs), found to be effective in reducing anemia in chemotherapy-treated cancer patients, also are associated with an increased risk of cardiovascular events, including stroke. In an attempt to mitigate the risk, the Food and Drug Administration implemented a Risk Evaluation Mitigation Strategy (REMS) in February 2010. The purpose of this study is to evaluate change over time in the incidence of stroke among these patients before and after implementation of REMS. A retrospective data analysis using the Medicare 5% Sample Dataset, 2008-2011, was performed. Patients had to be 65 years of age or older at the start of at least 1 year of continuous enrollment and to have lung and/or breast cancers along with chemotherapy-induced anemia (CIA) in both pre-REMS and post-REMS periods (1Q2008 through 4Q2009 and 1Q2010 through 4Q2011, respectively). Logistic regression was used to evaluate differences in proportions of patients who received ESAs and experienced a stroke pre and post REMS. The pre-REMS cohort included 1252 eligible patients prescribed ESAs; the post-REMS cohort included 949 patients. No statistically significant change in stroke incidence was observed post REMS among patients with CIA who received ESAs. There was a 29.5% decrease in ESA use in patients with lung cancer and a 27.8% decrease in patients with breast cancer. Both were statistically significant. Results adjusted for baseline characteristics and comorbid conditions were similar. There was a statistically significant decrease in ESA use in patients with breast and/or lung cancers post REMS; no statistically significant reduction in the incidence of stroke was observed regardless of cancer type.

Risk evaluation mitigation strategy: impact of application of the Food and Drug Adminstration's strategy on use of erythropoiesis‐stimulating agents and transfusion in patients with chemotherapy‐induced anaemia

The Food and Drug Administration (FDA) instituted a risk evaluation mitigation strategy (REMS) for erythropoiesis‐stimulating agent (ESA) use in patients with cancer in February 2010. Implementation of REMS was considered likely to reduce ESA use and increase red blood cell transfusions. We aimed to quantify ESA and transfusion use pre‐ and post‐REMS.

A Multidisciplinary Approach to Impact Acute Care Utilization in Sickle Cell Disease

Sickle cell disease (SCD), an inherited red blood cell disorder, is characterized by anemia, end-organ damage, unpredictable episodes of pain, and early mortality. Emergency department (ED) visits and hospitalizations are frequent, leading to increased burden on patients and increased health care costs. This study assessed the effects of a multidisciplinary care team intervention on acute care utilization among adults with SCD. The multidisciplinary care team intervention included monthly team meetings and development of individualized care plans. Individualized care plans included targeted pain management plans for management of uncomplicated pain crisis. Following implementation of the multidisciplinary care team intervention, a significant decrease in ED utilization was identified among those individuals with a history of high ED utilization. Findings highlight the potential strength of multidisciplinary interventions and suggest that targeting interventions toward high-utilizing subpopulations may offer the greatest impact.

A single activity with a practice quality improvement project for faculty and a quality improvement project for residents

PURPOSE The Next Accreditation System (NAS) requires radiation oncology residents to do a formal quality improvement project during their residency. The American Board of Radiology (ABR) Maintenance of Certification (MOC) program requires certified physicians to complete a Practice Quality Improvement (PQI) project approximately every 3 years. The purpose of our project was to develop a clinical transition of care policy via a process that resulted in quality improvement project credit for residents and PQI credit for participating faculty. METHODS AND MATERIALS Approval for project implementation was obtained from the ABR MOC committee. The PQI project consisted of an initial survey to assess resident perception on resident transition of care in our department, formal sign-out training, and 2 postintervention surveys after 1 and 11 months. The primary endpoint was the percentage of questions with ≤1 unfavorable responses. Sign-test was used to determine response difference from neutral. RESULTS One hundred percent of surveyed residents completed the preintervention (n = 6), postintervention 1 (n = 7), and postintervention 2 (n = 8) surveys. In the preintervention, postintervention 1, and postintervention 2 surveys, 71.4%, 57.1%, and 57.1% of questions were answered with ≤1 unfavorable response, respectively. The number of questions with ≥75% favorable response was 7 (50%), 7 (50%), and 11 (78.5%) in the preintervention, postintervention 1, and postintervention 2 surveys, respectively (P = .13). A written sign-out template and monthly protected sign-out meetings were instituted. One resident and 3 attending physicians received credit for Accreditation Council of Graduate Medical Education NAS quality improvement and ABR MOC PQI projects, respectively. CONCLUSIONS This project shows the feasibility of a combined attending and resident physician effort to improve patient care and fulfill his or her respective ABR MOC PQI and Accreditation Council of Graduate Medical Education NAS requirements. Attending and resident physicians can tailor collaborative projects to fulfill MOC and NAS requirements unique to their subspecialty. Written sign-out templates and protected sign-out time may improve transition of care.

Primary care units in Emilia-Romagna, Italy: an assessment of organizational culture.

This study investigates the organizational culture and associated characteristics of the newly established primary care units (PCUs)—collaborative teams of general practitioners (GPs) who provide patients with integrated health care services—in the Emilia-Romagna Region (RER), Italy. A survey instrument covering 6 cultural dimensions was administered to all 301 GPs in 21 PCUs in the Local Health Authority (LHA) of Parma, RER; the response rate was 79.1%. Management style, organizational trust, and collegiality proved to be more important aspects of PCU organizational culture than information sharing, quality, and cohesiveness. Cultural dimension scores were positively associated with certain characteristics of the PCUs including larger PCU size and greater proportion of older GPs. The presence of female GPs in the PCUs had a negative impact on collegiality, organizational trust, and quality. Feedback collected through this assessment will be useful to the RER and LHAs for evaluating and guiding improvements in the PCUs.

Increasing faculty participation in resident education and providing cost-effective self-assessment module credit to faculty through resident-generated didactics

PURPOSE/OBJECTIVE(S) Board certified radiation oncologists and medical physicists are required to earn self-assessment module (SAM) continuing medical education (CME) credit, which may require travel costs or usage fees. Data indicate that faculty participation in resident teaching activities is beneficial to resident education. Our hypothesis was that providing the opportunity to earn SAM credit in resident didactics would increase faculty participation in and improve resident education. METHODS AND MATERIALS SAM applications, comprising CME certified category 1 resident didactic lectures and faculty-generated questions with respective answers, rationales, and references, were submitted to the American Board of Radiology for formal review. Surveys were distributed to assess main academic campus physician, affiliate campus physician, physicist, and radiation oncology resident impressions regarding the quality of the lectures. Survey responses were designed in Likert-scale format. Sign-test was performed with P < .05 considered statistically different from neutral. RESULTS First submission SAM approval was obtained for 9 of 9 lectures to date. A total of 52 SAM credits have been awarded to 4 physicists and 7 attending physicians. Main academic campus physician and affiliate campus physician attendance increased from 20% and 0%, respectively, over the 12 months preceding CME/SAM lectures, to 55.6% and 20%, respectively. Survey results indicated that the change to SAM lectures increased the quality of resident lectures (P = .001), attending physician participation in resident education (P < .0001), physicist involvement in medical resident education (P = .0006), and faculty motivation to attend resident didactics (P = .004). Residents reported an increased amount of time required to prepare lectures (P = .008). CONCLUSIONS We are the first department, to our knowledge, to offer SAM credit to clinical faculty for participation in resident-generated didactics. Offering SAM credit at resident lectures is a cost-effective alternative to purchasing SAM resources, increases faculty attendance, and may improve the quality of radiation oncology resident education.

Patient and Provider Characteristics Associated With Optimal Post-Fracture Osteoporosis Management

Despite an estimated 2 million osteoporosis (OP)-related fractures annually, quality of care for post-fracture OP management remains low. This study aimed to identify patient and provider characteristics associated with achieving or not achieving optimal post-fracture OP management, as defined by the current HEDIS quality measure. The study included women 67 to 85 years of age, with ≥1 fracture, and continuous enrollment in a Humana insurance plan. The study identified a higher percentage of black women in the not achieved group (6.2% vs 5.4%; P < .0001) and Hispanic women in the achieved group (3.0% vs 1.3%; P < .0001). The not achieved group largely included patients residing in the South and urban and suburban areas. The majority of providers were primary care or OP-related specialty, and 66% did not achieve the 4-star OP rating. The study findings can guide development of predictive models to identify at-risk women to improve post-fracture OP management.

Evaluating the quality, clinical relevance, and resident perception of the radiation oncology in-training examination: A national survey

PURPOSE The yearly radiation oncology in-training examination (ITE) by the American College of Radiology is a widely used, norm-referenced educational assessment, with high test reliability and psychometric performance. We distributed a national survey to evaluate the academic radiation oncology communitys perception of the ITE. METHODS AND MATERIALS In June 2014, a 7-question online survey was distributed via e-mail to current radiation oncology residents, program directors, and attending physicians who had completed residency in the past 5 years or junior attendings. Survey questions were designed on a 5-point Likert scale. Sign test was performed with P ≤ .05 considered statistically different from neutral. RESULTS Thirty-one program directors (33.3%), 114 junior attendings (35.4%), and 225 residents (41.2%) responded. Junior attendings and program directors reported that the ITE directly contributed to their preparation for the American Board of Radiology written certification (P = .050 and .004, respectively). Residents did not perceive the examination as an accurate assessment of relevant clinical and scientific knowledge (P < .0001) and feel the quality assurance is insufficient in its current form (P < .0001). Residents and junior attendings agree that there are factual errors, and unclear questions/answers (P < .0001 and .04, respectively). Free response suggestions included: less questions on rare disease sites (16.4%), more relevance to clinical practice (15.4%), avoiding questions that discriminate between a few percentage points (11.8%), and designing the test similar to the written certification examination (9.2%). CONCLUSIONS Despite high examination reliability and psychometric performance, resident and attending physicians report a need for improved quality assurance and clinical relevance in the ITE. Although the current examination allows limited feedback, establishing a venue for individualized feedback may allow continual and timely improvement of the ITE. Adopting a criterion-referenced examination may further increase resident investment in and utilization of this valuable learning tool.

Using the ACR Accreditation Process As a Quality Improvement Tool.

DESCRIPTION OF THE PROBLEM The ACR accreditation process is a voluntary review that allows for an impartial peer evaluation of radiation oncology departments. Accreditation is a mechanism for departments to demonstrate to patients, providers, and payers adherence to recognized standards of care and quality performance. Among the goals of the process listed by the ACR are recognizing quality radiation oncology practices, as well as recommending potential practice improvements based on nationally recognized standards. As part of the accreditation process, an onsite survey of departmental facilities, staff, and procedures is carried out by board-certified radiation oncologists and medical physicists. During the onsite survey, the external reviewers interview key personnel, assess documentation of departmental policies and procedures, audit the department’s existing quality assurance and improvement program, and review patient records to assess adherence to nationally recognized clinical standards. Although quality of care is a challenging metric to assess in radiation oncology, accreditation programs focus on components of a department’s structure, process, and outcomes. Most quantifiable outcomes fall into the structure and process categories of quality assessment. Our department sought to quantify the quality improvement