Kristen K. McNiff

A Process for Measuring the Quality of Cancer Care: The Quality Oncology Practice Initiative

PURPOSE The Quality Oncology Practice Initiative (QOPI) is a practice-based system of quality self-assessment sponsored by the participants and the American Society of Clinical Oncology (ASCO). The process of quality evaluation, development of the pilot questionnaire, and preliminary results are reported. METHODS Physicians from seven oncology groups developed medical record abstraction measures based on practice guidelines and consensus-supported indicators of quality care. Each practice completed two rounds of records review and received practice and aggregate results. Mean frequencies of responses for each indicator were compared among practices. RESULTS Participants universally, if informally, find QOPI helpful, and results show statistically significant variation among practices for several indicators, including assessing pain in patients close to death, documentation of informed consent for chemotherapy, and concordance with granulocytic and erythroid growth factor administration guidelines. Measures with universally high concordance include the use of serotonin antagonist antiemetics according to the ASCO guideline; the presence of a pathology report in the record; the use of chemotherapy flow sheets; and adherence to standard chemotherapy recommendations for patients with certain stages of breast, colon, and rectal cancer. Concordance with quality indicators significantly changed between survey rounds for several measures. CONCLUSION Pilot results indicate that the QOPI process provides a rapid and objective measurement of practice quality that allows comparisons among practices and over time. It also provides a mechanism for measuring concordance with published guidelines. Most importantly, it provides a tool for practice self-examination that can promote excellence in cancer care.

American Society of Clinical Oncology/National Comprehensive Cancer Network Quality Measures

PURPOSE The National Cancer Policy Board recommended the creation of quality measures and a national reporting system in 1999. Representatives from the American Society of Clinical Oncology (ASCO) and the National Comprehensive Cancer Network (NCCN) collaborated to create metrics suitable for national performance measurement. METHODS Content and methodology experts nominated by ASCO and NCCN met to select and refine metrics for breast, colon, and rectal cancer based on National Initiative for Cancer Care Quality and NCCN measures and NCCN and ASCO guidelines. Measures were selected based on their impact on disease free and overall survival, the degree to which opportunities for improvement exist, and the feasibility of data collection. RESULTS Three breast cancer measures and four colorectal cancer measures were chosen. Measures for breast cancer included adjuvant hormone therapy for hormone receptor-positive tumors, chemotherapy for hormone receptor-negative cancer, and radiation after lumpectomy. Colorectal measures included adjuvant radiation and chemotherapy for rectal cancer, and adjuvant chemotherapy for colon cancer. All but one were recommended as accountability measures and one for quality improvement (removal and examination of 12 or more lymph nodes in colon cancer). Specifications were developed for each measure using tumor registries as the data source. CONCLUSION ASCO/NCCN measures can be implemented by health systems, provider groups or payors for improvement or accountability using local tumor registries to furnish data on staging and treatment.

American Society of Clinical Oncology/Oncology Nursing Society Chemotherapy Administration Safety Standards

Standardization of care can reduce the risk of errors, increase efficiency, and provide a framework for best practice. In 2008, the American Society of Clinical Oncology (ASCO) and the Oncology Nursing Society (ONS) invited a broad range of stakeholders to create a set of standards for the administration of chemotherapy to adult patients in the outpatient setting. At the close of a full-day structured workshop, 64 draft standards were proposed. After a formal process of electronic voting and conference calls, 29 draft standards were eliminated, resulting in a final list of 35 draft measures. The proposed set of standards was posted for 6 weeks of open public comment. Three hundred twenty-two comments were reviewed by the Steering Group and used as the basis for final editing to a final set of standards. The final list includes 31 standards encompassing seven domains, which include the following: review of clinical information and selection of a treatment regimen; treatment planning and informed consent; ordering of treatment; drug preparation; assessment of treatment compliance; administration and monitoring; and assessment of response and toxicity monitoring. Adherence to ASCO and ONS standards for safe chemotherapy administration should be a goal of all providers of adult cancer care.

Improvement in Oncology Practice Performance Through Voluntary Participation in the Quality Oncology Practice Initiative

PURPOSE The Quality Oncology Practice Initiative (QOPI) became available to all American Society of Clinical Oncology member physicians in 2006 as a voluntary medical oncology practice-based quality measurement and improvement project. QOPI assesses practice performance for a series of evidence- and consensus-based process measures, relying on practices to complete structured chart reviews and submit data via a secure Web-based portal. METHODS This analysis focused on the 71 practices that participated in both the March and September 2006 data collections (7,624 charts abstracted in March and 10,240 in September). Among 33 measures common to both collections, five measures were closely correlated, and 28 are included in the final analysis. Composite scores were created for six different domains of care. Statistical significance was tested on both absolute changes and relative changes (relative failure reduction) of quality measures from baseline to follow-up and between the lower quartile and all other quartiles. RESULTS Practice performance on individual measures varied between 18.8% and 98.6%. Mean overall performance as measured by a composite score increased from 78.7% in March to 82.3% in September (P < .05). Improvement was most marked among practices originally performing in the bottom quartile. Using a composite score, the absolute and relative performance for the bottom quartile improved by 27% and 35%, respectively, statistically superior to that of all others. CONCLUSION Practices that participated in QOPI demonstrated improved performance in self-reported process measures, with the greatest improvement demonstrated in initially low-performing practices.

Implementation of the Quality Oncology Practice Initiative at a University Comprehensive Cancer Center

PURPOSE The Quality Oncology Practice Initiative (QOPI) is a voluntary program developed by the American Society of Clinical Oncology (ASCO) to aid oncology practices in quality self-assessment. Few academic cancer centers have been QOPI participants. METHODS We implemented the QOPI process at the University of Michigan Comprehensive Cancer Center, a large, hospital-based academic cancer center, and report our experience with five rounds of data collection. Patient medical records were selected using QOPI-specified procedures and abstracted locally; results were entered into an ASCO-maintained database and analyzed. RESULTS Abstractors who were not directly involved with patient care required an average of 62.3 minutes per medical record (4.7 minutes per data element) to abstract data. We found that compliance with quality measures was uniformly high when measures were structured into our electronic medical record. Results from other measures, including those measuring chemotherapy administration in the last 2 weeks of life, were initially markedly different from those reported by other QOPI participants. Our practice changed toward the QOPI national practice norm after a presentation of the results at a faculty research conference. We found that other measures were consistently greater than 90%, including disease-specific diagnosis and treatment measures. CONCLUSION Measuring and showing performance data to physicians was sufficient to change some aspects of physician behavior. Improvement in other measures requires structural practice changes. QOPI, an oncologist-developed system, can be adapted for use in practice improvement at an academic medical center.

Measuring Supportive Care in Medical Oncology Practice: Lessons Learned From the Quality Oncology Practice Initiative

We provide a brief review of the use of quality measures to assess supportive care in the medical oncology office. Specifically, we discuss the development and implementation of supportive care measures in the Quality Oncology Practice Initiative (QOPI), a voluntary quality measurement and improvement program of the American Society of Clinical Oncology. QOPI has demonstrated that medical oncologists voluntarily engage in self-assessment and often select measures related to supportive care for measurement and improvement. Results to date have demonstrated that there is room for improvement in this domain. Because supportive care measures appropriate for use through structured chart review in the outpatient oncology setting are not generally available in the published literature, measures have been developed and tested through the program. Additional measures are in development for implementation in QOPI in 2008.

2013 Updated American Society of Clinical Oncology/Oncology Nursing Society Chemotherapy Administration Safety Standards Including Standards for the Safe Administration and Management of Oral Chemotherapy

In 2009, the American Society of Clinical Oncology (ASCO) and the Oncology Nursing Society (ONS) published standards for the safe use of parenteral chemotherapy in the outpatient setting, including issues of practitioner orders, preparation, and administration of medication. In 2011, these were updated to include inpatient facilities. In December 2011, a multistakeholder workgroup met to address the issues associated with orally administered antineoplastics, under the leadership of ASCO and ONS. The workgroup participants developed recommended standards, which were presented for public comment. Public comments informed final edits, and the final standards were reviewed and approved by the ASCO and ONS Boards of Directors. Significant newly identified recommendations include those associated with drug prescription and the necessity of ascertaining that prescriptions are filled. In addition, the importance of patient and family education regarding administration schedules, exception procedures, disposal of unused oral medication, and aspects of continuity of care across settings were identified. This article presents the newly developed standards.

Patient-Reported Outcome Performance Measures in Oncology

Patient self-reporting affords the opportunity to better understand the impact of care processes on how patients feel.

Defining High-Quality Palliative Care in Oncology Practice: An American Society of Clinical Oncology/American Academy of Hospice and Palliative Medicine Guidance Statement

PURPOSE Integrated into routine oncology care, palliative care can improve symptom burden, quality of life, and patient and caregiver satisfaction. However, not all oncology practices have access to specialist palliative medicine. This project endeavored to define what constitutes high-quality primary palliative care as delivered by medical oncology practices. METHODS An expert steering committee outlined 966 palliative care service items, in nine domains, each describing a candidate element of primary palliative care delivery for patients with advanced cancer or high symptom burden. Using modified Delphi methodology, 31 multidisciplinary panelists rated each service item on three constructs: importance, feasibility, and scope within medical oncology practice. RESULTS Panelists endorsed the highest proportion of palliative care service items in the domains of End-of-Life Care (81%); Communication and Shared Decision Making (79%); and Advance Care Planning (78%). The lowest proportions were in Spiritual and Cultural Assessment and Management (35%) and Psychosocial Assessment and Management (39%). In the largest domain, Symptom Assessment and Management, there was consensus that all symptoms should be assessed and managed at a basic level, with more comprehensive management for common symptoms such as nausea, vomiting, diarrhea, dyspnea, and pain. Within the Appropriate Palliative Care and Hospice Referral domain, there was consensus that oncology practices should be able to describe the difference between palliative care and hospice to patients and refer patients appropriately. CONCLUSION This statement describes the elements comprising high-quality primary palliative care for patients with advanced cancer or high symptom burden, as delivered by oncology practices. Oncology providers wishing to enhance palliative care delivery may find this information useful to inform operational changes and quality improvement efforts.

Quality Oncology Practice Initiative Certification Program: Overview, Measure Scoring Methodology, and Site Assessment Standards

More than a decade ago, the Institute of Medicine created the National Cancer Policy Board and identified a need to assess national quality of cancer care, generating a cascade of projects, including ASCOs QOPI.