Ann Madsen

An intervention to improve cause-of-death reporting in New York City hospitals, 2009-2010.

Introduction Poor-quality cause-of-death reporting reduces reliability of mortality statistics used to direct public health efforts. Overreporting of heart disease has been documented in New York City (NYC) and nationwide. Our objective was to evaluate the immediate and longer-term effects of a cause-of-death (COD) educational program that NYC’s health department conducted at 8 hospitals on heart disease reporting and on average conditions per certificate, which are indicators of the quality of COD reporting. Methods From June 2009 through January 2010, we intervened at 8 hospitals that overreported heart disease deaths in 2008. We shared hospital-specific data on COD reporting, held conference calls with key hospital staff, and conducted in-service training. For deaths reported from January 2009 through June 2011, we compared the proportion of heart disease deaths and average number of conditions per death certificate before and after the intervention at both intervention and nonintervention hospitals. Results At intervention hospitals, the proportion of death certificates that reported heart disease as the cause of death decreased from 68.8% preintervention to 32.4% postintervention (P < .001). Individual hospital proportions ranged from 58.9% to 79.5% preintervention and 25.9% to 45.0% postintervention. At intervention hospitals the average number of conditions per death certificate increased from 2.4 conditions preintervention to 3.4 conditions postintervention (P < .001) and remained at 3.4 conditions a year later. At nonintervention hospitals, these measures remained relatively consistent across the intervention and postintervention period. Conclusion This NYC health department’s hospital-level intervention led to durable changes in COD reporting.

Impact of a hospital-level intervention to reduce heart disease overreporting on leading causes of death.

Introduction The quality of cause-of-death reporting on death certificates affects the usefulness of vital statistics for public health action. Heart disease deaths are overreported in the United States. We evaluated the impact of an intervention to reduce heart disease overreporting on other leading causes of death. Methods A multicomponent intervention comprising training and communication with hospital staff was implemented during July through December 2009 at 8 New York City hospitals reporting excessive heart disease deaths. We compared crude, age-adjusted, and race/ethnicity-adjusted proportions of leading, underlying causes of death reported during death certification by intervention and nonintervention hospitals during preintervention (January–June 2009) and postintervention (January–June 2010) periods. We also examined trends in leading causes of death for 2000 through 2010. Results At intervention hospitals, heart disease deaths declined by 54% postintervention; other leading causes of death (ie, malignant neoplasms, influenza and pneumonia, cerebrovascular disease, and chronic lower respiratory diseases) increased by 48% to 232%. Leading causes of death at nonintervention hospitals changed by 6% or less. In the preintervention period, differences in leading causes of death between intervention and nonintervention hospitals persisted after controlling for race/ethnicity and age; in the postintervention period, age accounted for most differences observed between intervention and nonintervention hospitals. Postintervention, malignant neoplasms became the leading cause of premature death (ie, deaths among patients aged 35–74 y) at intervention hospitals. Conclusion A hospital-level intervention to reduce heart disease overreporting led to substantial changes to other leading causes of death, changing the leading cause of premature death. Heart disease overreporting is likely obscuring the true levels of cause-specific mortality.

Programmatic Impact of 5 Years of Mortality Surveillance of New York City Homeless Populations

A homeless mortality surveillance system identifies emerging trends in the health of the homeless population and provides this information to key stakeholders in a timely and ongoing manner to effect evidence-based, programmatic change. We describe the first 5 years of the New York City homeless mortality surveillance system and, for the first time in peer-reviewed literature, illustrate the impact of key elements of sustained surveillance (i.e., timely dissemination of aggregate mortality data and real-time sharing of information on individual homeless decedents) on the programs of New York Citys Department of Homeless Services. These key elements had a positive impact on the departments programs that target sleep-related infant deaths and hypothermia, drug overdose, and alcohol-related deaths among homeless persons.

Effect of Cause-of-Death Training on Agreement Between Hospital Discharge Diagnoses and Cause of Death Reported, Inpatient Hospital Deaths, New York City, 2008 - 2010

Introduction Accurate cause-of-death reporting is required for mortality data to validly inform public health programming and evaluation. Research demonstrates overreporting of heart disease on New York City death certificates. We describe changes in reported causes of death following a New York City health department training conducted in 2009 to improve accuracy of cause-of-death reporting at 8 hospitals. The objective of our study was to assess the degree to which death certificates citing heart disease as cause of death agreed with hospital discharge data and the degree to which training improved accuracy of reporting. Methods We analyzed 74,373 death certificates for 2008 through 2010 that were linked with hospital discharge records for New York City inpatient deaths and calculated the proportion of discordant deaths, that is, death certificates reporting an underlying cause of heart disease with no corresponding discharge record diagnosis. We also summarized top principal diagnoses among discordant reports and calculated the proportion of inpatient deaths reporting sepsis, a condition underreported in New York City, to assess whether documentation practices changed in response to clarifications made during the intervention. Results Citywide discordance between death certificates and discharge data decreased from 14.9% in 2008 to 9.6% in 2010 (P < .001), driven by a decrease in discordance at intervention hospitals (20.2% in 2008 to 8.9% in 2010; P < .001). At intervention hospitals, reporting of sepsis increased from 3.7% of inpatient deaths in 2008 to 20.6% in 2010 (P < .001). Conclusion Overreporting of heart disease as cause of death declined at intervention hospitals, driving a citywide decline, and sepsis reporting practices changed in accordance with health department training. Researchers should consider the effect of overreporting and data-quality changes when analyzing New York City heart disease mortality trends. Other vital records jurisdictions should employ similar interventions to improve cause-of-death reporting and use linked discharge data to monitor data quality.

A case study of the impact of inaccurate cause-of-death reporting on health disparity tracking: New York City premature cardiovascular mortality.

OBJECTIVES Heart disease death overreporting is problematic in New York City (NYC) and other US jurisdictions. We examined whether overreporting affects the premature (< 65 years) heart disease death rate disparity between non-Hispanic Blacks and non-Hispanic Whites in NYC. METHODS We identified overreporting hospitals and used counts of premature heart disease deaths at reference hospitals to estimate corrected counts. We then corrected citywide, age-adjusted premature heart disease death rates among Blacks and Whites and a White-Black premature heart disease death disparity. RESULTS At overreporting hospitals, 51% of the decedents were White compared with 25% at reference hospitals. Correcting the heart disease death counts at overreporting hospitals decreased the age-adjusted premature heart disease death rate 10.1% (from 41.5 to 37.3 per 100,000) among Whites compared with 4.2% (from 66.2 to 63.4 per 100,000) among Blacks. Correction increased the White-Black disparity 6.1% (from 24.6 to 26.1 per 100,000). CONCLUSIONS In 2008, NYCs White-Black premature heart disease death disparity was underestimated because of overreporting by hospitals serving larger proportions of Whites. Efforts to reduce overreporting may increase the observed disparity, potentially obscuring any programmatic or policy-driven advances.

Evaluating the Effectiveness of New York City Health Policy Initiatives in Reducing Cardiovascular Disease Mortality, 1990–2011

Beginning in 2002, New York City (NYC) implemented numerous policies and programs targeting cardiovascular disease (CVD) risk factors. Using death certificates, we analyzed trends in NYC-specific and US mortality rates from 1990 to 2011 for all causes, any CVD, atherosclerotic CVD (ACVD), coronary artery disease (CAD), and stroke. Joinpoint analyses quantified annual percent change (APC) and evaluated whether decreases in CVD mortality accelerated after 2002 in either NYC or the total US population. Our analyses included 1,149,217 NYC decedents. The rates of decline in mortality from all causes, any CVD, and stroke in NYC did not change after 2002. Among men, the decline in ACVD mortality accelerated during 2002-2011 (APC = -4.8%, 95% confidence interval (CI): -6.1, -3.4) relative to 1990-2001 (APC = -2.3%, 95% CI: -3.1, -1.5). Among women, ACVD rates began declining more rapidly in 1993 (APC = -3.2%, 95% CI: -3.8, -2.7) and again in 2006 (APC = -6.6%, 95% CI: -8.9, -4.3) as compared with 1990-1992 (APC = 1.6%, 95% CI: -2.7, 6.0). In the US population, no acceleration of mortality decline was observed in either ACVD or CAD mortality rates after 2002. Relative to 1990-2001, atherosclerotic CVD and CAD rates began to decline more rapidly during the 2002-2011 period in both men and women-a pattern not observed in the total US population, suggesting that NYC initiatives might have had a measurable influence on delaying or reducing ACVD mortality.

Evaluating the Use of an Electronic Death Registration System for Mortality Surveillance During and After Hurricane Sandy: New York City, 2012

OBJECTIVES We evaluated the use of New York Citys (NYCs) electronic death registration system (EDRS) to conduct mortality surveillance during and after Hurricane Sandy. METHODS We used Centers for Disease Control and Prevention guidelines for surveillance system evaluation to gather evidence on usefulness, flexibility, stability, timeliness, and quality. We assessed system components, interviewed NYC Health Department staff, and analyzed 2010 to 2012 death records. RESULTS Despite widespread disruptions, NYCs EDRS was stable and collected timely mortality data that were adapted to provide storm surveillance with minimal additional resources. Direct-injury fatalities and trends in excess all-cause mortality were rapidly identified, providing useful information for response; however, the time and burden of establishing reports, adapting the system, and identifying indirect deaths limited surveillance. CONCLUSIONS The NYC Health Department successfully adapted its EDRS for near real-time disaster-related mortality surveillance. Retrospective assessment of deaths, advanced methods for case identification and analysis, standardized reports, and system enhancements will further improve surveillance. Local, state, and federal partners would benefit from partnering with vital records to develop EDRSs for surveillance and to promote ongoing evaluation.

Evaluating New York City's abortion reporting system: insights for public health data collection systems.

CONTEXT New York City (NYC) mandates reporting of all abortion procedures. These reports enable tracking of abortion incidence and underpin programs, policy, and research. Since January 2011, the majority of abortion facilities must report electronically. OBJECTIVES We conducted an evaluation of NYCs abortion reporting system and its transition to electronic reporting. We summarize the evaluation methodology and results and draw lessons relevant to other vital statistics and public health reporting systems. DESIGN The evaluation followed Centers for Disease Control and Prevention guidelines for evaluating public health surveillance systems. We interviewed key stakeholders and conducted a data provider survey. In addition, we compared the systems abortion counts with external estimates and calculated the proportion of missing and invalid values for each variable on the report form. Finally, we assessed the process for changing the report form and estimated system costs. SETTING NYC Health Departments Bureau of Vital Statistics. MAIN OUTCOME MEASURES Usefulness, simplicity, flexibility, data quality, acceptability, sensitivity, timeliness, and stability of the abortion reporting system. RESULTS Ninety-five percent of abortion data providers considered abortion reporting important; 52% requested training regarding the report form. Thirty percent reported problems with electronic biometric fingerprint certification, and 18% reported problems with the electronic systems stability. Estimated system sensitivity was 88%. Of 17 variables, education and ancestry had more than 5% missing values in 2010. Changing the electronic reporting module was costly and time-consuming. System operating costs were estimated at

Assessing Electronic Death Registration and American Red Cross Systems for Mortality Surveillance During Hurricane Sandy, October 29–November 10, 2012, New York City

80 136 to

Improving Quality of Cause-of-Death Reporting in New York City

89 057 annually. CONCLUSIONS The NYC abortion reporting system is sensitive and provides high-quality data, but opportunities for improvement include facilitating biometric certification, increasing electronic platform stability, and conducting ongoing outreach and training for data providers. This evaluation will help data users determine the degree of confidence that should be placed on abortion data. In addition, the evaluation results are applicable to other vital statistics reporting and surveillance systems.