Alison M. Edwards

Accuracy of Electronically Reported “Meaningful Use” Clinical Quality Measures: A Cross-sectional Study

BACKGROUND The federal Electronic Health Record Incentive Program requires electronic reporting of quality from electronic health records, beginning in 2014. Whether electronic reports of quality are accurate is unclear. OBJECTIVE To measure the accuracy of electronic reporting compared with manual review. DESIGN Cross-sectional study. SETTING A federally qualified health center with a commercially available electronic health record. PATIENTS All adult patients eligible in 2008 for 12 quality measures (using 8 unique denominators) were identified electronically. One hundred fifty patients were randomly sampled per denominator, yielding 1154 unique patients. MEASUREMENTS Receipt of recommended care, assessed by both electronic reporting and manual review. Sensitivity, specificity, positive and negative predictive values, positive and negative likelihood ratios, and absolute rates of recommended care were measured. RESULTS Sensitivity of electronic reporting ranged from 46% to 98% per measure. Specificity ranged from 62% to 97%, positive predictive value from 57% to 97%, and negative predictive value from 32% to 99%. Positive likelihood ratios ranged from 2.34 to 24.25 and negative likelihood ratios from 0.02 to 0.61. Differences between electronic reporting and manual review were statistically significant for 3 measures: Electronic reporting underestimated the absolute rate of recommended care for 2 measures (appropriate asthma medication [38% vs. 77%; P < 0.001] and pneumococcal vaccination [27% vs. 48%; P < 0.001]) and overestimated care for 1 measure (cholesterol control in patients with diabetes [57% vs. 37%; P = 0.001]). LIMITATION This study addresses the accuracy of the measure numerator only. CONCLUSION Wide measure-by-measure variation in accuracy threatens the validity of electronic reporting. If variation is not addressed, financial incentives intended to reward high quality may not be given to the highest-quality providers. PRIMARY FUNDING SOURCE Agency for Healthcare Research and Quality.

Chronic Kidney Disease, Thrombotic Microangiopathy, and Hypertension Following T Cell-Depleted Hematopoietic Stem Cell Transplantation

Chronic kidney disease (CKD) is now an accepted long-term complication of allogeneic hematopoietic stem cell transplantation. Calcineurin inhibitors (CNI), which are used for prophylaxis and treatment of graft-versus-host disease (GVHD), have been associated with the development of nephrotoxicity. Hypertension (HTN) and thrombotic microangiopathy (TMA) are 2 comorbidities linked to CKD. T cell depletion (TCD) of stem cell grafts can obviate the need for the use of CNI. We conducted a retrospective analysis of 100 patients who underwent TCD transplantation: 30 in group A were conditioned without total-body radiation (TBI) and 70 in group B received a TBI containing regimen. None of the patients received CNI. The median age was 55.5 and 45 years for groups A and B, respectively. Eleven patients developed TMA, all in group B. The 2-year cumulative incidence of sustained CKD was 29.2% and 48.8% in group A and group B, respectively, with a mean follow-up of at least 21 months. CKD free survival was better in the non-TBI group (P = .046). Multivariable survival analysis revealed that exposure to TBI, older age, and TMA were risk factors for CKD. The incidence of new onset or worsening HTN was 6.7% and 25.7% (P = .03) in group A and B, respectively. The use of TBI (P = .0182) and diagnosis of TMA (P = .0006) predisposed patients to the development of HTN using univariable logistic regression models. Thus, despite the absence of CNI, a proportion of these older patients in both groups developed CKD and HTN.

Health Care Consumers’ Preferences Around Health Information Exchange

PURPOSE Consumer buy-in is important for the success of widespread federal initiatives to promote the use of health information exchange (HIE). Little is known, however, of consumers’ preferences around the storing and sharing of electronic health information. We conducted a study to better understand consumer preferences regarding the privacy and security of HIE. METHODS In 2008 we conducted a cross-sectional, random digit dial telephone survey of residents in the Hudson Valley of New York State, a state where patients must affirmatively consent to having their data accessed through HIE. RESULTS There was an 85% response rate (N = 170) for the survey. Most consumers would prefer that permission be obtained before various parties, including their clinician, could view their health information through HIE. Most consumers wanted any method of sharing their health information to have safeguards in place to protect against unauthorized viewing (86%). They also wanted to be able to see who has viewed their information (86%), to stop electronic storage of their data (84%), to stop all viewing (83%), and to select which parts of their health information are shared (78%). Among the approximately one-third (n = 54) of consumers who were uncomfortable with automatic inclusion of their health information in an electronic database for HIE, 78% wished to approve all information explicitly, and most preferred restricting information by clinician (83%), visit (81%), or information type (88%). CONCLUSION Consumers in a state with an opt-in consent policy are interested in having greater control over the privacy and security of their electronic health information. These preferences should be considered when developing and implementing systems, standards and policies.

Health information exchange system usage patterns in three communities: Practice sites, users, patients, and data

OBJECTIVES Public and private organizations are implementing systems for query-based health information exchange (HIE), the electronic aggregation of patient data from multiple institutions. However, existing studies of query-based HIE system usage have addressed a limited number of settings. Our goal was to quantify the breadth and depth of usage of a query-based HIE system implemented across multiple communities with diverse care settings and patient populations. METHODS We performed a cross-sectional study in three communities in New York State using system access log files from January 2009 to May 2011 to measure usage patterns of a query-based HIE web portal system with respect to practice sites, users, patients, and data. RESULTS System access occurred from 60% (n=200) of practice sites registered to use the system in Community A, 59% (n=156) in Community B, and 82% (n=28) in Community C. In Communities A and B, users were primarily non-clinical staff in outpatient settings, while in Community C inpatient physicians were the main users. Across communities, proportions of patients whose data were accessed varied with 5% (n=11,263) in Community A, 60% (n=212,586) in Community B, and 1% (n=1107) in Community C. In Community B, users updated patient consent through the HIE portal, whereas in the other communities, users updated patient consent through a separate system. Across communities, users most frequently accessed only patient summary data displayed by default followed by detailed laboratory and radiology data. CONCLUSIONS This study is among the first to illustrate large-scale usage of a query-based HIE system implemented across multiple communities. Patient summary data displayed by default may be an important feature of query-based HIE systems. User role, practice site type, and patient consent workflow may affect patterns of query-based HIE web portal system usage in the communities studied and elsewhere.

Electronic health records and health care quality over time in a federally qualified health center

The longitudinal effects of electronic health records (EHRs) on ambulatory quality are not clear. It is not known whether adoption and meaningful use of EHRs result in a brief period of quality improvement that then plateaus, or whether with ongoing use quality improvement continues. We studied health care quality at six sites of a Federally Qualified Health Center in New York State over 3 years (2008-2010) for 25 290 unique patients. Patients were twice as likely to receive recommended care on a set of 12 quality measures (11 of which are included in Stage 1 Meaningful Use) 3 years post-EHR implementation, compared to 1-year post-implementation (odds ratio 1.97; 95% confidence interval, 1.91-2.03). The magnitude of absolute improvement ranged from 5% to 20% per measure. EHRs were associated with continuing improvement in health care quality for at least 3 years post-implementation in the safety-net setting of a Federally Qualified Health Center.