Justin McReynolds

Development and Evaluation of the Personal Patient Profile-Prostate (P3P), a Web-Based Decision Support System for Men Newly Diagnosed With Localized Prostate Cancer

Background Given that no other disease with the high incidence of localized prostate cancer (LPC) has so many treatments with so few certainties related to outcomes, many men are faced with assuming some responsibility for the treatment decision along with guidance from clinicians. Men strongly consider their own personal characteristics and other personal factors as important and influential to the decision. Clinical researchers have not developed or comprehensively investigated interventions to facilitate the insight and prioritizing of personal factors along with medical factors that are required of a man in preparation for the treatment decision. Objectives The purpose of this pilot study was to develop and evaluate the feasibility and usability of a Web-based decision support technology, the Personal Patient Profile-Prostate (P3P), in men newly diagnosed with LPC. Methods Use cases were developed followed by infrastructure and content application. The program was provided on a personal desktop computer with a touch screen monitor. Participant responses to the query component of P3P determined the content of the multimedia educational and coaching intervention. The intervention was tailored to race, age, and personal factors reported as influencing the decision. Prepilot usability testing was conducted using a “think aloud” interview to identify navigation and content challenges. These issues were addressed prior to deployment in the clinic. A clinical pilot was conducted in an academic medical center where men sought consultation and treatment for LPC. Completion time, missing data, and acceptability were measured. Results Prepilot testing included 4 men with a past diagnosis of LPC who had completed therapy. Technical navigation issues were documented along with confusing content language. A total of 30 additional men with a recent diagnosis of LPC completed the P3P program in clinic prior to consulting with a urologist regarding treatment options. In a mean time of 46 minutes (SD 13 minutes), participants completed the P3P query and intervention components. Of a possible 4560 items for 30 participants, 22 (0.5%) were missing. Acceptability was reported as high overall. The sections of the intervention reported as most useful were the statistics graphs, priority information topics, and annotated external website links. Conclusions The P3P intervention is a feasible and usable program to facilitate treatment decision making by men with newly diagnosed LPC. Testing in a multisite randomized trial with a diverse sample is warranted.

Development and usability testing of a web-based cancer symptom and quality-of-life support intervention:

The feasibility and acceptability of computerized screening and patient-reported outcome measures have been demonstrated in the literature. However, patient-centered management of health information entails two challenges: gathering and presenting data using “patient-tailored” methods and supporting “patient-control” of health information. The design and development of many symptom and quality-of-life information systems have not included opportunities for systematically collecting and analyzing user input. As part of a larger clinical trial, the Electronic Self-Report Assessment for Cancer–II project, participatory design approaches were used to build and test new features and interfaces for patient/caregiver users. The research questions centered on patient/caregiver preferences with regard to the following: (a) content, (b) user interface needs, (c) patient-oriented summary, and (d) patient-controlled sharing of information with family, caregivers, and clinicians. Mixed methods were used with an emphasis on qualitative approaches; focus groups and individual usability tests were the primary research methods. Focus group data were content analyzed, while individual usability sessions were assessed with both qualitative and quantitative methods. We identified 12 key patient/caregiver preferences through focus groups with 6 participants. We implemented seven of these preferences during the iterative design process. We deferred development for some of the preferences due to resource constraints. During individual usability testing (n = 8), we were able to identify 65 usability issues ranging from minor user confusion to critical errors that blocked task completion. The participatory development model that we used led to features and design revisions that were patient centered. We are currently evaluating new approaches for the application interface and for future research pathways. We encourage other researchers to adopt user-centered design approaches when building patient-centered technologies.

Types of Myocardial Infarction Among Human Immunodeficiency Virus-Infected Individuals in the United States

Importance The Second Universal Definition of Myocardial Infarction (MI) divides MIs into different types. Type 1 MIs result spontaneously from instability of atherosclerotic plaque, whereas type 2 MIs occur in the setting of a mismatch between oxygen demand and supply, as with severe hypotension. Type 2 MIs are uncommon in the general population, but their frequency in human immunodeficiency virus (HIV)–infected individuals is unknown. Objectives To characterize MIs, including type; identify causes of type 2 MIs; and compare demographic and clinical characteristics among HIV-infected individuals with type 1 vs type 2 MIs. Design, Setting, and Participants This longitudinal study identified potential MIs among patients with HIV receiving clinical care at 6 US sites from January 1, 1996, to March 1, 2014, using diagnoses and cardiac biomarkers recorded in the centralized data repository. Sites assembled deidentified packets, including physician notes and electrocardiograms, procedures, and clinical laboratory tests. Two physician experts adjudicated each event, categorizing each definite or probable MI as type 1 or type 2 and identifying the causes of type 2 MI. Main Outcomes and Measures The number and proportion of type 1 vs type 2 MIs, demographic and clinical characteristics among those with type 1 vs type 2 MIs, and the causes of type 2 MIs. Results Among 571 patients (median age, 49 years [interquartile range, 43-55 years]; 430 men and 141 women) with definite or probable MIs, 288 MIs (50.4%) were type 2 and 283 (49.6%) were type 1. In analyses of type 1 MIs, 79 patients who underwent cardiac interventions, such as coronary artery bypass graft surgery, were also included, totaling 362 patients. Sepsis or bacteremia (100 [34.7%]) and recent use of cocaine or other illicit drugs (39 [13.5%]) were the most common causes of type 2 MIs. A higher proportion of patients with type 2 MIs were younger than 40 years (47 of 288 [16.3%] vs 32 of 362 [8.8%]) and had lower current CD4 cell counts (median, 230 vs 383 cells/µL), lipid levels (mean [SD] total cholesterol level, 167 [63] vs 190 [54] mg/dL, and mean (SD) Framingham risk scores (8% [7%] vs 10% [8%]) than those with type 1 MIs or who underwent cardiac interventions. Conclusions and Relevance Approximately half of all MIs among HIV-infected individuals were type 2 MIs caused by heterogeneous clinical conditions, including sepsis or bacteremia and recent use of cocaine or other illicit drugs. Demographic characteristics and cardiovascular risk factors among those with type 1 and type 2 MIs differed, suggesting the need to specifically consider type among HIV-infected individuals to further understand MI outcomes and to guide prevention and treatment.

Exposure to a Patient-Centered, Web-Based Intervention for Managing Cancer Symptom and Quality of Life Issues: Impact on Symptom Distress

Background Effective eHealth interventions can benefit a large number of patients with content intended to support self-care and management of both chronic and acute conditions. Even though usage statistics are easily logged in most eHealth interventions, usage or exposure has rarely been reported in trials, let alone studied in relationship to effectiveness. Objective The intent of the study was to evaluate use of a fully automated, Web-based program, the Electronic Self Report Assessment-Cancer (ESRA-C), and how delivery and total use of the intervention may have affected cancer symptom distress. Methods Patients at two cancer centers used ESRA-C to self-report symptom and quality of life (SxQOL) issues during therapy. Participants were randomized to ESRA-C assessment only (control) or the ESRA-C intervention delivered via the Internet to patients’ homes or to a tablet at the clinic. The intervention enabled participants to self-monitor SxQOL and receive self-care education and customized coaching on how to report concerns to clinicians. Overall and voluntary intervention use were defined as having ≥2 exposures, and one non-prompted exposure to the intervention, respectively. Factors associated with intervention use were explored with Fisher’s exact test. Propensity score matching was used to select a sample of control participants similar to intervention participants who used the intervention. Analysis of covariance (ANCOVA) was used to compare change in Symptom Distress Scale (SDS-15) scores from pre-treatment to end-of-study by groups in the matched sample. Results Radiation oncology participants used the intervention, overall and voluntarily, more than medical oncology and transplant participants. Participants who were working and had more than a high school education voluntarily used the intervention more. The SDS-15 score was reduced by an estimated 1.53 points (P=.01) in the intervention group users compared to the matched control group. Conclusions The intended effects of a Web-based, patient-centered intervention on cancer symptom distress were modified by intervention use frequency. Clinical and personal demographics influenced voluntary use. Trial Registration Clinicaltrials.gov NCT00852852; http://clinicaltrials.gov/ct2/show/NCT00852852 (Archived by WebCite at http://www.webcitation.org/6YwAfwWl7).

Lessons Learned From the Design and Implementation of Myocardial Infarction Adjudication Tailored for HIV Clinical Cohorts

We developed, implemented, and evaluated a myocardial infarction (MI) adjudication protocol for cohort research of human immunodeficiency virus. Potential events were identified through the centralized Centers for AIDS Research Network of Integrated Clinical Systems data repository using MI diagnoses and/or cardiac enzyme laboratory results (1995-2012). Sites assembled de-identified packets, including physician notes and results from electrocardiograms, procedures, and laboratory tests. Information pertaining to the specific antiretroviral medications used was redacted for blinded review. Two experts reviewed each packet, and a third review was conducted if discrepancies occurred. Reviewers categorized probable/definite MIs as primary or secondary and identified secondary causes of MIs. The positive predictive value and sensitivity for each identification/ascertainment method were calculated. Of the 1,119 potential events that were adjudicated, 294 (26%) were definite/probable MIs. Almost as many secondary (48%) as primary (52%) MIs occurred, often as the result of sepsis or cocaine use. Of the patients with adjudicated definite/probable MIs, 78% had elevated troponin concentrations (positive predictive value = 57%, 95% confidence interval: 52, 62); however, only 44% had clinical diagnoses of MI (positive predictive value = 45%, 95% confidence interval: 39, 51). We found that central adjudication is crucial and that clinical diagnoses alone are insufficient for ascertainment of MI. Over half of the events ultimately determined to be MIs were not identified by clinical diagnoses. Adjudication protocols used in traditional cardiovascular disease cohorts facilitate cross-cohort comparisons but do not address issues such as identifying secondary MIs that may be common in persons with human immunodeficiency virus.

Unannounced Telephone-Based Pill Counts: A Valid and Feasible Method for Monitoring Adherence

Phone-based unannounced pill counts to measure medication adherence are much more practical and less expensive than home-based unannounced pill counts, but their validity has not been widely assessed. We examined the validity of phone versus home-based pill counts using a simplified protocol streamlined for studies embedded in clinical care settings. A total of 100 paired counts were used to compare concordance between unannounced phone and home-based pill counts using interclass correlations. Discrepancy analyses using χ2 tests compared demographic and clinical characteristics across patients who were concordant between phone and home-based pill counts and patients who were not concordant. Concordance was high for phone-based and home-based unannounced total pill counts, as well as individual medication counts and calculated adherence. This study demonstrates that a simplified phone-based pill count protocol can be implemented among patients from a routine clinical care setting and is a feasible means of monitoring medication adherence.ResumenLos conteos no anunciados de comprimidos por teléfono, con el propósito de medir el cumplimiento con respecto a los medicamentos, es mucho más práctico y menos costoso que los conteos no anunciados de comprimidos en el hogar, pero su validez no se ha evaluado en forma amplia. Examinamos la validez de los conteos no anunciados de comprimidos en el hogar, mediante el uso de un protocolo racionalizado para estudios integrados en ambientes de atención clínica. Un total de 100 conteos en pares se usaron para comparar la concordancia entre los conteos no anunciados de comprimidos por teléfono y en el hogar con correlaciones entre clases. Los análisis de discrepancia mediante pruebas χ2 compararon características demográficas y clínicas en los pacientes que fueron concordantes entre los conteos de comprimidos por teléfono y en el hogar y los pacientes que no fueron concordantes. Hubo una alta concordancia para los conteos no anunciados totales de comprimidos por teléfono y en el hogar, al igual que para los conteos de medicamentos individuales y para el cumplimiento calculado. Este estudio demuestra que se puede implementar un protocolo simplificado de conteo de comprimidos por teléfono entre los pacientes de un entorno de atención clínica de rutina y que es un medio factible para controlar el cumplimiento con respecto a los medicamentos.

Provider perceptions of the value of same-day, electronic patient-reported measures for use in clinical HIV care

ABSTRACT Strong evidence suggests that patient-reported outcomes (PROs) aid in managing chronic conditions, reduce omissions in care, and improve patient–provider communication. However, provider acceptability of PROs and their use in clinical HIV care is not well known. We interviewed providers (n = 27) from four geographically diverse HIV and community care clinics in the US that have integrated PROs into routine HIV care, querying perceived value, challenges, and use of PRO data. Perceived benefits included the ability of PROs to identify less-observable behaviors and conditions, particularly suicidal ideation, depression, and substance use; usefulness in agenda setting prior to a visit; and reduction of social desirability bias in patient–provider communication. Challenges included initial flow integration issues and ease of interpretation of PRO feedback. Providers value same-day, electronic patient-reported measures for use in clinical HIV care with the condition that PROs are (1) tailored to be the most clinically relevant to their population; (2) well integrated into clinic flow; and (3) easy to interpret, highlighting chief patient concerns and changes over time.

Ascertainment and Verification of End-Stage Renal Disease and End-Stage Liver Disease in the North American AIDS Cohort Collaboration on Research and Design

The burden of HIV disease has shifted from traditional AIDS-defining illnesses to serious non-AIDS-defining comorbid conditions. Research aimed at improving HIV-related comorbid disease outcomes requires well-defined, verified clinical endpoints. We developed methods to ascertain and verify end-stage renal disease (ESRD) and end-stage liver disease (ESLD) and validated screening algorithms within the largest HIV cohort collaboration in North America (NA-ACCORD). Individuals who screened positive among all participants in twelve cohorts enrolled between January 1996 and December 2009 underwent medical record review to verify incident ESRD or ESLD using standardized protocols. We randomly sampled 6% of contributing cohorts to determine the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of ESLD and ESRD screening algorithms in a validation subcohort. Among 43,433 patients screened for ESRD, 822 screened positive of which 620 met clinical criteria for ESRD. The algorithm had 100% sensitivity, 99% specificity, 82% PPV, and 100% NPV for ESRD. Among 41,463 patients screened for ESLD, 2,024 screened positive of which 645 met diagnostic criteria for ESLD. The algorithm had 100% sensitivity, 95% specificity, 27% PPV, and 100% NPV for ESLD. Our methods proved robust for ascertainment of ESRD and ESLD in persons infected with HIV.

Technical Description of the Distribute Project: A Community-based Syndromic Surveillance System Implementation.

This paper describes the design of a syndromic surveillance system implemented for community-based monitoring of influenza-like illness. The system began as collaboration between colleagues from state and large metropolitan area health jurisdictions, academic institutions, and the non-profit, International Society for Disease Surveillance. Over the six influenza seasons from 2006 to 2012, the system was automated and enhanced, with new features and infrastructure, and the resulting, reliable, enterprise grade system supported peer comparisons between 44 state and local public health jurisdictions who voluntarily contributed summarized data on influenza-like illness and gastrointestinal syndromes. The system was unusual in that it addressed the needs of a widely distributed, voluntary, community engaged in real-time data integration to support operational public health.

Usability Testing the "Personal Patient Profile-Prostate" in a Sample of African American and Hispanic Men.

Shared treatment decision making in a cancer setting requires a patients understanding of the potential benefits and risks of each treatment option. Graphical display of risk information is one approach to improving understanding. Little is known about how patients engage with infographics in the context of health education materials and whether interactions vary with health literacy levels. We conducted an observational study, using an eye tracker device, of how men with newly diagnosed localized prostate cancer visually engaged with an on-screen infographic depicting risk information in the Personal Patient Profile–Prostate. Health literacy was measured with the Short Assessment of Health Literacy–English. Gaze patterns on an exemplar screens containing infographics about survival were analyzed and explored with respect to sociodemographic and health literacy data. Acceptability of Personal Patient Profile–Prostate was measured with the Acceptability E-scale. Twenty-six English-speaking men participated, and eye tracking data were collected for 12 men on the exemplar page of risk information that we analyzed. We found preliminary evidence of visual scanning and of participants with lower literacy focusing sooner on infographics versus text. Acceptability for Personal Patient Profile–Prostate was high. These findings suggest that infographics may be of higher relative value to participants with low health literacy. Eye trackers may provide valuable information on how people visually engage with infographics and may inform development of health education materials, although care must be taken to minimize data loss.