Jo Ann Shoup

The RE-AIM Framework: A Systematic Review of Use Over Time

We provided a synthesis of use, summarized key issues in applying, and highlighted exemplary applications in the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. We articulated key RE-AIM criteria by reviewing the published literature from 1999 to 2010 in several databases to describe the application and reporting on various RE-AIM dimensions. After excluding nonempirical articles, case studies, and commentaries, 71 articles were identified. The most frequent publications were on physical activity, obesity, and disease management. Four articles reported solely on 1 dimension compared with 44 articles that reported on all 5 dimensions of the framework. RE-AIM was broadly applied, but several criteria were not reported consistently.

Validation of a survey instrument to assess home environments for physical activity and healthy eating in overweight children.

BackgroundFew measures exist to measure the overall home environment for its ability to support physical activity (PA) and healthy eating in overweight children. The purpose of this study was to develop and test the reliability and validity of such a measure.MethodsThe Home Environment Survey (HES) was developed to reflect availability, accessibility, parental role modelling, and parental policies related to PA resources, fruits and vegetables (F&V), and sugar sweetened drinks and snacks (SS). Parents of overweight children (n = 219) completed the HES and concurrent behavioural assessments. Children completed the Block Kids survey and wore an accelerometer for one week. A subset of parents (n = 156) completed the HES a second time to determine test-retest reliability. Finally, 41 parent dyads living in the same home (n = 41) completed the survey to determine inter-rater reliability. Initial psychometric analyses were completed to trim items from the measure based on lack of variability in responses, moderate or higher item to scale correlation, or contribution to strong internal consistency. Inter-rater and test-retest reliability were completed using intraclass correlation coefficients. Validity was assessed using Pearson correlations between the HES scores and child and parent nutrition and PA.ResultsEight items were removed and acceptable internal consistency was documented for all scales (α = .66–84) with the exception of the F&V accessibility. The F&V accessibility was reduced to a single item because the other two items did not meet reliability standards. Test-retest reliability was high (r > .75) for all scales. Inter-rater reliability varied across scales (r = .22–.89). PA accessibility, parent role modelling, and parental policies were all related significantly to child (r = .14–.21) and parent (r = .15–.31) PA. Similarly, availability of F&V and SS, parental role modelling, and parental policies were related to child (r = .14–36) and parent (r = .15–26) eating habits.ConclusionThe HES shows promise as a potentially valid and reliable assessment of the physical and social home environment related to a childs physical activity and eating habits.

A systematic review of collaboration and network research in the public affairs literature: implications for public health practice and research.

OBJECTIVES We explored and analyzed how findings from public affairs research can inform public health research and practice, specifically in the area of interorganizational collaboration, one of the most promising practice-based approaches in the public health field. METHODS We conducted a systematic review of the public affairs literature by following a grounded theory approach. We coded 151 articles for demographics and empirical findings (n = 258). RESULTS Three primary findings stand out in the public affairs literature: network structure affects governance, management strategies exist for administrators, and collaboration can be linked to outcomes. These findings are linked to priorities in public health practice. CONCLUSIONS Overall, we found that public affairs has a long and rich history of research in collaborations that offers unique organizational theory and management tools to public health practitioners.

Automated Telephone Counseling for Parents of Overweight Children A Randomized Controlled Trial

BACKGROUND Interactive technologies have the potential to increase the reach and frequency of practical clinical interventions that assist the parents of overweight and at-risk children to promote healthy lifestyle behaviors for their families. DESIGN A practical RCT evaluated the relative effectiveness of three interventions to support parents of overweight or at-risk children to change the home environment to foster more healthful child eating and activity behaviors, thereby reducing child BMI and BMI z-scores. A secondary purpose was to determine the patterns of use and potential dose effect for the highest-intensity intervention. SETTING/PARTICIPANTS Parent-and-child (aged 8-12 years) dyads (N=220) who received care from Kaiser Permanente Colorado were assigned randomly to one of the three Family Connections (FC) interventions: FC-workbook, FC-group, or FC-interactive voice response (IVR) counseling. MAIN OUTCOME MEASURES Child BMI z-scores, as well as symptoms of eating disorders and body image, were assessed at baseline, 6 months, and 12 months. RESULTS The BMI z-scores of children assigned to the FC-IVR intervention were the only ones that decreased from baseline to 6 months (0.07 SD) and from baseline to 12 months (0.08 SD, p<0.05). Children whose parents completed at least six of the ten FC-IVR counseling calls had decreased BMI z-scores to a greater extent than children in the FC-workbook or FC-group interventions at both 6 months (p<0.05) and 12 months (p<0.01). No intervention increased child symptoms of eating disorders or body dissatisfaction at any time point. CONCLUSIONS This trial demonstrated that automated telephone counseling can support the parents of overweight children to reduce the extent to which their children are overweight. TRIAL REGISTRATION NCT00433901.

Accuracy of Data on Influenza Vaccination Status at Four Vaccine Safety Datalink Sites

BACKGROUND Studies of influenza vaccination using electronic medical records rely on accurate classification of vaccination status. Vaccinations not entered into electronic records would be unavailable for study. PURPOSE This study evaluated the sensitivity and negative predictive value (NPV) of electronic records for influenza vaccination and factors associated with failure to capture vaccinations. METHODS In four diverse medical care organizations in the Vaccine Safety Datalink, those aged 50-79 years with no influenza vaccination record during the 2007-2008 season were surveyed by telephone, and electronic records were analyzed in 2008. The sensitivity and NPV of electronic records were estimated, using survey responses as the gold standard. Logistic regression models determined associations between 1-NPV and demographic factors, risk of influenza complications, and healthcare utilization levels. RESULTS Data were obtained for 933 survey participants and 1,085,916 medical care organization members. Sites varied significantly in the sensitivity (51%, 68%, 79%, 89%) and NPV (46%, 62%, 66%, 87%) of electronic records. In multivariate analysis, the rate of failure to capture vaccinations was significantly higher for those aged 65-79 years than for those aged 50-64 years at three sites. Of vaccinations not captured by electronic records, 58% were reportedly administered in nontraditional settings, usually workplaces; the rest were given within the sites. CONCLUSIONS Influenza vaccination studies relying on electronic records may misclassify substantial proportions of vaccinated individuals as unvaccinated, producing biased estimates of vaccine effectiveness. Sites with limited sensitivity to capture vaccinations administered within their organization should seek possible remedies. More complete capture of vaccinations administered to older patients and in nontraditional settings would further reduce misclassification.

Association of Patient-Centered Outcomes With Patient-Reported and ICD-9–Based Morbidity Measures

PURPOSE Evaluating patient-centered care for complex patients requires morbidity measurement appropriate for use with a variety of clinical outcomes. We compared the contributions of self-reported morbidity and morbidity measured using administrative diagnosis data for both patient-reported outcomes and utilization outcomes. METHODS Using a cohort of 961 persons aged 65 years or older with 3 or more medical conditions, we explored 9 health outcomes as a function of 4 independent variables representing different types of morbidity measures: International Classification of Diseases, Ninth Revision (ICD-9), a self-reported weighted count of conditions, and self-reported symptoms of depression and of anxiety. Outcomes varied from self-reported health status to utilization. Depending on the outcome measure, we used multivariate linear, negative binomial, or logistic regression, adjusting for demographic characteristics and length of enrollment to assess associations between dependent and all 4 independent variables. RESULTS Higher morbidity measured by ICD-9 diagnoses was independently associated with less favorable levels of 7 of the 9 clinical outcomes. Higher self-reported disease burden was significantly associated with less favorable levels of 8 of the outcomes, controlling for the 3 other morbidity measures. Morbidity measured by diagnosis code was more strongly associated with higher utilization, whereas self-reported disease burden and emotional symptoms were more strongly associated with patient-reported outcomes. CONCLUSIONS A comprehensive assessment of morbidity requires both subjective and objective measurement of disease burden as well as an assessment of emotional symptoms. Such multidimensional morbidity measurement is particularly relevant for research or quality assessments involving the delivery of patient-centered care to complex patient populations.

Effect of continuity of care on hospital utilization for seniors with multiple medical conditions in an integrated health care system.

PURPOSE Lower continuity of care has been associated with higher rates of adverse outcomes for persons with multiple chronic medical conditions. It is unclear, however, whether this relationship also exists within integrated systems that offer high levels of informational continuity through shared electronic health records. METHODS We conducted a retrospective cohort study of 12,200 seniors with 3 or more chronic conditions within an integrated delivery system. Continuity of care was calculated using the Continuity of Care Index, which reflects visit concentration with individual clinicians. Using Cox proportional hazards regression permitting continuity to vary monthly until the outcome or censoring event, we separately assessed inpatient admissions and emergency department visits as a function of primary care continuity and specialty care continuity. RESULTS After adjusting for covariates (demographics; baseline, primary, and specialty care visits; baseline outcomes; and morbidity burden), greater primary care continuity and greater specialty care continuity were each associated with a lower risk of inpatient admission (respective hazard ratios (95% CIs) = 0.97 (0.96, 0.99) and 0.95 (0.93, 0.98)) and a lower risk of emergency department visits (respective hazard ratios = 0.97 (0.96, 0.98) and 0.98 (0.96, 1.00)). For the subgroup with 3 or more primary care and 3 or more specialty care visits, specialty care continuity (but not primary care continuity) was independently associated with a decreased risk of inpatient admissions (hazard ratio = 0.94 (0.92, 0.97)), and primary care continuity (but not specialty care continuity) was associated with a decreased risk of emergency department visits (hazard ratio = 0.98 (0.96, 1.00)). CONCLUSIONS In an integrated delivery system with high informational continuity, greater continuity of care is independently associated with lower hospital utilization for seniors with multiple chronic medical conditions. Different subgroups of patients will benefit from continuity with primary and specialty care clinicians depending on their care needs.

Timely versus delayed early childhood vaccination and seizures

BACKGROUND: Little is known regarding the timing of childhood vaccination and postvaccination seizures. METHODS: In a cohort of 323 247 US children from the Vaccine Safety Datalink born from 2004 to 2008, we analyzed the association between the timing of childhood vaccination and the first occurrence of seizure with a self-controlled case series analysis of the first doses of individual vaccines received in the first 2 years of life. RESULTS: In infants, there was no association between the timing of infant vaccination and postvaccination seizures. In the second year of life, the incident rate ratio (IRR) for seizures after receipt of the first measles-mumps-rubella vaccine (MMR) dose at 12 to 15 months was 2.65 (95% confidence interval [CI] 1.99–3.55); the IRR after an MMR dose at 16 to 23 months was 6.53 (95% CI 3.15–13.53). The IRR for seizures after receipt of the first measles-mumps-rubella-varicella vaccine (MMRV) dose at 12 to 15 months was 4.95 (95% CI 3.68–6.66); the IRR after an MMRV dose at 16 to 23 months was 9.80 (95% CI 4.35 –22.06). CONCLUSIONS: There is no increased risk of postvaccination seizure in infants regardless of timing of vaccination. In year 2, delaying MMR vaccine past 15 months of age results in a higher risk of seizures. The strength of the association is doubled with MMRV vaccine. These findings suggest that on-time vaccination is as safe with regard to seizures as delayed vaccination in the first year of life, and that delayed vaccination in the second year of life is associated with more postvaccination seizures than on-time vaccination.

Development of an Interactive Social Media Tool for Parents With Concerns About Vaccines

Objective. Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. Method. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Results. Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool’s content, design, functionality, and overall look and feel. Conclusion. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial.

Parental Choice of Recall Method for HPV Vaccination: A Pragmatic Trial.

OBJECTIVES: Completion rates for the human papillomavirus vaccine (HPV) series among adolescents remain low. Effectiveness of recall with parents choosing the method (preference-based recall) for increasing HPV series completion is unstudied. Within a cluster-randomized trial, we examined effectiveness of preference-based recall compared with usual care for increasing series completion and the association of recall choices with completion. METHODS: All Kaiser Permanente Colorado pediatric practices (n = 7) were randomized to intervention (n = 4) or control (n = 3) by using covariate-constrained randomization. From January to June 2013, parents at intervention practices whose adolescents received HPV 1 were asked the recall method they preferred for subsequent doses and if they also wanted their child reminded. Completion rates were assessed 1 year after HPV 1. RESULTS: At intervention practices, 374 (43%) of 867 patients were enrolled; 39% preferred text, 18% e-mail, 9% auto-dialer, and 34% 2-methods; 19% chose to have adolescent also recalled. Intervention adolescents were more likely to complete (63% vs 38%) than were controls (adjusted risk ratio 1.47 [1.38–1.57]) and less likely to be late in completing the series (45% vs 57%, P = .02). Rates of completion were similar between different recall methods, but significantly higher for those preferring e-mail and phone compared withother methods (90% vs 60%. P = .008). Completion rates were similar for adolescents who also received recalls (62%) versus those who did not (63%). CONCLUSIONS: Preference-based recall was effective in increasing HPV series completion rates, with point estimates substantially higher than for most published studies of reminder/recall.