Julie Lucero

Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures

Community-based participatory research (CBPR) has been widely used in public health research in the last decade as an approach to develop culturally centered interventions and collaborative research processes in which communities are directly involved in the construction and implementation of these interventions and in other application of findings. Little is known, however, about CBPR pathways of change and how these academic-community collaborations may contribute to successful outcomes. A new health CBPR conceptual model (Wallerstein N, Oetzel JG, Duran B et al. CBPR: What predicts outcomes? In: Minkler M, Wallerstein N (eds). Communication Based Participatory Research, 2nd edn. San Francisco, CA: John Wiley & Co., 2008) suggests that relationships between four components: context, group dynamics, the extent of community-centeredness in intervention and/or research design and the impact of these participatory processes on CBPR system change and health outcomes. This article seeks to identify instruments and measures in a comprehensive literature review that relates to these distinct components of the CBPR model and to present them in an organized and indexed format for researcher use. Specifically, 258 articles were identified in a review of CBPR (and related) literature from 2002 to 2008. Based on this review and from recommendations of a national advisory board, 46 CBPR instruments were identified and each was reviewed and coded using the CBPR logic model. The 46 instruments yielded 224 individual measures of characteristics in the CBPR model. While this study does not investigate the quality of the instruments, it does provide information about reliability and validity for specific measures. Group dynamics proved to have the largest number of identified measures, while context and CBPR system and health outcomes had the least. Consistent with other summaries of instruments, such as Granner and Sharpes inventory (Granner ML, Sharpe PA. Evaluating community coalition characteristics and functioning: a summary of measurement tools. Health Educ Res 2004; 19: 514-32), validity and reliability information were often lacking, and one or both were only available for 65 of the 224 measures. This summary of measures provides a place to start for new and continuing partnerships seeking to evaluate their progress.

Evaluating Community-Based Participatory Research to Improve Community-Partnered Science and Community Health

Background: Since 2007, the National Congress of American Indians (NCAI) Policy Research Center (PRC) has partnered with the Universities of New Mexico and Washington to study the science of community-based participatory research (CBPR). Our goal is to identify facilitators and barriers to effective community-academic partnerships in American Indian and other communities, which face health disparities.Objectives: We have described herein the scientific design of our National Institutes of Health (NIH)-funded study (2009-2013) and lessons learned by having a strong community partner leading the research efforts.Methods: The research team is implementing a mixed-methods study involving a survey of principal investigators (PIs) and partners across the nation and in-depth case studies of CBPR projects.Results: We present preliminary findings on methods and measures for community-engaged research and eight lessons learned thus far regarding partnership evaluation, advisory councils, historical trust, research capacity development of community partner, advocacy, honoring each other, messaging, and funding.Conclusions: Study methodologies and lessons learned can help community-academic research partnerships translate research in communities.

Obstacles for rural American Indians seeking alcohol, drug, or mental health treatment

The purpose of this study was to identify factors associated with 4 clusters of obstacles (self-reliance, privacy issues, quality of care, and communication and trust) to mental health and substance abuse treatment in 3 treatment sectors for residents of 3 reservations in the United States. Participants (N=3,084) disclosed whether they had sought treatment for emotional, drug, or alcohol problems in the past year and, if so, whether they had faced obstacles in obtaining care from Indian Health Services, tribal services, and other public or private systems. Correlates of these obstacles included negative social support, instrumental social support, utility of counselors, utility of family doctors, treatment sector, treatment type, diagnosis of an anxiety disorder, and tribe.

Community-Based Participatory Research Conceptual Model Community Partner Consultation and Face Validity

A national community-based participatory research (CBPR) team developed a conceptual model of CBPR partnerships to understand the contribution of partnership processes to improved community capacity and health outcomes. With the model primarily developed through academic literature and expert consensus building, we sought community input to assess face validity and acceptability. Our research team conducted semi-structured focus groups with six partnerships nationwide. Participants validated and expanded on existing model constructs and identified new constructs based on “real-world” praxis, resulting in a revised model. Four cross-cutting constructs were identified: trust development, capacity, mutual learning, and power dynamics. By empirically testing the model, we found community face validity and capacity to adapt the model to diverse contexts. We recommend partnerships use and adapt the CBPR model and its constructs, for collective reflection and evaluation, to enhance their partnering practices and achieve their health and research goals.

Using Motivational Interviewing to Promote HIV Testing at an American Indian Substance Abuse Treatment Facility

Abstract Alcohol and drug use are associated with increased risk of HIV/AIDS. American Indians and Alaska Natives (AI/AN) have high rates of alcohol and other drug use, as well as a high incidence of unsafe sex behaviors and injection drug use practices. Indicators of AI/AN HIV risks involving sexual activity include high rates of STDs, such as gonorrhea, chlamydia, and syphilis. Despite these facts, the prevalence of HIV infection among AI/AN is not well known. The present study is part of a HRSA-funded SPNS HIV/AIDS health initiative, one goal of which is to increase the number of HIV-positive individuals who know their HIV status. To meet the goal of the SPNS project, patients in an inpatient alcohol and drug treatment center were provided with an HIV prevention educational presentation followed by one-on-one HIV counseling. Motivational interviewing was used in the counseling sessions to aid participants in recognizing their risk status and making a decision to be HIV tested. Results show that of the 134 who agreed to one-on-one HIV counseling and 105 (78%) returned for their results.

Social Support and Social Undermining as Correlates for Alcohol, Drug, and Mental Disorders in American Indian Women Presenting for Primary Care at an Indian Health Service Hospital

The purpose of this study was to determine the relationship of two types of social support (emotional and instrumental) and two types of social undermining (critical appraisal and isolation) with five categories of alcohol, drug, or mental disorders (ADM; any mood, any anxiety, any substance abuse, any disorder, and two or more disorders) in 169 American Indian women presenting for primary care at an Indian Health Service facility. Social support and social undermining are often treated as opposite poles, but in fact they are distinct factors with independent effects. The findings illustrate that social support and undermining variables have a significant relationship with ADM outcomes even when controlling for confounding demographic variables. Any substance abuse was associated with all four social variables, while two or more disorders were associated with instrumental support and isolation. Any anxiety (isolation), any mood (critical appraisal), and any disorder (isolation) were each associated with one social variable. Overall, social undermining appears to have a stronger relationship with mental health than with social support.

Development of a Mixed Methods Investigation of Process and Outcomes of Community-Based Participatory Research:

This article describes a mixed methods study of community-based participatory research (CBPR) partnership practices and the links between these practices and changes in health status and disparities outcomes. Directed by a CBPR conceptual model and grounded in indigenous-transformative theory, our nation-wide, cross-site study showcases the value of a mixed methods approach for better understanding the complexity of CBPR partnerships across diverse community and research contexts. The article then provides examples of how an iterative, integrated approach to our mixed methods analysis yielded enriched understandings of two key constructs of the model: trust and governance. Implications and lessons learned while using mixed methods to study CBPR are provided.

Establishing the Psychometric Properties of Constructs in a Community-Based Participatory Research Conceptual Model

Purpose. The purpose of this study is to establish the psychometric properties of 22 measures from a community-based participatory research (CBPR) conceptual model. Design. The design of this study was an online, cross-sectional survey of academic and community partners involved in a CPBR project. Setting. CPBR projects (294) in the United States with federal funding in 2009. Subjects. Of the 404 academic and community partners invited, 312 (77.2%) participated. Of the 200 principal investigators/project directors invited, 138 (69.0%) participated. Measures. Twenty-two measures of CBPR context, group dynamics, methods, and health-related outcomes were examined. Analysis. Confirmatory factor analysis to establish factorial validity and Pearson correlations to establish convergent and divergent validity were used. Results. Confirmatory factor analysis demonstrated strong factorial validity for the 22 constructs. Pearson correlations (p < .001) supported the convergent and divergent validity of the measures. Internal consistency was strong, with 18 of 22 measures achieving at least a .78 Cronbach α. Conclusion. CBPR is a key approach for health promotion in underserved communities and/or communities of color, yet the basic psychometric properties of CBPR constructs have not been well established. This study provides evidence of the factorial, convergent, and discriminant validity and the internal consistency of 22 measures related to the CBPR conceptual model. Thus, these measures can be used with confidence by both CBPR practitioners and researchers to evaluate their own CBPR partnerships and to advance the science of CBPR.

Rural American Indians' Perspectives of Obstacles in the Mental Health Treatment Process in Three Treatment Sectors

This study sought to identify obstacles associated with alcohol, drug, and mental (ADM) health care utilization in three treatment sectors for residents on three reservations in the United States. Participants (N 224) disclosed that they had sought treatment for ADM problems in the past year and identified obstacles they faced during this process. Four obstacles were identified: (a) self-reliance, (b) privacy issues, (c) quality of care, and (d) communication/trust. A vast majority (71%) of participants reported at least one of these obstacles during treatment, and 61% faced two or more obstacles. There were no differences in the type or number of obstacles by treatment sector. Privacy and communication/trust obstacles were more likely to occur in emotional treatment compared to alcohol/drug treatment.

Research for Improved Health: Variability and Impact of Structural Characteristics in Federally Funded Community Engaged Research

Background: Although there is strong scientific, policy, and community support for community-engaged research (CEnR)—including community-based participatory research (CBPR)—the science of CEnR is still developing. Objective: To describe structural differences in federally funded CEnR projects by type of research (i.e., descriptive, intervention, or dissemination/policy change) and race/ethnicity of the population served. Methods: We identified 333 federally funded projects in 2009 that potentially involved CEnR, 294 principal investigators/project directors (PI/PD) were eligible to participate in a key informant (KI) survey from late 2011 to early 2012 that asked about partnership structure (68% response rate). Results: The National Institute on Minority Health & Health Disparities (19.1%), National Cancer Institute (NCI; 13.3%), and the Centers for Disease Control and Prevention (CDC; 12.6%) funded the most CEnR projects. Most were intervention projects (66.0%). Projects serving American Indian or Alaskan Native (AIAN) populations (compared with other community of color or multiple-race/unspecified) were likely to be descriptive projects (p < .01), receive less funding (p < .05), and have higher rates of written partnership agreements (p < .05), research integrity training (p < .05), approval of publications (p < .01), and data ownership (p < .01). AIAN-serving projects also reported similar rates of research productivity and greater levels of resource sharing compared with those serving multiple-race/unspecified groups. Conclusions: There is clear variability in the structure of CEnR projects with future research needed to determine the impact of this variability on partnering processes and outcomes. In addition, projects in AIAN communities receive lower levels of funding yet still have comparable research productivity to those projects in other racial/ethnic communities.