Scott S. Lee

5-SPICE: the application of an original framework for community health worker program design, quality improvement and research agenda setting

Introduction Despite decades of experience with community health workers (CHWs) in a wide variety of global health projects, there is no established conceptual framework that structures how implementers and researchers can understand, study and improve their respective programs based on lessons learned by other CHW programs. Objective To apply an original, non-linear framework and case study method, 5-SPICE, to multiple sister projects of a large, international non-governmental organization (NGO), and other CHW projects. Design Engaging a large group of implementers, researchers and the best available literature, the 5-SPICE framework was refined and then applied to a selection of CHW programs. Insights gleaned from the case study method were summarized in a tabular format named the ‘5×5-SPICE chart’. This format graphically lists the ways in which essential CHW program elements interact, both positively and negatively, in the implementation field. Results The 5×5-SPICE charts reveal a variety of insights that come from a more complex understanding of how essential CHW projects interact and influence each other in their unique context. Some have been well described in the literature previously, while others are exclusive to this article. An analysis of how best to compensate CHWs is also offered as an example of the type of insights that this method may yield. Conclusions The 5-SPICE framework is a novel instrument that can be used to guide discussions about CHW projects. Insights from this process can help guide quality improvement efforts, or be used as hypothesis that will form the basis of a programs research agenda. Recent experience with research protocols embedded into successfully implemented projects demonstrates how such hypothesis can be rigorously tested. This paper is part of the thematic cluster Global Health Beyond 2015 - more papers from this cluster can be found at http://www.globalhealthaction.net

Supporting Community Health Workers in India through Voice- and Web-Based Feedback

Our research aims to support community health workers (CHWs) in low-resource settings by providing them with personalized information regarding their work. This information is delivered through a combination of voice- and web-based feedback that is derived from data already collected by CHWs. We describe the in situ participatory design approach used to create usable and appropriate feedback for low-literate CHWs and present usage data from a 12-month study with 71 CHWs in India. We show how the system supported and motivated CHWs, and how they used both the web- and voice-based systems, and each of the visualizations, for different reasons. We also show that the comparative feedback provided by the system introduced elements of competition that discouraged some CHWs while motivating others. Taken together, our findings suggest that providing personalized voice- and web-based feedback could be an effective way to support and motivate CHWs in low-resource settings.

Closing the Feedback Loop: A 12-month Evaluation of ASTA, a Self-Tracking Application for ASHAs

Accredited Social Health Activists (ASHAs) have been shown to have a positive impact on health outcomes of the households they visit, particularly in maternal and neonatal health. As the first line of the public health system in many countries, they are a critical link to the broader public health infrastructure for community members. Yet they do this all with minimal training and limited support infrastructure. To a pregnant woman, an ASHA is a trusted ally in navigating the health system---information gathered is returned by appropriate advice and counseling. To the health system, the ASHA is a key channel of valuable householdlevel information for the public health system, yet she generally receives minimal guidance in return. In this paper we present ASTA---the ASHA Self-Tracking Application---a system that provides ASHAs with timely, on-demand information regarding their own performance compared to their peers. Using ASTA, ASHAs access comparative performance data through both a web-based and voice-based interface on demand. We evaluated ASTA through a 12-month deployment with 142 ASHAs in Uttar Pradesh, India, assessing the impact of providing feedback on ASHA performance. We find that ASHAs with access to the ASTA system made significantly more client visits, with average monthly visits 21.5% higher than ASHAs who had access to a control system. In addition, higher ASHA performance was correlated with increased usage of ASTA. However, the performance improvement was front-loaded, with the impact of the system decreasing toward the end of the study period. Taken together, our findings provide promising evidence that studying and incorporating tools like ASTA could be cost effective and impactful for ASHA programs.

Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial

Background Countries across sub-Saharan Africa are scaling up Community Health Worker (CHW) programmes, yet there remains little high-quality research assessing strategies for CHW supervision and performance improvement. This randomised controlled trial aimed to determine the effect of a personalised performance dashboard used as a supervision tool on the quantity, speed, and quality of CHW care. Methods We conducted a randomised controlled trial in a large health catchment area in peri-urban Mali. One hundred forty-eight CHWs conducting proactive case-finding home visits were randomly allocated to receive individual monthly supervision with or without the CHW Performance Dashboard from January to June 2016. Randomisation was stratified by CHW supervisor, level of CHW experience, and CHW baseline performance for monthly quantity of care (number of household visits). With regression analysis, we used a difference-in-difference model to estimate the effect of the intervention on monthly quantity, timeliness (percentage of children under five treated within 24 hours of symptom onset), and quality (percentage of children under five treated without protocol error) of care over a six-month post-intervention period relative to a three-month pre-intervention period. Results Use of the Dashboard during monthly supervision significantly increased the mean number of home visits by 39.94 visits per month (95% CI = 3.56-76.3; P = 0.031). Estimated effects on secondary outcomes of timeliness and quality were positive but not statistically significant. Across both study arms, CHW quantity, timeliness, and quality of care significantly improved over the study period, during which time all CHWs received dedicated monthly supervision, although effects plateaued over time. Conclusions Our findings suggest that dedicated monthly supervision and personalised feedback using performance dashboards can increase CHW productivity. Further operational research is needed to understand how to sustain the performance improvements over time. Trial registration ClinicalTrials.gov (NCT03684551).