Barbara Madaj

Social Return on Investment (SROI) methodology to account for value for money of public health interventions: a systematic review

BackgroundIncreased scarcity of public resources has led to a concomitant drive to account for value-for-money of interventions. Traditionally, cost-effectiveness, cost-utility and cost-benefit analyses have been used to assess value-for-money of public health interventions. The social return on investment (SROI) methodology has capacity to measure broader socio-economic outcomes, analysing and computing views of multiple stakeholders in a singular monetary ratio. This review provides an overview of SROI application in public health, explores lessons learnt from previous studies and makes recommendations for future SROI application in public health.MethodsA systematic review of peer-reviewed and grey literature to identify SROI studies published between January 1996 and December 2014 was conducted. All articles describing conduct of public health SROI studies and which reported a SROI ratio were included. An existing 12-point framework was used to assess study quality. Data were extracted using pre-developed codes: SROI type, type of commissioning organisation, study country, public health area in which SROI was conducted, stakeholders included in study, discount rate used, SROI ratio obtained, time horizon of analysis and reported lessons learnt.Results40 SROI studies, of varying quality, including 33 from high-income countries and 7 from low middle-income countries, met the inclusion criteria. SROI application increased since its first use in 2005 until 2011, declining afterwards. SROI has been applied across different public health areas including health promotion (12 studies), mental health (11), sexual and reproductive health (6), child health (4), nutrition (3), healthcare management (2), health education and environmental health (1 each). Qualitative and quantitative methods have been used to gather information for public health SROI studies. However, there remains a lack of consensus on who to include as beneficiaries, how to account for counterfactual and appropriate study-time horizon.Reported SROI ratios vary widely (1.1:1 to 65:1).ConclusionsSROI can be applied across healthcare settings. Best practices such as analysis involving only beneficiaries (not all stakeholders), providing justification for discount rates used in models, using purchasing power parity equivalents for monetary valuations and incorporating objective designs such as case–control or before-and-after designs for accounting for outcomes will improve robustness of public health SROI studies.

Changing the role of the traditional birth attendant in Somaliland

To explore the feasibility of changing the role of the traditional birth attendant (TBA) to act as birth companion and promoter of skilled birth attendance.

Knowledge and Skills of Healthcare Providers in Sub-Saharan Africa and Asia before and after Competency-Based Training in Emergency Obstetric and Early Newborn Care

Background Healthcare provider training in Emergency Obstetric and Newborn Care (EmOC&NC) is a component of 65% of intervention programs aimed at reducing maternal and newborn mortality and morbidity. It is important to evaluate the effectiveness of this. Methods We evaluated knowledge and skills among 5,939 healthcare providers before and after 3–5 days ‘skills and drills’ training in emergency obstetric and newborn care (EmOC&NC) conducted in 7 sub-Saharan Africa countries (Ghana, Kenya, Malawi, Nigeria, Sierra Leone, Tanzania, Zimbabwe) and 2 Asian countries (Bangladesh, Pakistan). Standardised assessments using multiple choice questions and objective structured clinical examination (OSCE) were used to measure change in knowledge and skills and the Improvement Ratio (IR) by cadre and by country. Linear regression was performed to identify variables associated with pre-training score and IR. Results 99.7% of healthcare providers improved their overall score with a median (IQR) increase of 10.0% (5.0% - 15.0%) for knowledge and 28.8% (23.1% - 35.1%) for skill. There were significant improvements in knowledge and skills for each cadre of healthcare provider and for each country (p<0.05). The mean IR was 56% for doctors, 50% for mid-level staff and nurse-midwives and 38% for nursing-aides. A teaching job, previous in-service training, and higher percentage of work-time spent providing maternity care were each associated with a higher pre-training score. Those with more than 11 years of experience in obstetrics had the lowest scores prior to training, with mean IRs 1.4% lower than for those with no more than 2 years of experience. The largest IR was for recognition and management of obstetric haemorrhage (49–70%) and the smallest for recognition and management of obstructed labour and use of the partograph (6–15%). Conclusions Short in-service EmOC&NC training was associated with improved knowledge and skills for all cadres of healthcare providers working in maternity wards in both sub-Saharan Africa and Asia. Additional support and training is needed for use of the partograph as a tool to monitor progress in labour. Further research is needed to assess if this is translated into improved service delivery.

Developing global indicators for quality of maternal and newborn care: a feasibility assessment

Abstract Objective To assess the feasibility of applying the World Health Organization’s proposed 15 indicators of quality of care for maternal and newborn health at health-facility level in low- and middle-income settings. Methods Six of the indicators are about maternal health, five are for newborn health and four are general cross-cutting indicators. We used data collected routinely in facility registers and obtained as part of facility assessments from 963 health-care facilities specializing in maternity services in 10 countries in Africa and Asia. We made a feasibility assessment of the availability of data and the clarity of indicator definitions and identified additional information and data collection processes needed to apply the proposed indicators in real-life settings. Findings Of the indicators evaluated, 10 were clearly defined, of which four could be applied directly in the field and six would require revisions to operationalize them. The other five indicators require further development, with one of them being ready for implementation by using information readily available in registers and four requiring further information before deployment. For indicators that measure coverage of care or availability of services or products, there is a need to further strengthen measurement. Information on emergency obstetric complications was not recorded in a standard manner, thus limiting the reliability of the information. Conclusion While some of the proposed indicators can already be applied, other indicators need to be refined or will need additional sources and methods of data collection to be applied in real-world settings.

Assessing value-for-money in maternal and newborn health

Responding to increasing demands to demonstrate value-for-money (VfM) for maternal and newborn health interventions, and in the absence of VfM analysis in peer-reviewed literature, this paper reviews VfM components and methods, critiques their applicability, strengths and weakness and proposes how VfM assessments can be improved. VfM comprises four components: economy, efficiency, effectiveness and cost-effectiveness. Both ‘economy’ and ‘efficiency’ can be assessed with detailed cost analysis utilising costs obtained from programme accounting data or generic cost databases. Before-and-after studies, case–control studies or randomised controlled trials can be used to assess ‘effectiveness’. To assess ‘cost-effectiveness’, cost-effectiveness analysis (CEA), cost-utility analysis (CUA), cost-benefit analysis (CBA) or social return on investment (SROI) analysis are applicable. Generally, costs can be obtained from programme accounting data or existing generic cost databases. As such ‘economy’ and ‘efficiency’ are relatively easy to assess. However, ‘effectiveness’ and ‘cost-effectiveness’ which require establishment of the counterfactual are more difficult to ascertain. Either a combination of CEA or CUA with tools for assessing other VfM components, or the independent use of CBA or SROI are alternative approaches proposed to strengthen VfM assessments. Cross-cutting themes such as equity, sustainability, scalability and cultural acceptability should also be assessed, as they provide critical contextual information for interpreting VfM assessments. To select an assessment approach, consideration should be given to the purpose, data availability, stakeholders requiring the findings and perspectives of programme beneficiaries. Implementers and researchers should work together to improve the quality of assessments. Standardisation around definitions, methodology and effectiveness measures to be assessed would help.

Economic evaluation of emergency obstetric care training: a systematic review

BackgroundTraining healthcare providers in Emergency Obstetric Care (EmOC) has been shown to be effective in improving their capacity to provide this critical care package for mothers and babies. However, little is known about the costs and cost-effectiveness of such training. Understanding costs and cost-effectiveness is essential in guaranteeing value-for-money in healthcare spending. This study systematically reviewed the available literature on cost and cost-effectiveness of EmOC trainings.MethodsPeer-reviewed and grey literature was searched for relevant papers published after 1990. Studies were included if they described an economic evaluation of EmOC training and the training cost data were available. Two reviewers independently searched, screened, and selected studies that met the inclusion criteria, with disagreements resolved by a third reviewer. Quality of studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards statement. For comparability, all costs in local currency were converted to International dollar (I

Retention of knowledge and skills after Emergency Obstetric Care training: A multi-country longitudinal study

) equivalents using purchasing power parity conversion factors. The cost per training per participant was calculated. Narrative synthesis was used to summarise the available evidence on cost effectiveness.ResultsFourteen studies (five full and nine partial economic evaluations) met the inclusion criteria. All five and two of the nine partial economic evaluations were of high quality. The majority of studies (13/14) were from low- and middle-income countries. Training equipment, per diems and resource person allowance were the most expensive components. Cost of training per person per day ranged from I

Burden of physical, psychological and social ill-health during and after pregnancy among women in India, Pakistan, Kenya and Malawi

33 to I

Developing Global Indicators for Quality of Maternal and Newborn Care: A Feasibility assessment/Developpement D'indicateurs Globaux De la Qualite Des Soins De Sante Maternelle et Neonatale: Etude De faisabilite/Desarrollo De Indicadores Globales Para la Calidad De la Atencion Materna Y Obstetrica: Evaluacion De Viabilidad

90 when accommodation was required and from I

Obstetrics knowledge and skills training as a catalyst for change

5 to I