Guy Kegels

Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research

This overview aims to stimulate conceptual and practical discussions to help unlock the full potential of realist evaluation in health systems research. Based on a structured literature search, this review maps how the concepts of realist evaluation are applied in health systems research and which methodological problems are encountered. We found a great diversity in the depth of application of the philosophical concepts, use of terminology and scope of application in the research process. Terms of theory-driven evaluation, theories of change and realist evaluation are often used interchangeably. Diverging views exist regarding the nature of ‘mechanism’ and the difference between mechanism and essential context condition. A lack of methodological guidance was highlighted by many authors. Realist evaluation is slowly gaining traction in health systems research, but more clarity is needed concerning the definitions of mechanisms and context and how the configuration of context, mechanism and intervention can be described and assessed.

Scaling-up antiretroviral treatment in Southern African countries with human resource shortage: How will health systems adapt?

Scaling-up antiretroviral treatment (ART) to socially meaningful levels in low-income countries with a high AIDS burden is constrained by (1) the continuously growing caseload of people to be maintained on long-term ART; (2) evident problems of shortage and skewed distribution in the health workforce; and (3) the heavy workload inherent to presently used ART delivery models. If we want to imagine how health systems can react to such challenges, we need to understand better what needs to be done regarding the different types of functions ART requires, and how these can be distributed through the care supply system, knowing that different functions rely on different rationales (professional, bureaucratic, social) for which the human input need not necessarily be found in formal healthcare supply systems. Given the present realities of an increasingly pluralistic healthcare supply and highly eclectic demand, we advance three main generic requirements for ART interventions to be successful: trustworthiness, affordability and exclusiveness--and their constituting elements. We then apply this analytic model to the baseline situation (no fundamental changes) and different scenarios. In Scenario A there are no fundamental changes, but ART gets priority status and increased resources. In Scenario B the ART scale-up strengthens the overall health system: we detail a B1 technocratic variant scenario, with profoundly re-engineered ART service production, including significant task shifting, away from classical delivery models and aimed at maximum standardisation and control of all operations; while in the B2 community-based variant scenario the typology of ART functions is maximally exploited to distribute the tasks over a human potential pool that is as wide as possible, including patients and possible communities. The latter two scenarios would entail a high degree of de-medicalisation of ART.

Global Health Actors Claim To Support Health System Strengthening—Is This Reality or Rhetoric?

Bruno Marchal and colleagues argue that most current strategies aimed at health systems strengthening remain selectively targeted at specific diseases.

Viewpoint: HIV/AIDS and the health workforce crisis: What are the next steps?

In scaling up antiretroviral treatment (ART), financing is fast becoming less of a constraint than the human resources to ensure the implementation of the programmes. In the countries hardest affected by the acquired immunodeficiency syndrome (AIDS) pandemic, AIDS increases workloads, professional frustration and burn‐out. It affects health workers also directly, contributing to rising sick leave and attrition rates. This burden is shouldered by a health workforce weakened already by chronic deficiencies in training, distribution and retention. In these countries, health workforce issues can no longer be analysed from the traditional perspective of human resource development, but should start from the position that entire societies are in a process of social involution of a scale unprecedented in human history. Strategies that proved to be effective and correct in past conditions need be reviewed, particularly in the domains of human resource management and policy‐making, education and international aid. True paradigm shifts are thus required, without which the fundamental changes required to effectively strengthen the health workforce are unlikely to be initiated.

Health systems frameworks in their political context: framing divergent agendas

BackgroundDespite the mounting attention for health systems and health systems theories, there is a persisting lack of consensus on their conceptualisation and strengthening. This paper contributes to structuring the debate, presenting landmarks in the development of health systems thinking against the backdrop of the policy context and its dominant actors. We argue that frameworks on health systems are products of their time, emerging from specific discourses. They are purposive, not neutrally descriptive, and are shaped by the agendas of their authors.DiscussionThe evolution of thinking over time does not reflect a progressive accumulation of insights. Instead, theories and frameworks seem to develop in reaction to one another, partly in line with prevailing paradigms and partly as a response to the very different needs of their developers. The reform perspective considering health systems as projects to be engineered is fundamentally different from the organic view that considers a health system as a mirror of society. The co-existence of health systems and disease-focused approaches indicates that different frameworks are complementary but not synthetic.The contestation of theories and methods for health systems relates almost exclusively to low income countries. At the global level, health system strengthening is largely narrowed down to its instrumental dimension, whereby well-targeted and specific interventions are supposed to strengthen health services and systems or, more selectively, specific core functions essential to programmes. This is in contrast to a broader conceptualization of health systems as social institutions.SummaryHealth systems theories and frameworks frame health, health systems and policies in particular political and public health paradigms. While there is a clear trend to try to understand the complexity of and dynamic relationships between elements of health systems, there is also a demand to provide frameworks that distinguish between health system interventions, and that allow mapping with a view of analysing their returns. The choice for a particular health system model to guide discussions and work should fit the purpose. The understanding of the underlying rationale of a chosen model facilitates an open dialogue about purpose and strategy.

How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa.

BackgroundThis paper presents the development of a study design built on the principles of theory-driven evaluation. The theory-driven evaluation approach was used to evaluate an adolescent sexual and reproductive health intervention in Mali, Burkina Faso and Cameroon to improve continuity of care through the creation of networks of social and health care providers.Methods/designBased on our experience and the existing literature, we developed a six-step framework for the design of theory-driven evaluations, which we applied in the ex-post evaluation of the networking component of the intervention. The protocol was drafted with the input of the intervention designer. The programme theory, the central element of theory-driven evaluation, was constructed on the basis of semi-structured interviews with designers, implementers and beneficiaries and an analysis of the interventions logical framework.DiscussionThe six-step framework proved useful as it allowed for a systematic development of the protocol. We describe the challenges at each step. We found that there is little practical guidance in the existing literature, and also a mix up of terminology of theory-driven evaluation approaches. There is a need for empirical methodological development in order to refine the tools to be used in theory driven evaluation. We conclude that ex-post evaluations of programmes can be based on such an approach if the required information on context and mechanisms is collected during the programme.

A health insurance scheme for hospital care in Bwamanda district, Zaire : lessons and questions after 10 years of functioning

A voluntary insurance scheme for hospital care was launched in 1986 in the Bwamanda district in North West Zaire. The paper briefly reviews the rationale, design and implementation of the scheme and discusses its results and performance over time. The scheme succeeded in generating stable revenue for the hospital in a context where government intervention was virtually absent and external subsidies were most uncertain. Hospital data indicate that hospital services were used by a significantly higher proportion of insured patients than uninsured people. The features of the environment in which the insurance scheme thrived are discussed and the conditions that facilitated its development reviewed. These conditions comprise organizational‐managerial, economic‐financial, social and political factors. The Bwamanda case study illustrates the feasibility of health insurance – at least for hospital‐based inpatient care – at rural district level in sub‐Saharan Africa, but also exemplifies the managerial and social complexity of such financing mechanisms.

Monitoring unmet obstetric need at district level in Morocco

Unmet obstetric need was assessed in Taounate province (Morocco) during the year 1995 by monitoring rates of major obstetric intervention for absolute maternal indications. We report results in terms of spatial distribution of the failures of the health care system to provide women with essential emergency obstetric care. An estimated 135 women with life‐threatening conditions did not benefit from the obstetric interventions they required. The paper documents the effects of the monitoring process on the way the provincial team changed their way of dealing with deliveries. Assessment of unmet obstetric need in Taounate province proved feasible and affordable without external budgetary inputs. It provided the team with information on the magnitude of a previously ignored problem. The results were so dramatic as to lead the team to look for causes and solutions. These were clearly not merely technical but systemic in nature.

The contribution of international health volunteers to the health workforce in sub-Saharan Africa

BackgroundIn this paper, we aim to quantify the contribution of international health volunteers to the health workforce in sub-Saharan Africa and to explore the perceptions of health service managers regarding these volunteers.MethodsRapid survey among organizations sending international health volunteers and group discussions with experienced medical officers from sub-Saharan African countries.ResultsWe contacted 13 volunteer organizations having more than 10 full-time equivalent international health volunteers in sub-Saharan Africa and estimated that they employed together 2072 full-time equivalent international health volunteers in 2005. The numbers sent by secular non-governmental organizations (NGOs) is growing, while the number sent by development NGOs, including faith-based organizations, is mostly decreasing. The cost is estimated at between US

Are Expert Patients an Untapped Resource for ART Provision in Sub-Saharan Africa?

36 000 and US