Stella A. Quimbo

Associations between Cognitive Function, Blood Lead Concentration, and Nutrition among Children in the Central Philippines

OBJECTIVE Because little is known about its effects on cognitive function among children in less-developed countries, we determined the impact of lead exposure from other nutritional determinants of cognitive ability. STUDY DESIGN Data were from a cross-sectional population-based stratified random sample of 877 children (age 6 months-5 years) participating in the Quality Improvement Demonstration Study we are conducting in the Philippines. With data from validated psychometric instruments, venous blood samples, and comprehensive survey instruments, we developed multi-stage models to account for endogenous determinants of blood lead levels (BLLs) and exogenous confounders of the association between BLLs and cognitive function. RESULTS A 1 microg/dL increase in BLL was associated with a 3.32 point decline in cognitive functioning in children aged 6 months to 3 years and a 2.47 point decline in children aged 3 to 5 years olds. BLL was inversely associated with hemoglobin and folate levels. Higher folate levels mitigated the negative association between BLL and cognitive function. CONCLUSIONS These population-based data suggest greater lead toxicity on cognitive function than previously reported. Our findings also suggest that folate and iron deficient children are more susceptible to the negative cognitive effects of lead. Folate supplementation may offer some protective effects against lead exposure.

Financial Incentives And Measurement Improved Physicians’ Quality Of Care In The Philippines

The merits of using financial incentives to improve clinical quality have much appeal, yet few studies have rigorously assessed the potential benefits. The uncertainty surrounding assessments of quality can lead to poor policy decisions, possibly resulting in increased cost with little or no quality improvement, or missed opportunities to improve care. We conducted an experiment involving physicians in thirty Philippine hospitals that overcomes many of the limitations of previous studies. We measured clinical performance and then examined whether modest bonuses equal to about 5 percent of a physicians salary, as well as system-level incentives that increased compensation to hospitals and across groups of physicians, led to improvements in the quality of care. We found that both the bonus and system-level incentives improved scores in a quality measurement system used in our study by ten percentage points. Our findings suggest that when careful measurement is combined with the types of incentives we studied, there may be a larger impact on quality than previously recognized.

Elevated blood-lead levels among children living in the rural Philippines

OBJECTIVE Generally, lead poisoning is not considered a significant environmental hazard for children in rural areas of developing countries. With a prospectively designed policy experiment, the research community and the government are conducting a broad-based investigation to introduce and evaluate the impact of health policy reforms on children in a rural area of the Philippines - the Quality Improvement Demonstration Study (QIDS). As part of this study, we researched lead exposure in children under the age of five. METHODS We sampled a population of children from the Visayas region in the central Philippines, covering approximately one third of the countrys geographical area. From December 2003 to September 2004, the survey collected blood lead levels (BLL) together with demographic, socioeconomic and child health data points. Supplemental field-testing among a sub-sample of the most exposed children assessed the sources of environmental lead exposure. FINDINGS Among children in this study, 21% (601 of 2861 children) had BLL greater than 10 microg/dl. BLL were associated independently with age, haemoglobin concentration, water source, roofing material, expenditures and history of breastfeeding. A follow-up assessment of possible environmental exposures among the sub-sample of children with elevated BLL revealed no single or predominant exposure source. Instead, there appear to be multiple potential sources, such as fossil-fuel combustion, lead paint (in or around 38% of homes) and household items. CONCLUSION Elevated BLL are common among children in the Visayas, and may signify an under-recognized threat to children living in rural areas of other developing nations. This setting has varied environmental sources of lead. Observed correlates of BLL may be of clinical, environmental and public health utility to identify and mitigate the consequences of lead toxicity.

The impact of performance incentives on child health outcomes: results from a cluster randomized controlled trial in the Philippines

Improving clinical performance using measurement and payment incentives, including pay for performance (or P4P), has, so far, shown modest to no benefit on patient outcomes. Our objective was to assess the impact of a P4P programme on paediatric health outcomes in the Philippines. We used data from the Quality Improvement Demonstration Study. In this study, the P4P intervention, introduced in 2004, was randomly assigned to 10 community district hospitals, which were matched to 10 control sites. At all sites, physician quality was measured using Clinical Performance Vignettes (CPVs) among randomly selected physicians every 6 months over a 36-month period. In the hospitals randomized to the P4P intervention, physicians received bonus payments if they met qualifying scores on the CPV. We measured health outcomes 4-10 weeks after hospital discharge among children 5 years of age and under who had been hospitalized for diarrhoea and pneumonia (the two most common illnesses affecting this age cohort) and had been under the care of physicians participating in the study. Health outcomes data collection was done at baseline/pre-intervention and 2 years post-intervention on the following post-discharge outcomes: (1) age-adjusted wasting, (2) C-reactive protein in blood, (3) haemoglobin level and (4) parental assessment of childs health using general self-reported health (GSRH) measure. To evaluate changes in health outcomes in the control vs intervention sites over time (baseline vs post-intervention), we used a difference-in-difference logistic regression analysis, controlling for potential confounders. We found an improvement of 7 and 9 percentage points in GSRH and wasting over time (post-intervention vs baseline) in the intervention sites relative to the control sites (P ≤ 0.001). The results from this randomized social experiment indicate that the introduction of a performance-based incentive programme, which included measurement and feedback, led to improvements in two important child health outcomes.

The health and cost impact of care delay and the experimental impact of insurance on reducing delays.

OBJECTIVE To examine whether delays in seeking care are associated with worse health outcomes or increased treatment costs in children, and then assess whether insurance coverage reduces these delays. STUDY DESIGN We use data on 4070 children younger than 5 years from the Quality Improvement Demonstration Study, a randomized controlled experiment assessing the effects of increasing insurance coverage. We examined whether delay in care, defined as greater than 2 days between the onset of symptoms and admission to the study district hospitals, is associated with wasting or having positive C-reactive protein levels on discharge, and with total charge for hospital admission; we also evaluated whether increased benefit coverage and enrollment reduced the likelihood of delay. RESULTS Delay is associated with 4.2% and 11.2% percentage point increases in the likelihood of wasting (P = .08) and having positive C-reactive protein levels (P = .03), respectively, at discharge. On average, hospitalization costs were 1.9% higher with delay (P = .04). Insurance intervention results in 5 additional children in 100 not delaying going to the hospital (P = .02). CONCLUSIONS In this population, delayed care is associated with worse health outcomes and higher costs. Access to insurance reduced delays; thus insurance interventions may have positive effects on health outcomes.

The Quality Improvement Demonstration Study: An example of evidence-based policy-making in practice

BackgroundRandomized trials have long been the gold-standard for evaluating clinical practice. There is growing recognition that rigorous studies are similarly needed to assess the effects of policy. However, these studies are rarely conducted. We report on the Quality Improvement Demonstration Study (QIDS), an example of a large randomized policy experiment, introduced and conducted in a scientific manner to evaluate the impact of large-scale governmental policy interventions.MethodsIn 1999 the Philippine government proposed sweeping reforms in the National Health Sector Reform Agenda. We recognized the unique opportunity to conduct a social experiment. Our ongoing goal has been to generate results that inform health policy. Early on we concentrated on developing a multi-institutional collaborative effort. The QIDS team then developed hypotheses that specifically evaluated the impact of two policy reforms on both the delivery of care and long-term health status in children. We formed an experimental design by randomizing matched blocks of three communities into one of the two policy interventions plus a control group. Based on the reform agenda, one arm of the experiment provided expanded insurance coverage for children; the other introduced performance-based payments to hospitals and physicians. Data were collected in household, hospital-based patient exit, and facility surveys, as well as clinical vignettes, which were used to assess physician practice. Delivery of services and health status were evaluated at baseline and after the interventions were put in place using difference-in-difference estimation.ResultsWe found and addressed numerous challenges conducting this study, namely: formalizing the experimental design using the existing health infrastructure; securing funding to do research coincident with the policy reforms; recognizing biases and designing the study to account for these; putting in place a broad data collection effort to account for unanticipated findings; introducing sustainable policy interventions based on the reform agenda; and providing results in real-time to policy makers through a combination of venues.ConclusionQIDS demonstrates that a large, prospective, randomized controlled policy experiment can be successfully implemented at a national level as part of sectoral reform. While we believe policy experiments should be used to generate evidence-based health policy, to do this requires opportunity and trust, strong collaborative relationships, and timing. This study nurtures the growing attitude that translation of scientific findings from the bedside to the community can be done successfully and that we should raise the bar on project evaluation and the policy-making process.

Quality variation and its impact on costs and satisfaction: evidence from the QIDS study.

Background:Improving the quality of inpatient hospital care is increasingly attainable in a variety of settings. However, the relationship between rising quality and costs is unclear; similarly the relationship between varying levels of quality and a patients satisfaction remains poorly defined. Methods:We use data from the Quality Improvement Demonstration Study (QIDS) based in 30 district hospitals in the Philippines. There were 974 children in the study; these children were cared for by 43 physicians. To measure quality of care, the physicians completed vignettes, a valid and inexpensive measure. Patient exit surveys were given to parents of children on the day of discharge, collecting information on services and hospital charges for the inpatient stay, payment sources for the hospitalization, and the Patient Satisfaction Survey (PSQ-18). Results:We found a nonlinear relationship between quality and hospital charges: at low levels of quality improvements are linked to lower hospital charges. However, as quality improves further, these changes lead to higher charges. Higher quality also demonstrated a similar nonlinear relationship with patient satisfaction. Conclusions:The U-shaped association between quality and hospital charges suggests that targeting the lowest quality providers may decrease costs. The similar relationship between patient-reported satisfaction and quality improvement suggests that investments in quality will raise satisfaction, perhaps even when charges are increased.

A novel method for measuring health care system performance: experience from QIDS in the Philippines

OBJECTIVES Measuring and monitoring health system performance is important albeit controversial. Technical, logistic and financial challenges are formidable. We introduced a system of measurement, which we call Q, to measure the quality of hospital clinical performance across a range of facilities. This paper describes how Q was developed, implemented in hospitals in the Philippines and how it compares with typical measures. METHODS Q consists of measures of clinical performance, patient satisfaction and volume of physician services. We evaluate Q using experimental data from the Quality Improvement Demonstration Study (QIDS), a randomized policy experiment. We determined its responsiveness over time and to changes in structural measures such as staffing and supplies. We also examined the operational costs of implementing Q. RESULTS Q was sustainable, minimally disruptive and readily grafted into existing routines in 30 hospitals in 10 provinces semi-annually for a period of 2(1/2) years. We found Q to be more responsive to immediate impacts of policy change than standard structural measures. The operational costs totalled USD2133 or USD305 per assessment per site. CONCLUSION Q appears to be an achievable assessment tool that is a comprehensive and responsive measure of system level quality at a limited cost in resource-poor settings.

A comparison of objective biomarkers with a subjective health status measure among children in the Philippines.

Large health surveys use subjective (self-reported) and objective (biomarkers) measures to assess heath status. However, the linkage or disparity of these measures has not been systematically studied in developing countries. Method: Using data from the Philippine Quality Improvement Demonstration Study, QIDS, this study evaluated the associations between General Self-Reported Health Status (GSRH) and height, weight, hemoglobin, red blood cell folate, C-reactive protein, and blood lead levels. The authors modeled each biomarker as a function of GSRH controlling for socioeconomic status and selection effects. Changes in biomarkers and GSRH in children who had previously been hospitalized were also examined. Results: GSRH independently predicted hemoglobin, C-reactive protein, stunting, and wasting. GSRH did not vary significantly with folate deficiency and blood lead levels. Conclusions: In addition to being a measure of overall child health status, GSRH may be a useful and inexpensive screening tool for identifying children that need further health testing.

Underutilization of social insurance among the poor: evidence from the Philippines.

Background Many developing countries promote social health insurance as a means to eliminate unmet health needs. However, this strategy may be ineffective if there are barriers to fully utilizing insurance. Methods We analyzed the utilization of social health insurance in 30 hospital districts in the central regions of the Philippines between 2003 and 2007. Data for the study came from the Quality Improvement Demonstration Study (QIDS) and included detailed patient information from exit interviews of children under 5 years of age conducted in seven waves among public hospital districts located in the four central regions of the Philippines. These data were used to estimate and identify predictors of underutilization of insurance benefits - defined as the likelihood of not filing claims despite having legitimate insurance coverage - using logistic regression. Results Multivariate analyses using QIDS data from 2004 to 2007 reveal that underutilization averaged about 15% throughout the study period. Underutilization, however, declined over time. Among insured hospitalized children, increasing length of stay in the hospital and mothers education, were associated with less underutilization. Being in a QIDS intervention site was also associated with less underutilization and partially accounts for the downward trend in underutilization over time. Discussion The surprisingly high level of insurance underutilization by insured patients in the QIDS sites undermines the potentially positive impact of social health insurance on the health of the marginalized. In the Philippines, where the largest burden of health care spending falls on households, underutilization suggests ineffective distribution of public funds, failing to reach a significant proportion of households which are by and large poor. Interventions that improve benefit awareness may combat the problem of underutilization and should be the focus of further research in this area.