Natalia Tiberti

pROC: an open-source package for R and S+ to analyze and compare ROC curves

BackgroundReceiver operating characteristic (ROC) curves are useful tools to evaluate classifiers in biomedical and bioinformatics applications. However, conclusions are often reached through inconsistent use or insufficient statistical analysis. To support researchers in their ROC curves analysis we developed pROC, a package for R and S+ that contains a set of tools displaying, analyzing, smoothing and comparing ROC curves in a user-friendly, object-oriented and flexible interface.ResultsWith data previously imported into the R or S+ environment, the pROC package builds ROC curves and includes functions for computing confidence intervals, statistical tests for comparing total or partial area under the curve or the operating points of different classifiers, and methods for smoothing ROC curves. Intermediary and final results are visualised in user-friendly interfaces. A case study based on published clinical and biomarker data shows how to perform a typical ROC analysis with pROC.ConclusionspROC is a package for R and S+ specifically dedicated to ROC analysis. It proposes multiple statistical tests to compare ROC curves, and in particular partial areas under the curve, allowing proper ROC interpretation. pROC is available in two versions: in the R programming language or with a graphical user interface in the S+ statistical software. It is accessible at http://expasy.org/tools/pROC/ under the GNU General Public License. It is also distributed through the CRAN and CSAN public repositories, facilitating its installation.

A combined CXCL10, CXCL8 and H-FABP panel for the staging of human African trypanosomiasis patients

Background Human African trypanosomiasis (HAT), also known as sleeping sickness, is a parasitic tropical disease. It progresses from the first, haemolymphatic stage to a neurological second stage due to invasion of parasites into the central nervous system (CNS). As treatment depends on the stage of disease, there is a critical need for tools that efficiently discriminate the two stages of HAT. We hypothesized that markers of brain damage discovered by proteomic strategies and inflammation-related proteins could individually or in combination indicate the CNS invasion by the parasite. Methods Cerebrospinal fluid (CSF) originated from parasitologically confirmed Trypanosoma brucei gambiense patients. Patients were staged on the basis of CSF white blood cell (WBC) count and presence of parasites in CSF. One hundred samples were analysed: 21 from stage 1 (no trypanosomes in CSF and ≤5 WBC/µL) and 79 from stage 2 (trypanosomes in CSF and/or >5 WBC/µL) patients. The concentration of H-FABP, GSTP-1 and S100β in CSF was measured by ELISA. The levels of thirteen inflammation-related proteins (IL-1ra, IL-1β, IL-6, IL-9, IL-10, G-CSF, VEGF, IFN-γ, TNF-α, CCL2, CCL4, CXCL8 and CXCL10) were determined by bead suspension arrays. Results CXCL10 most accurately distinguished stage 1 and stage 2 patients, with a sensitivity of 84% and specificity of 100%. Rule Induction Like (RIL) analysis defined a panel characterized by CXCL10, CXCL8 and H-FABP that improved the detection of stage 2 patients to 97% sensitivity and 100% specificity. Conclusion This study highlights the value of CXCL10 as a single biomarker for staging T. b. gambiense-infected HAT patients. Further combination of CXCL10 with H-FABP and CXCL8 results in a panel that efficiently rules in stage 2 HAT patients. As these molecules could potentially be markers of other CNS infections and disorders, these results should be validated in a larger multi-centric cohort including other inflammatory diseases such as cerebral malaria and active tuberculosis.

Cerebrospinal fluid neopterin as marker of the meningo-encephalitic stage of Trypanosoma brucei gambiense sleeping sickness.

Background Sleeping sickness, or human African trypanosomiasis (HAT), is a protozoan disease that affects rural communities in sub-Saharan Africa. Determination of the disease stage, essential for correct treatment, represents a key issue in the management of patients. In the present study we evaluated the potential of CXCL10, CXCL13, ICAM-1, VCAM-1, MMP-9, B2MG, neopterin and IgM to complement current methods for staging Trypanosoma brucei gambiense patients. Methods and Findings Five hundred and twelve T. b. gambiense HAT patients originated from Angola, Chad and the Democratic Republic of the Congo (D.R.C.). Their classification as stage 2 (S2) was based on the number of white blood cells (WBC) (>5/µL) or presence of parasites in the cerebrospinal fluid (CSF). The CSF concentration of the eight markers was first measured on a training cohort encompassing 100 patients (44 S1 and 56 S2). IgM and neopterin were the best in discriminating between the two stages of disease with 86.4% and 84.1% specificity respectively, at 100% sensitivity. When a validation cohort (412 patients) was tested, neopterin (14.3 nmol/L) correctly classified 88% of S1 and S2 patients, confirming its high staging power. On this second cohort, neopterin also predicted both the presence of parasites, and of neurological signs, with the same ability as IgM and WBC, the current reference for staging. Conclusions This study has demonstrated that neopterin is an excellent biomarker for staging T. b. gambiense HAT patients. A rapid diagnostic test for detecting this metabolite in CSF could help in more accurate stage determination.

Discovery and verification of osteopontin and Beta-2-microglobulin as promising markers for staging human African trypanosomiasis

Human African trypanosomiasis, or sleeping sickness, is a parasitic disease endemic in sub-Saharan Africa, transmitted to humans through the bite of a tsetse fly. The first or hemolymphatic stage of the disease is associated with presence of parasites in the bloodstream, lymphatic system, and body tissues. If patients are left untreated, parasites cross the blood-brain barrier and invade the cerebrospinal fluid and the brain parenchyma, giving rise to the second or meningoencephalitic stage. Stage determination is a crucial step in guiding the choice of treatment, as drugs used for S2 are potentially dangerous. Current staging methods, based on counting white blood cells and demonstrating trypanosomes in cerebrospinal fluid, lack specificity and/or sensitivity. In the present study, we used several proteomic strategies to discover new markers with potential for staging human African trypanosomiasis. Cerebrospinal fluid (CSF) samples were collected from patients infected with Trypanosoma brucei gambiense in the Democratic Republic of Congo. The stage was determined following the guidelines of the national control program. The proteome of the samples was analyzed by two-dimensional gel electrophoresis (n = 9), and by sixplex tandem mass tag (TMT) isobaric labeling (n = 6) quantitative mass spectrometry. Overall, 73 proteins were overexpressed in patients presenting the second stage of the disease. Two of these, osteopontin and β-2-microglobulin, were confirmed to be potential markers for staging human African trypanosomiasis (HAT) by Western blot and ELISA. The two proteins significantly discriminated between S1 and S2 patients with high sensitivity (68% and 78%, respectively) for 100% specificity, and a combination of both improved the sensitivity to 91%. The levels of osteopontin and β-2-microglobulin in CSF of S2 patients (μg/ml range), as well as the fold increased concentration in S2 compared with S1 (3.8 and 5.5 respectively) make the two markers good candidates for the development of a test for staging HAT patients.

New biomarkers for stage determination in Trypanosoma brucei rhodesiense sleeping sickness patients

Accurate stage determination is crucial in the choice of treatment for patients suffering from sleeping sickness, also known as human African trypanosomiasis (HAT). Current staging methods, based on the counting of white blood cells (WBC) and the detection of parasites in the cerebrospinal fluid (CSF) have limited accuracy. We hypothesized that immune mediators reliable for staging T. b. gambiense HAT could also be used to stratify T. b. rhodesiense patients, the less common form of HAT.A population comprising 85 T. b. rhodesiense patients, 14 stage 1 (S1) and 71 stage 2 (S2) enrolled in Malawi and Uganda, was investigated. The CSF levels of IgM, MMP-9, CXCL13, CXCL10, ICAM-1, VCAM-1, neopterin and B2MG were measured and their staging performances evaluated using receiver operating characteristic (ROC) analyses.IgM, MMP-9 and CXCL13 were the most accurate markers for stage determination (partial AUC 88%, 86% and 85%, respectively). The combination in panels of three molecules comprising CXCL13-CXCL10-MMP-9 or CXCL13-CXCL10-IgM significantly increased their staging ability to partial AUC 94% (p value < 0.01).The present study highlighted new potential markers for stage determination of T. b. rhodesiense patients. Further investigations are needed to better evaluate these molecules, alone or in panels, as alternatives to WBC to make reliable choice of treatment.

Matrix metalloproteinase‐9 and intercellular adhesion molecule 1 are powerful staging markers for human African trypanosomiasis

Objectives  A critical step before treatment of human African trypanosomiasis (HAT) is the correct staging of the disease. As late stage is established when trypanosomes cross the blood–brain barrier and invade the central nervous system, we hypothesized that matrix metalloproteinases and cell adhesion molecules could indicate, alone or in combination, the disease progression from the first to the second stage of HAT.

Neopterin is a cerebrospinal fluid marker for treatment outcome evaluation in patients affected by Trypanosoma brucei gambiense sleeping sickness.

Background Post-therapeutic follow-up is essential to confirm cure and to detect early treatment failures in patients affected by sleeping sickness (HAT). Current methods, based on finding of parasites in blood and cerebrospinal fluid (CSF) and counting of white blood cells (WBC) in CSF, are imperfect. New markers for treatment outcome evaluation are needed. We hypothesized that alternative CSF markers, able to diagnose the meningo-encephalitic stage of the disease, could also be useful for the evaluation of treatment outcome. Methodology/Principal findings Cerebrospinal fluid from patients affected by Trypanosoma brucei gambiense HAT and followed for two years after treatment was investigated. The population comprised stage 2 (S2) patients either cured or experiencing treatment failure during the follow-up. IgM, neopterin, B2MG, MMP-9, ICAM-1, VCAM-1, CXCL10 and CXCL13 were first screened on a small number of HAT patients (n = 97). Neopterin and CXCL13 showed the highest accuracy in discriminating between S2 cured and S2 relapsed patients (AUC 99% and 94%, respectively). When verified on a larger cohort (n = 242), neopterin resulted to be the most efficient predictor of outcome. High levels of this molecule before treatment were already associated with an increased risk of treatment failure. At six months after treatment, neopterin discriminated between cured and relapsed S2 patients with 87% specificity and 92% sensitivity, showing a higher accuracy than white blood cell numbers. Conclusions/Significance In the present study, neopterin was highlighted as a useful marker for the evaluation of the post-therapeutic outcome in patients suffering from sleeping sickness. Detectable levels of this marker in the CSF have the potential to shorten the follow-up for HAT patients to six months after the end of the treatment.

Measuring Serum Amyloid A for Infection Prediction in Aneurysmal Subarachnoid Hemorrhage.

Aneurysmal subarachnoid hemorrhage (aSAH) is associated with high rates of mortality and morbidity. Nosocomial infections, such as pneumonia or urinary tract infections, are among the main causes of worsening outcomes and death. The aim of this study was to discover a biomarker to predict infection in aSAH patients. For this purpose, the plasma of infected and noninfected patients was compared using quantitative mass spectrometry. The most interesting differentially expressed proteins were selected for validation by immunoassays on plasma samples taken from patients (n = 81) over 10 days of hospitalization. Predictive performances were established using Mann-Whitney U tests and receiver operating characteristic curves. Quantitative proteomics identified 17 significantly regulated proteins. Of these, levels of serum amyloid A (SAA) were significantly higher in infected patients (p < 0.007). ELISA confirmed that the concentrations were significantly higher (p < 0.002) already at hospital admission in patients who subsequently developed an infection during their hospitalization, (AUC of 76%) for a cutoff value of 90.9 μg/mL. Our data suggested that measuring SAA could be an efficient means of detecting patients susceptible of developing an infection during hospitalization after an aSAH. Its predictive capacity could lead to earlier antibiotherapy, improved patient management, and potentially better long-term outcomes.

Neopterin plasma concentrations in patients with aneurysmal subarachnoid hemorrhage: correlation with infection and long-term outcome.

OBJECT Aneurysmal subarachnoid hemorrhage (aSAH) is associated with high rates of mortality and morbidity. The main predictor for the poor outcome is the World Federation of Neurosurgical Societies (WFNS) scale. However, this scale does not take into account proinflammatory events, such as infection occurring after the aSAH, which could modify the long-term status of patients. The aim of this study was to evaluate neopterin as an inflammatory biomarker for outcome and infection prediction in aSAH patients. METHODS Plasma concentrations of neopterin were measured in 61 aSAH patients (22 male and 39 female; mean age [± SD] 52.8 ± 11.8 years) using a commercial ELISA kit. Samples were collected daily for 10 days. Outcome at 12 months was determined using the Glasgow Outcome Scale (GOS) and dichotomized as poor (GOS score 1, 2, or 3) or good (GOS score 4 or 5). Infection was determined by the presence of a positive bacterial culture. RESULTS Patients with poor outcome at 12 months had higher concentrations of neopterin than patients with good outcome. In the same way, patients who had an infection during the hospitalization had significantly higher concentrations of neopterin than patients without infection (p = 0.001). Moreover, neopterin concentrations were significantly (p < 0.008) elevated in infected patients 2 days before infection detection and antibiotic therapy. CONCLUSIONS Neopterin is an efficient outcome predictor after aSAH. Furthermore, it is able to differentiate between infected and uninfected patients as early as 2 days before clinical signs of infection, facilitating earlier antibiotic therapy and better management.

Sleeping Sickness in the ‘Omics Era

Sleeping sickness is a neglected tropical disease caused by Trypanosoma brucei parasites, affecting the poorest communities in sub‐Saharan Africa. The great efforts done by the scientific community, local governments, and non‐governmental organizations (NGOs) via active patients’ screening, vector control, and introduction of improved treatment regimens have significantly contributed to the reduction of human African trypanosomiasis (HAT) incidence during the last 15 years. Consequently, the WHO has announced the objective of HAT elimination as a public health problem by 2020. Studies at both parasite and host levels have improved our understanding of the parasite biology and the mechanisms of parasite interaction with its mammalian host. In this review, the impact that ‘omics studies have had on sleeping sickness by revealing novel properties of parasites subcellular organelles are summarized, by highlighting changes induced in the host during the infection and by proposing potential disease markers and therapeutic targets.