Xavier Arnaud Robin

pROC: an open-source package for R and S+ to analyze and compare ROC curves

BackgroundReceiver operating characteristic (ROC) curves are useful tools to evaluate classifiers in biomedical and bioinformatics applications. However, conclusions are often reached through inconsistent use or insufficient statistical analysis. To support researchers in their ROC curves analysis we developed pROC, a package for R and S+ that contains a set of tools displaying, analyzing, smoothing and comparing ROC curves in a user-friendly, object-oriented and flexible interface.ResultsWith data previously imported into the R or S+ environment, the pROC package builds ROC curves and includes functions for computing confidence intervals, statistical tests for comparing total or partial area under the curve or the operating points of different classifiers, and methods for smoothing ROC curves. Intermediary and final results are visualised in user-friendly interfaces. A case study based on published clinical and biomarker data shows how to perform a typical ROC analysis with pROC.ConclusionspROC is a package for R and S+ specifically dedicated to ROC analysis. It proposes multiple statistical tests to compare ROC curves, and in particular partial areas under the curve, allowing proper ROC interpretation. pROC is available in two versions: in the R programming language or with a graphical user interface in the S+ statistical software. It is accessible at http://expasy.org/tools/pROC/ under the GNU General Public License. It is also distributed through the CRAN and CSAN public repositories, facilitating its installation.

KinomeXplorer: an integrated platform for kinome biology studies

or even impossible to be captured by cellular or in vivo experiments alone. Furthermore, it is difficult to design kinase perturbation experiments, because the kinome-wide selectivity and specificity of many kinase inhibitors is unknown3,4. As a result, knowledge is lacking on which of the ~540 human kinases phosphorylate a given site: of the 42,914 phosphorylation sites currently annotated in the Phospho.ELM database5, only ~20% have been linked to a kinase. Technological advances in mass spectrometry–based phosphoproteomics have accelerated the ability to identify phosphorylation sites but not to determine which kinases phosphorylate them. To systematically identify these dynamic interactions, computational methods to guide experiments must be deployed. We have shown that combining computational algorithms with quantitative mass spectrometry is a powerful approach to validate kinase-substrate relationships6. Notably, we have shown that kinase specificity can be described in terms of two main contributing elements: the recognition motif of the individual kinase (for example, X-S/T-Q-X for the ATM kinase) and proteins that can be functionally associated with it (i.e., not just proteins that directly interact with the kinase). The network context of kinases is crucial, as exemplified by the discovery that the phenotypic role of the JNK kinase depends entirely on the state of the cellular signaling networks before its activation7. In other words, it is crucial to assess the protein networks embedding kinases and how these are dynamically modulated (for example, through time or perturbations) to predict cell behavior8. KinomeXplorer (Fig. 1) provides workflows that enable researchers to efficiently analyze phosphorylationd e p e n d e nt i n t e r a c t i o n n e t w o r k s (Supplementary Fig. 1) and aids them in designing follow-up perturbation experiments. The platform includes improved versions of NetworKIN (an algorithm that integrates cellular context information and motif-based predictions)6 and NetPhorest (a phylogenetic tree–based algorithm to classify phosphorylation sites in terms of kinases and phosphobinding domains)9, conferring increased prediction accuracy through a novel Bayesian scoring scheme, broader kinome coverage, new phosphatome coverage and a redesigned unifying web interface. The framework also integrates the new KinomeSelector tool, which enables the user to select an optimal kinase panel to functionally perturb the predicted phosphorylation signaling networks. We re-engineered the NetworKIN algorithm to improve its performance and usability (Supplementary Note). To calculate the NetworKIN score, we combined the NetPhorest probability and the STRING-derived proximity score using KinomeXplorer: an integrated platform for kinome biology studies

A combined CXCL10, CXCL8 and H-FABP panel for the staging of human African trypanosomiasis patients

Background Human African trypanosomiasis (HAT), also known as sleeping sickness, is a parasitic tropical disease. It progresses from the first, haemolymphatic stage to a neurological second stage due to invasion of parasites into the central nervous system (CNS). As treatment depends on the stage of disease, there is a critical need for tools that efficiently discriminate the two stages of HAT. We hypothesized that markers of brain damage discovered by proteomic strategies and inflammation-related proteins could individually or in combination indicate the CNS invasion by the parasite. Methods Cerebrospinal fluid (CSF) originated from parasitologically confirmed Trypanosoma brucei gambiense patients. Patients were staged on the basis of CSF white blood cell (WBC) count and presence of parasites in CSF. One hundred samples were analysed: 21 from stage 1 (no trypanosomes in CSF and ≤5 WBC/µL) and 79 from stage 2 (trypanosomes in CSF and/or >5 WBC/µL) patients. The concentration of H-FABP, GSTP-1 and S100β in CSF was measured by ELISA. The levels of thirteen inflammation-related proteins (IL-1ra, IL-1β, IL-6, IL-9, IL-10, G-CSF, VEGF, IFN-γ, TNF-α, CCL2, CCL4, CXCL8 and CXCL10) were determined by bead suspension arrays. Results CXCL10 most accurately distinguished stage 1 and stage 2 patients, with a sensitivity of 84% and specificity of 100%. Rule Induction Like (RIL) analysis defined a panel characterized by CXCL10, CXCL8 and H-FABP that improved the detection of stage 2 patients to 97% sensitivity and 100% specificity. Conclusion This study highlights the value of CXCL10 as a single biomarker for staging T. b. gambiense-infected HAT patients. Further combination of CXCL10 with H-FABP and CXCL8 results in a panel that efficiently rules in stage 2 HAT patients. As these molecules could potentially be markers of other CNS infections and disorders, these results should be validated in a larger multi-centric cohort including other inflammatory diseases such as cerebral malaria and active tuberculosis.

EasyProt - An easy-to-use graphical platform for proteomics data analysis

High throughput protein identification and quantification analysis based on mass spectrometry are fundamental steps in most proteomics projects. Here, we present EasyProt (available at http://easyprot.unige.ch), a new platform for mass spectrometry data processing, protein identification, quantification and unexpected post-translational modification characterization. EasyProt provides a fully integrated graphical experience to perform a large part of the proteomic data analysis workflow. Our goal was to develop a software platform that would fulfill the needs of scientists in the field, while emphasizing ease-of-use for non-bioinformatician users. Protein identification is based on OLAV scoring schemes and protein quantification is implemented for both, isobaric labeling and label-free methods. Additional features are available, such as peak list processing, isotopic correction, spectra filtering, charge-state deconvolution and spectra merging. To illustrate the EasyProt platform, we present two identification and quantification workflows based on isobaric tagging and label-free methods.

Cerebrospinal fluid neopterin as marker of the meningo-encephalitic stage of Trypanosoma brucei gambiense sleeping sickness.

Background Sleeping sickness, or human African trypanosomiasis (HAT), is a protozoan disease that affects rural communities in sub-Saharan Africa. Determination of the disease stage, essential for correct treatment, represents a key issue in the management of patients. In the present study we evaluated the potential of CXCL10, CXCL13, ICAM-1, VCAM-1, MMP-9, B2MG, neopterin and IgM to complement current methods for staging Trypanosoma brucei gambiense patients. Methods and Findings Five hundred and twelve T. b. gambiense HAT patients originated from Angola, Chad and the Democratic Republic of the Congo (D.R.C.). Their classification as stage 2 (S2) was based on the number of white blood cells (WBC) (>5/µL) or presence of parasites in the cerebrospinal fluid (CSF). The CSF concentration of the eight markers was first measured on a training cohort encompassing 100 patients (44 S1 and 56 S2). IgM and neopterin were the best in discriminating between the two stages of disease with 86.4% and 84.1% specificity respectively, at 100% sensitivity. When a validation cohort (412 patients) was tested, neopterin (14.3 nmol/L) correctly classified 88% of S1 and S2 patients, confirming its high staging power. On this second cohort, neopterin also predicted both the presence of parasites, and of neurological signs, with the same ability as IgM and WBC, the current reference for staging. Conclusions This study has demonstrated that neopterin is an excellent biomarker for staging T. b. gambiense HAT patients. A rapid diagnostic test for detecting this metabolite in CSF could help in more accurate stage determination.

Discovery and verification of osteopontin and Beta-2-microglobulin as promising markers for staging human African trypanosomiasis

Human African trypanosomiasis, or sleeping sickness, is a parasitic disease endemic in sub-Saharan Africa, transmitted to humans through the bite of a tsetse fly. The first or hemolymphatic stage of the disease is associated with presence of parasites in the bloodstream, lymphatic system, and body tissues. If patients are left untreated, parasites cross the blood-brain barrier and invade the cerebrospinal fluid and the brain parenchyma, giving rise to the second or meningoencephalitic stage. Stage determination is a crucial step in guiding the choice of treatment, as drugs used for S2 are potentially dangerous. Current staging methods, based on counting white blood cells and demonstrating trypanosomes in cerebrospinal fluid, lack specificity and/or sensitivity. In the present study, we used several proteomic strategies to discover new markers with potential for staging human African trypanosomiasis. Cerebrospinal fluid (CSF) samples were collected from patients infected with Trypanosoma brucei gambiense in the Democratic Republic of Congo. The stage was determined following the guidelines of the national control program. The proteome of the samples was analyzed by two-dimensional gel electrophoresis (n = 9), and by sixplex tandem mass tag (TMT) isobaric labeling (n = 6) quantitative mass spectrometry. Overall, 73 proteins were overexpressed in patients presenting the second stage of the disease. Two of these, osteopontin and β-2-microglobulin, were confirmed to be potential markers for staging human African trypanosomiasis (HAT) by Western blot and ELISA. The two proteins significantly discriminated between S1 and S2 patients with high sensitivity (68% and 78%, respectively) for 100% specificity, and a combination of both improved the sensitivity to 91%. The levels of osteopontin and β-2-microglobulin in CSF of S2 patients (μg/ml range), as well as the fold increased concentration in S2 compared with S1 (3.8 and 5.5 respectively) make the two markers good candidates for the development of a test for staging HAT patients.

New biomarkers for stage determination in Trypanosoma brucei rhodesiense sleeping sickness patients

Accurate stage determination is crucial in the choice of treatment for patients suffering from sleeping sickness, also known as human African trypanosomiasis (HAT). Current staging methods, based on the counting of white blood cells (WBC) and the detection of parasites in the cerebrospinal fluid (CSF) have limited accuracy. We hypothesized that immune mediators reliable for staging T. b. gambiense HAT could also be used to stratify T. b. rhodesiense patients, the less common form of HAT.A population comprising 85 T. b. rhodesiense patients, 14 stage 1 (S1) and 71 stage 2 (S2) enrolled in Malawi and Uganda, was investigated. The CSF levels of IgM, MMP-9, CXCL13, CXCL10, ICAM-1, VCAM-1, neopterin and B2MG were measured and their staging performances evaluated using receiver operating characteristic (ROC) analyses.IgM, MMP-9 and CXCL13 were the most accurate markers for stage determination (partial AUC 88%, 86% and 85%, respectively). The combination in panels of three molecules comprising CXCL13-CXCL10-MMP-9 or CXCL13-CXCL10-IgM significantly increased their staging ability to partial AUC 94% (p value < 0.01).The present study highlighted new potential markers for stage determination of T. b. rhodesiense patients. Further investigations are needed to better evaluate these molecules, alone or in panels, as alternatives to WBC to make reliable choice of treatment.

Bioinformatics for protein biomarker panel classification: what is needed to bring biomarker panels into in vitro diagnostics?

A large number of biomarkers have been discovered over the past few years using proteomics techniques. Unfortunately, most of them are neither specific nor sensitive enough to be translated into in vitro diagnostics and routine clinical practice. From this observation, the idea of combining several markers into panels to improve clinical performances has emerged. In this article, we present a discussion of the bioinformatics aspects of biomarker panels and the concomitant challenges, including high dimensionality and low patient number and reproducibility.

Matrix metalloproteinase‐9 and intercellular adhesion molecule 1 are powerful staging markers for human African trypanosomiasis

Objectives  A critical step before treatment of human African trypanosomiasis (HAT) is the correct staging of the disease. As late stage is established when trypanosomes cross the blood–brain barrier and invade the central nervous system, we hypothesized that matrix metalloproteinases and cell adhesion molecules could indicate, alone or in combination, the disease progression from the first to the second stage of HAT.

Neopterin is a cerebrospinal fluid marker for treatment outcome evaluation in patients affected by Trypanosoma brucei gambiense sleeping sickness.

Background Post-therapeutic follow-up is essential to confirm cure and to detect early treatment failures in patients affected by sleeping sickness (HAT). Current methods, based on finding of parasites in blood and cerebrospinal fluid (CSF) and counting of white blood cells (WBC) in CSF, are imperfect. New markers for treatment outcome evaluation are needed. We hypothesized that alternative CSF markers, able to diagnose the meningo-encephalitic stage of the disease, could also be useful for the evaluation of treatment outcome. Methodology/Principal findings Cerebrospinal fluid from patients affected by Trypanosoma brucei gambiense HAT and followed for two years after treatment was investigated. The population comprised stage 2 (S2) patients either cured or experiencing treatment failure during the follow-up. IgM, neopterin, B2MG, MMP-9, ICAM-1, VCAM-1, CXCL10 and CXCL13 were first screened on a small number of HAT patients (n = 97). Neopterin and CXCL13 showed the highest accuracy in discriminating between S2 cured and S2 relapsed patients (AUC 99% and 94%, respectively). When verified on a larger cohort (n = 242), neopterin resulted to be the most efficient predictor of outcome. High levels of this molecule before treatment were already associated with an increased risk of treatment failure. At six months after treatment, neopterin discriminated between cured and relapsed S2 patients with 87% specificity and 92% sensitivity, showing a higher accuracy than white blood cell numbers. Conclusions/Significance In the present study, neopterin was highlighted as a useful marker for the evaluation of the post-therapeutic outcome in patients suffering from sleeping sickness. Detectable levels of this marker in the CSF have the potential to shorten the follow-up for HAT patients to six months after the end of the treatment.