Ruth Hüttenhain

mProphet: automated data processing and statistical validation for large-scale SRM experiments

Selected reaction monitoring (SRM) is a targeted mass spectrometric method that is increasingly used in proteomics for the detection and quantification of sets of preselected proteins at high sensitivity, reproducibility and accuracy. Currently, data from SRM measurements are mostly evaluated subjectively by manual inspection on the basis of ad hoc criteria, precluding the consistent analysis of different data sets and an objective assessment of their error rates. Here we present mProphet, a fully automated system that computes accurate error rates for the identification of targeted peptides in SRM data sets and maximizes specificity and sensitivity by combining relevant features in the data into a statistical model.

Targeted Peptide Measurements in Biology and Medicine: Best Practices for Mass Spectrometry-based Assay Development Using a Fit-for-Purpose Approach

Adoption of targeted mass spectrometry (MS) approaches such as multiple reaction monitoring (MRM) to study biological and biomedical questions is well underway in the proteomics community. Successful application depends on the ability to generate reliable assays that uniquely and confidently identify target peptides in a sample. Unfortunately, there is a wide range of criteria being applied to say that an assay has been successfully developed. There is no consensus on what criteria are acceptable and little understanding of the impact of variable criteria on the quality of the results generated. Publications describing targeted MS assays for peptides frequently do not contain sufficient information for readers to establish confidence that the tests work as intended or to be able to apply the tests described in their own labs. Guidance must be developed so that targeted MS assays with established performance can be made widely distributed and applied by many labs worldwide. To begin to address the problems and their solutions, a workshop was held at the National Institutes of Health with representatives from the multiple communities developing and employing targeted MS assays. Participants discussed the analytical goals of their experiments and the experimental evidence needed to establish that the assays they develop work as intended and are achieving the required levels of performance. Using this “fit-for-purpose” approach, the group defined three tiers of assays distinguished by their performance and extent of analytical characterization. Computational and statistical tools useful for the analysis of targeted MS results were described. Participants also detailed the information that authors need to provide in their manuscripts to enable reviewers and readers to clearly understand what procedures were performed and to evaluate the reliability of the peptide or protein quantification measurements reported. This paper presents a summary of the meeting and recommendations.

On the development of plasma protein biomarkers.

The development of plasma biomarkers has proven to be more challenging than initially anticipated. Many studies have reported lists of candidate proteins rather than validated candidate markers with an assigned performance to a specific clinical objective. Biomarker research necessitates a clear rational framework with requirements on a multitude of levels. On the technological front, the platform needs to be effective to detect low abundant plasma proteins and be able to measure them in a high throughput manner over a large amount of samples reproducibly. At a conceptual level, the choice of the technological platform and available samples should be part of an overall clinical study design that depends on a joint effort between basic and clinical research. Solutions to these needs are likely to facilitate more feasible studies. Targeted proteomic workflows based on SRM mass spectrometry show the potential of fast verification of biomarker candidates in plasma and thereby closing the gap between discovery and validation in the biomarker development pipeline. Biological samples need to be carefully chosen based on well-established guidelines either for candidate discovery in the form of disease models with optimal fidelity to human disease or for candidate evaluation as well-designed and annotated clinical cohort groups. Most importantly, they should be representative of the target population and directly address the investigated clinical question. A conceptual structure of a biomarker study can be provided in the form of several sequential phases, each having clear objectives and predefined goals. Furthermore, guidelines for reporting the outcome of biomarker studies are critical to adequately assess the quality of the research, interpretation and generalization of the results. By being attentive to and applying these considerations, biomarker research should become more efficient and lead to directly translatable biomarker candidates into clinical evaluation.

Reproducible quantification of cancer-associated proteins in body fluids using targeted proteomics

A compendium of SRM assays for cancer-associated proteins provides a resource for accelerating and planning biomarker verification studies. Dealing with Data Overload With the exponential blossoming of information sources—from 24-hour news to blogs to Twitter feeds—it can be difficult to differentiate fact from fiction. Translational medicine is experiencing a parallel mushrooming of data in research on disease biomarkers. Whereas marker validation once occurred on a case by case basis, the literature now bulges with potential biomarkers at diverse stages of validation, and researchers and clinicians are hard-pressed to make sense of it all. Now, Hüttenhain et al. provide a modern validation method that can keep up with the current pace of biomarker-candidate generation. The authors report on a high-throughput method for developing selected reaction-monitoring (SRM) assays (targeted mass spectrometry) for human proteins. SRM assays can be run in parallel and have low limits of detection and high accuracy. They then used these assays—for more than 1000 cancer-associated proteins—to determine the detectability of the target proteins in plasma and urine from cancer patients and healthy controls. They detected 182 proteins in plasma and 408 in urine, and reproducibly quantified 34 biomarker candidates across 83 patient plasma samples. These SRM assays can be broadly applied for cancer-associated biomarker validation and should help provide a filter to stem information overload. The rigorous testing of hypotheses on suitable sample cohorts is a major limitation in translational research. This is particularly the case for the validation of protein biomarkers; the lack of accurate, reproducible, and sensitive assays for most proteins has precluded the systematic assessment of hundreds of potential marker proteins described in the literature. Here, we describe a high-throughput method for the development and refinement of selected reaction monitoring (SRM) assays for human proteins. The method was applied to generate such assays for more than 1000 cancer-associated proteins, which are functionally related to candidate cancer driver mutations. We used the assays to determine the detectability of the target proteins in two clinically relevant samples: plasma and urine. One hundred eighty-two proteins were detected in depleted plasma, spanning five orders of magnitude in abundance and reaching below a concentration of 10 ng/ml. The narrower concentration range of proteins in urine allowed the detection of 408 proteins. Moreover, we demonstrate that these SRM assays allow reproducible quantification by monitoring 34 biomarker candidates across 83 patient plasma samples. Through public access to the entire assay library, researchers will be able to target their cancer-associated proteins of interest in any sample type using the detectability information in plasma and urine as a guide. The generated expandable reference map of SRM assays for cancer-associated proteins will be a valuable resource for accelerating and planning biomarker verification studies.

Quantitative measurements of N-linked glycoproteins in human plasma by SWATH-MS.

SWATH‐MS is a data‐independent acquisition method that generates, in a single measurement, a complete recording of the fragment ion spectra of all the analytes in a biological sample for which the precursor ions are within a predetermined m/z versus retention time window. To assess the performance and suitability of SWATH‐MS‐based protein quantification for clinical use, we compared SWATH‐MS and SRM‐MS‐based quantification of N‐linked glycoproteins in human plasma, a commonly used sample for biomarker discovery. Using dilution series of isotopically labeled heavy peptides representing biomarker candidates, the LOQ of SWATH‐MS was determined to reach 0.0456 fmol at peptide level by targeted data analysis, which corresponds to a concentration of 5–10 ng protein/mL in plasma, while SRM reached a peptide LOQ of 0.0152 fmol. Moreover, the quantification of endogenous glycoproteins using SWATH‐MS showed a high degree of reproducibility, with the mean CV of 14.90%, correlating well with SRM results (R2 = 0.9784). Overall, SWATH‐MS measurements showed a slightly lower sensitivity and a comparable reproducibility to state‐of‐the‐art SRM measurements for targeted quantification of the N‐glycosites in human blood. However, a significantly larger number of peptides can be quantified per analysis. We suggest that SWATH‐MS analysis combined with N‐glycoproteome enrichment in plasma samples is a promising integrative proteomic approach for biomarker discovery and verification.

Perspectives of targeted mass spectrometry for protein biomarker verification.

The identification of specific biomarkers will improve the early diagnosis of disease, facilitate the development of targeted therapies, and provide an accurate method to monitor treatment response. A major challenge in the process of verifying biomarker candidates in blood plasma is the complexity and high dynamic range of proteins. This article reviews the current, targeted proteomic strategies that are capable of quantifying biomarker candidates at concentration ranges where biomarkers are expected in plasma (i.e. at the ng/ml level). In addition, a workflow is presented that allows the fast and definitive generation of targeted mass spectrometry-based assays for most biomarker candidate proteins. These assays are stored in publicly accessible databases and have the potential to greatly impact the throughput of biomarker verification studies.

PASSEL: The PeptideAtlas SRMexperiment library

Public repositories for proteomics data have accelerated proteomics research by enabling more efficient cross‐analyses of datasets, supporting the creation of protein and peptide compendia of experimental results, supporting the development and testing of new software tools, and facilitating the manuscript review process. The repositories available to date have been designed to accommodate either shotgun experiments or generic proteomic data files. Here, we describe a new kind of proteomic data repository for the collection and representation of data from selected reaction monitoring (SRM) measurements. The PeptideAtlas SRM Experiment Library (PASSEL) allows researchers to easily submit proteomic data sets generated by SRM. The raw data are automatically processed in a uniform manner and the results are stored in a database, where they may be downloaded or browsed via a web interface that includes a chromatogram viewer. PASSELenables cross‐analysis of SRMdata, supports optimization of SRMdata collection, and facilitates the review process of SRMdata. Further, PASSELwill help in the assessment of proteotypic peptide performance in a wide array of samples containing the same peptide, as well as across multiple experimental protocols.

Protein significance analysis in selected reaction monitoring (SRM) measurements

Selected reaction monitoring (SRM) is a targeted mass spectrometry technique that provides sensitive and accurate protein detection and quantification in complex biological mixtures. Statistical and computational tools are essential for the design and analysis of SRM experiments, particularly in studies with large sample throughput. Currently, most such tools focus on the selection of optimized transitions and on processing signals from SRM assays. Little attention is devoted to protein significance analysis, which combines the quantitative measurements for a protein across isotopic labels, peptides, charge states, transitions, samples, and conditions, and detects proteins that change in abundance between conditions while controlling the false discovery rate. We propose a statistical modeling framework for protein significance analysis. It is based on linear mixed-effects models and is applicable to most experimental designs for both isotope label-based and label-free SRM workflows. We illustrate the utility of the framework in two studies: one with a group comparison experimental design and the other with a time course experimental design. We further verify the accuracy of the framework in two controlled data sets, one from the NCI-CPTAC reproducibility investigation and the other from an in-house spike-in study. The proposed framework is sensitive and specific, produces accurate results in broad experimental circumstances, and helps to optimally design future SRM experiments. The statistical framework is implemented in an open-source R-based software package SRMstats, and can be used by researchers with a limited statistics background as a stand-alone tool or in integration with the existing computational pipelines.

Mass spectrometric protein maps for biomarker discovery and clinical research

Among the wide range of proteomic technologies, targeted mass spectrometry (MS) has shown great potential for biomarker studies. To extend the degree of multiplexing achieved by selected reaction monitoring (SRM), we recently developed SWATH MS. SWATH MS is a variant of the emerging class of data-independent acquisition (DIA) methods and essentially converts the molecules in a physical sample into perpetually re-usable digital maps. The thus generated SWATH maps are then mined using a targeted data extraction strategy, allowing us to profile disease-related proteomes at a high degree of reproducibility. The successful application of both SRM and SWATH MS requires the a priori generation of reference spectral maps that provide coordinates for quantification. Herein, we demonstrate that the application of the mass spectrometric reference maps and the acquisition of personalized SWATH maps hold a particular promise for accelerating the current process of biomarker discovery.

Automated selected reaction monitoring data analysis workflow for large-scale targeted proteomic studies

Targeted proteomics based on selected reaction monitoring (SRM) mass spectrometry is commonly used for accurate and reproducible quantification of protein analytes in complex biological mixtures. Strictly hypothesis-driven, SRM assays quantify each targeted protein by collecting measurements on its peptide fragment ions, called transitions. To achieve sensitive and accurate quantitative results, experimental design and data analysis must consistently account for the variability of the quantified transitions. This consistency is especially important in large experiments, which increasingly require profiling up to hundreds of proteins over hundreds of samples. Here we describe a robust and automated workflow for the analysis of large quantitative SRM data sets that integrates data processing, statistical protein identification and quantification, and dissemination of the results. The integrated workflow combines three software tools: mProphet for peptide identification via probabilistic scoring; SRMstats for protein significance analysis with linear mixed-effect models; and PASSEL, a public repository for storage, retrieval and query of SRM data. The input requirements for the protocol are files with SRM traces in mzXML format, and a file with a list of transitions in a text tab-separated format. The protocol is especially suited for data with heavy isotope–labeled peptide internal standards. We demonstrate the protocol on a clinical data set in which the abundances of 35 biomarker candidates were profiled in 83 blood plasma samples of subjects with ovarian cancer or benign ovarian tumors. The time frame to realize the protocol is 1–2 weeks, depending on the number of replicates used in the experiment.