Chin-Hsien Tai

Assessment of template‐free modeling in CASP10 and ROLL

We present the assessment of predictions for Template‐Free Modeling in CASP10 and a report on the first ROLL experiment wherein predictions are collected year round for review at the regular CASP season. Models were first clustered so that duplicated or very similar ones were grouped together and represented by one model in the cluster. The representatives were then compared with targets using GDT_TS, QCS, and three additional superposition‐independent score functions newly developed for CASP10. For each target, the top 15 representatives by each score were pooled to form the Top15Union set. All models in this set were visually inspected by four of us independently using the new plugin, EvalScore, which we developed with the UCSF Chimera group. The best models were selected for each target after extensive debate among the four examiners. Groups were ranked by the number of targets (hits) for which a groups model was selected as one of the best models. The Keasar group had most hits in both categories, with four of 19 FM and eight of 36 ROLL targets. The most successful prediction servers were QUARK from Zhangs group for FM category with three hits and Zhang‐server for the ROLL category with seven hits. As observed in CASP9, many successful groups were not true “template‐free” modelers but used remote templates and/or server models to obtain their winning models. The results of the first ROLL experiment were broadly similar to those of the CASP10 FM exercise. Proteins 2014; 82(Suppl 2):57–83.

Assessment of CASP6 predictions for new and nearly new fold targets

This is a report of the assessment of the predictions made for the CASP6 protein structure prediction experiment conducted in 2004 in the New Fold (NF) category. There were nine protein domains that were judged to have new folds (NF) and 16 for which a similar structure was known but the sequence similarity was judged to be too low for them to be easily recognized (FR/A). We selected all NF targets and eight of the 16 FR/A targets judged to be at the borderline between NF and FR/A for evaluation in the NF category. A total of 165 prediction groups submitted over 7400 structural models for these targets. The quality of these models was evaluated using the GDT_TS scores of the structural similarity detection program LGA and by visual inspection of the top‐scoring models. The best models submitted bore an overall similarity to the target structure for three or four of the nine NF targets and for all but one of the FR/A targets. High‐scoring models for the NF targets were submitted by several different groups. When both the NF and FR/A targets were considered, Baker group dominated by submitting best models for seven of the 17 targets, but 14 other groups also managed to submit best models for one or more targets. Proteins 2005;Suppl 7:67–83.

Evaluation of domain prediction in CASP6

We present an analysis of the domain boundary prediction, a new category, in the sixth community‐wide experiment on the Critical Assessment of Techniques for Protein Structure Prediction (CASP6). There were 1011 predictions submitted for 63 targets. Each prediction was compared to the set of domains defined manually by visual inspection of the experimental structure. The comparison was scored using a new domain prediction scoring scheme. As the definition of a domain is subjective, many targets were assigned alternate definitions. For such targets, each prediction was compared with all different definitions and the best score was chosen. The predictors found it difficult to accurately predict domain boundaries when the target protein contained many domains or domains made of multiple sequence segments. The CBRC‐DR (P0536) and Sternberg (P0237) groups were the most successful among human experts, while Baker‐Rossettadom (P0353) and Baker‐Robetta‐Ginzu (P0421) did well among servers. Proteins 2005;Suppl 7:183–192.

Towards an automatic classification of protein structural domains based on structural similarity

BackgroundFormal classification of a large collection of protein structures aids the understanding of evolutionary relationships among them. Classifications involving manual steps, such as SCOP and CATH, face the challenge of increasing volume of available structures. Automatic methods such as FSSP or Dali Domain Dictionary, yield divergent classifications, for reasons not yet fully investigated. One possible reason is that the pairwise similarity scores used in automatic classification do not adequately reflect the judgments made in manual classification. Another possibility is the difference between manual and automatic classification procedures. We explore the degree to which these two factors might affect the final classification.ResultsWe use DALI, SHEBA and VAST pairwise scores on the SCOP C class domains, to investigate a variety of hierarchical clustering procedures. The constructed dendrogram is cut in a variety of ways to produce a partition, which is compared to the SCOP fold classification.Wards method dendrograms led to partitions closest to the SCOP fold classification. Dendrogram- or tree-cutting strategies fell into four categories according to the similarity of resulting partitions to the SCOP fold partition. Two strategies which optimize similarity to SCOP, gave an average of 72% true positives rate (TPR), at a 1% false positive rate. Cutting the largest size cluster at each step gave an average of 61% TPR which was one of the best strategies not making use of prior knowledge of SCOP. Cutting the longest branch at each step produced one of the worst strategies.We also developed a method to detect irreducible differences between the best possible automatic partitions and SCOP, regardless of the cutting strategy. These differences are substantial. Visual examination of hard-to-classify proteins confirms our previous finding, that global structural similarity of domains is not the only criterion used in the SCOP classification.ConclusionDifferent clustering procedures give rise to different levels of agreement between automatic and manual protein classifications. None of the tested procedures completely eliminates the divergence between automatic and manual protein classifications. Achieving full agreement between these two approaches would apparently require additional information.

Assessment of CASP10 contact‐assisted predictions

In CASP10, for the first time, contact‐assisted structure predictions have been assessed. Sets of pairs of contacting residues from target structures were provided to predictors for a second round of prediction after the initial round in which they were given only sequences. The objective of the experiment was to measure model quality improvement resulting from the added contact information and thereby assess and help develop so‐called hybrid prediction methods—methods where some experimentally determined distance constraints are used to augment de novo computational prediction methods. The results of the experiment were, overall, quite promising. Proteins 2014; 82(Suppl 2):84–97.

Definition and classification of evaluation units for CASP10.

For the 10th experiment on Critical Assessment of the techniques of protein Structure Prediction (CASP), the prediction target proteins were broken into independent evaluation units (EUs), which were then classified into template‐based modeling (TBM) or free modeling (FM) categories. We describe here how the EUs were defined and classified, what issues arose in the process, and how we resolved them. EUs are frequently not the whole target proteins but the constituting structural domains. However, the assessors from CASP7 on combined more than one domain into 1 EU for some targets, which implied that the assessment also included evaluation of the prediction of the relative position and orientation of these domains. In CASP10, we followed and expanded this notion by defining multidomain EUs for a number of targets. These included 3 EUs, each made of two domains of familiar fold but arranged in a novel manner and for which the focus of evaluation was the interdomain arrangement. An EU was classified to the TBM category if a template could be found by sequence similarity searches and to FM if a structural template could not be found by structural similarity searches. The EUs that did not fall cleanly in either of these cases were classified case‐by‐case, often including consideration of the overall quality and characteristics of the predictions. Proteins 2014; 82(Suppl 2):14–25.

Poor correlation between T-cell activation assays and HLA-DR binding prediction algorithms in an immunogenic fragment of Pseudomonas exotoxin A

The ability to identify immunogenic determinants that activate T-cells is important for the development of new vaccines, allergy therapy and protein therapeutics. In silico MHC-II binding prediction algorithms are often used for T-cell epitope identification. To understand how well those programs predict immunogenicity, we computed HLA binding to peptides spanning the sequence of PE38, a fragment of an anti-cancer immunotoxin, and compared the predicted and experimentally identified T-cell epitopes. We found that the prediction for individual donors did not correlate well with the experimental data. Furthermore, prediction of T-cell epitopes in an HLA heterogenic population revealed that the two strongest epitopes were predicted at multiple cutoffs but the third epitope was predicted negative at all cutoffs and overall 4/9 epitopes were missed at several cutoffs. We conclude that MHC class-II binding predictions are not sufficient to predict the T-cell epitopes in PE38 and should be supplemented by experimental work.

Protein domain assignment from the recurrence of locally similar structures

Domains are basic units of protein structure and essential for exploring protein fold space and structure evolution. With the structural genomics initiative, the number of protein structures in the Protein Databank (PDB) is increasing dramatically and domain assignments need to be done automatically. Most existing structural domain assignment programs define domains using the compactness of the domains and/or the number and strength of intra‐domain versus inter‐domain contacts. Here we present a different approach based on the recurrence of locally similar structural pieces (LSSPs) found by one‐against‐all structure comparisons with a dataset of 6373 protein chains from the PDB. Residues of the query protein are clustered using LSSPs via three different procedures to define domains. This approach gives results that are comparable to several existing programs that use geometrical and other structural information explicitly. Remarkably, most of the proteins that contribute the LSSPs defining a domain do not themselves contain the domain of interest. This study shows that domains can be defined by a collection of relatively small locally similar structural pieces containing, on average, four secondary structure elements. In addition, it indicates that domains are indeed made of recurrent small structural pieces that are used to build protein structures of many different folds as suggested by recent studies. Proteins 2011. Published 2010 Wiley‐Liss, Inc.

Combining Local Immunotoxins Targeting Mesothelin with CTLA-4 Blockade Synergistically Eradicates Murine Cancer by Promoting Anticancer Immunity

Patients with mesothelioma showed delayed responses to immunotoxin SS1P, suggesting the development of anticancer immunity. A mouse model was developed in which tumor regressions were greatly enhanced by checkpoint blockade when immunotoxins were directly injected into tumors. Immune checkpoint blockade using antibodies to cytotoxic T-lymphocyte-associated antigen 4 (CTLA-4) benefits a limited number of cancer patients. SS1P and LMB-100 are immunotoxins that target mesothelin. We observed delayed responses to SS1P in patients with mesothelioma suggesting that antitumor immunity was induced. Our goal was to stimulate antitumor immunity by combining SS1P or LMB-100 with anti–CTLA-4. We constructed a BALB/c breast cancer cell line expressing human mesothelin (66C14-M), which was implanted in one or two locations. SS1P or LMB-100 was injected directly into established tumors and anti–CTLA-4 administered i.p. In mice with two tumors, one tumor was injected with immunotoxin and the other was not. The complete regression rate was 86% for the injected tumors and 53% for the uninjetced tumors. No complete regressions occurred when drugs were given separately. In regressing tumors, dying and dead tumor cells were intermingled with PMNs and surrounded by a collar of admixed eosinophils and mononuclear cells. Tumor regression was associated with increased numbers of tumor-infiltrating CD8+ cells and blocked by administration of antibodies to CD8. Surviving mice were protected from tumor rechallenge by 66C14 cells not expressing mesothelin, indicating the development of antitumor immunity. The antitumor effect was abolished when a mutant noncytotoxic variant was used instead of LMB-100, showing that the antitumor response is not mediated by recognition of a foreign bacterial protein. Our findings support developing a therapy composed of immunotoxins and checkpoint inhibitors for patients. Cancer Immunol Res; 5(8); 685–94. ©2017 AACR.

SymD webserver: a platform for detecting internally symmetric protein structures

Internal symmetry of a protein structure is the pseudo-symmetry that a single protein chain sometimes exhibits. This is in contrast to the symmetry with which monomers are arranged in many multimeric protein complexes. SymD is a program that detects proteins with internal symmetry. It proved to be useful for analyzing protein structure, function and modeling. This web-based interactive tool was developed by implementing the SymD algorithm. To the best of our knowledge, SymD webserver is the first tool of its kind with which users can easily study the symmetry of the protein they are interested in by uploading the structure or retrieving it from databases. It uses the Galaxy platform to take advantage of its extensibility and displays the symmetry properties, the symmetry axis and the sequence alignment of the structures before and after the symmetry transformation via an interactive graphical visualization environment in any modern web browser. An Example Run video displays the workflow to help users navigate. SymD webserver is publicly available at http://symd.nci.nih.gov.