Bioinformatics · 2015 · 153 citations · 27 references
Life SciencesBioinformaticsImmunologyBiomolecular ModelingComputational BiologyMolecular ImmunologyBinding Affinity PredictionMajor Histocompatibility ComplexPeptide IdentificationProtein Database SearchVirtual ScreeningBenchmarking Binding Affinity ModelsComputational Epitope PredictionEpitope SelectionExperimental ValidationImmune Epitope Database CurationMajor Histocompatibility Complex Binding AnalysisMhc-peptide Binding SpecificitySelection Bias Assessment
MOTIVATION: Numerous in silico methods predicting peptide binding to major histocompatibility complex (MHC) class I molecules have been developed over the last decades. However, the multitude of available prediction tools makes it non-trivial for the end-user to select which tool to use for a given task. To provide a solid basis on which to compare different prediction tools, we here describe a framework for the automated benchmarking of peptide-MHC class I binding prediction tools. The framework runs weekly benchmarks on data that are newly entered into the Immune Epitope Database (IEDB), giving the public access to frequent, up-to-date performance evaluations of all participating tools. To overcome potential selection bias in the data included in the IEDB, a strategy was implemented that suggests a set of peptides for which different prediction methods give divergent predictions as to their binding capability. Upon experimental binding validation, these peptides entered the benchmark study. RESULTS: The benchmark has run for 15 weeks and includes evaluation of 44 datasets covering 17 MHC alleles and more than 4000 peptide-MHC binding measurements. Inspection of the results allows the end-user to make educated selections between participating tools. Of the four participating servers, NetMHCpan performed the best, followed by ANN, SMM and finally ARB. AVAILABILITY AND IMPLEMENTATION: Up-to-date performance evaluations of each server can be found online at http://tools.iedb.org/auto_bench/mhci/weekly. All prediction tool developers are invited to participate in the benchmark. Sign-up instructions are available at http://tools.iedb.org/auto_bench/mhci/join. CONTACT: mniel@cbs.dtu.dk or bpeters@liai.org SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
27
NetMHCpan, a method for MHC class I binding prediction beyond humans
Ilka Hoof, Bjoern Peters, John Sidney et al. · Immunogenetics · 2008 · 784 citations
The Immune Epitope Database 2.0
Randi Vita, Laura Zarebski, Jason Greenbaum et al. · Nucleic Acids Research · 2009 · 642 citations · Full text