Nature Communications · 2024 · 55 citations · 56 references
Life SciencesBioinformaticsMolecular BiologyBiomolecular ModelingDrug DesignPost-translational ModificationLanguage ModelingPost-translational Modification AnalysisProtein Function AnnotationDisease AssociationsInterpretable ModelingLinguistic PatternsMolecular Recognition MotifsPost-translational Modification DetectionPost-translational Modification Motif AnalysisPost-translational Modification Site PredictionPost-translational Modification Sites
Post-translational modifications (PTMs) are pivotal in modulating protein functions and influencing cellular processes like signaling, localization, and degradation. The complexity of these biological interactions necessitates efficient predictive methodologies. In this work, we introduce PTMGPT2, an interpretable protein language model that utilizes prompt-based fine-tuning to improve its accuracy in precisely predicting PTMs. Drawing inspiration from recent advancements in GPT-based architectures, PTMGPT2 adopts unsupervised learning to identify PTMs. It utilizes a custom prompt to guide the model through the subtle linguistic patterns encoded in amino acid sequences, generating tokens indicative of PTM sites. To provide interpretability, we visualize attention profiles from the model’s final decoder layer to elucidate sequence motifs essential for molecular recognition and analyze the effects of mutations at or near PTM sites to offer deeper insights into protein functionality. Comparative assessments reveal that PTMGPT2 outperforms existing methods across 19 PTM types, underscoring its potential in identifying disease associations and drug targets. PTMGPT2, which leverages prompt-based fine-tuning on protein sequences, predicts post-translational modifications (PTMs) with higher accuracy. It interprets attention scores as motifs and identifies pathogenic mutations, providing insights into protein functionality.
56
CD-HIT: accelerated for clustering the next-generation sequencing data
LiMin Fu, Beifang Niu, Zhengwei Zhu et al. · Bioinformatics · 2012 · 11.8K citations · Full text
Life Sciences, Bioinformatics, High-performance Computing +12
Mutations of the BRAF gene in human cancer
Helen Davies, Graham R. Bignell, Charles Cox et al. · Nature · 2002 · 10.7K citations
Transformers: State-of-the-Art Natural Language Processing
Thomas Wolf, Lysandre Debut, Victor Sanh et al. · 2020 · 8K citations · Full text
dbSNP: the NCBI database of genetic variation
Stephen T. Sherry · Nucleic Acids Research · 2001 · 7.8K citations · Full text