Nature Communications · 2025 · 21 citations · 33 references
Life SciencesBioinformaticsGeneticsComputational BiologyGene ExpressionGenomicsFunctional GenomicsGenomic PredictionBenchmark DatasetsGene Prediction BenchmarkingModel Performance AnalysisModel Performance EvaluationPathogenic Variant DetectionSequence ClassificationVariant Effect PredictionZero-shot Classification
The rapid evolution of DNA foundation models promises to revolutionize genomics, yet comprehensive evaluations are lacking. Here, we present a comprehensive, unbiased benchmark of five models (DNABERT-2, Nucleotide Transformer V2, HyenaDNA, Caduceus-Ph, and GROVER) across diverse genomic and genetic tasks including sequence classification, gene expression prediction, variant effect quantification, and topologically associating domain (TAD) region recognition, using zero-shot embeddings. Our analysis reveals that mean token embedding consistently and significantly improves sequence classification performance, outperforming other pooling strategies. Model performance varies among tasks and datasets; while general purpose DNA foundation models showed competitive performance in pathogenic variant identification, they were less effective in predicting gene expression and identifying putative causal QTLs compared to specialized models. Our findings offer a framework for model selection, highlighting the impact of architecture, pre-training data, and embedding strategies on performance in genomic and genetic tasks.
33
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
The GTEx Consortium atlas of genetic regulatory effects across human tissues
François Aguet, Shankara Anand, Kristin Ardlie et al. · Science · 2020 · 5.8K citations · Full text
arXiv (Cornell University) · 2023 · 2.4K citations · Full text