Nature Communications · 2023 · 25 citations · 36 references
Life SciencesBioinformaticsGeneticsGenomic Data AnalysisGenomic InformaticsGenomicsDna SequencingGenome SequencingNext-generation SequencingVariant AnalysisVariant CallingVariant DetectionDistance MetricsInsertion-deletion Variant CallingPerformance ConsistencyPrecision-recall TradeoffRelative Performance AnalysisVariant BenchmarkingVariant Calling BenchmarkingVariant Representation
Abstract Accurately benchmarking small variant calling accuracy is critical for the continued improvement of human whole genome sequencing. In this work, we show that current variant calling evaluations are biased towards certain variant representations and may misrepresent the relative performance of different variant calling pipelines. We propose solutions, first exploring the affine gap parameter design space for complex variant representation and suggesting a standard. Next, we present our tool vcfdist and demonstrate the importance of enforcing local phasing for evaluation accuracy. We then introduce the notion of partial credit for mostly-correct calls and present an algorithm for clustering dependent variants. Lastly, we motivate using alignment distance metrics to supplement precision-recall curves for understanding variant calling performance. We evaluate the performance of 64 phased Truth Challenge V2 submissions and show that vcfdist improves measured insertion and deletion performance consistency across variant representations from R 2 = 0.97243 for baseline vcfeval to 0.99996 for vcfdist.
36
Minimap2: pairwise alignment for nucleotide sequences
Heng Li · Bioinformatics · 2018 · 16.8K citations · Full text
Twelve years of SAMtools and BCFtools
Petr Danecek, James Bonfield, Jennifer Liddle et al. · GigaScience · 2021 · 15.9K citations · Full text
The Sequence of the Human Genome
J. Craig Venter, Mark D. Adams, Eugene W. Myers et al. · Science · 2001 · 13.7K citations
dbSNP: the NCBI database of genetic variation
Stephen T. Sherry · Nucleic Acids Research · 2001 · 7.8K citations · Full text