Bioinformatics · 2018 · 91 citations · 9 references
Life SciencesBioinformaticsData StructuresGenomic Data AnalysisGenomicsData CompressionDna SequencingGenome SequencingNext-generation SequencingCompressionCompressorsGenome CompressionQuality Values
MOTIVATION: High-Throughput Sequencing technologies produce huge amounts of data in the form of short genomic reads, associated quality values and read identifiers. Because of the significant structure present in these FASTQ datasets, general-purpose compressors are unable to completely exploit much of the inherent redundancy. Although there has been a lot of work on designing FASTQ compressors, most of them lack in support of one or more crucial properties, such as support for variable length reads, scalability to high coverage datasets, pairing-preserving compression and lossless compression. RESULTS: In this work, we propose SPRING, a reference-free compressor for FASTQ files. SPRING supports a wide variety of compression modes and features, including lossless compression, pairing-preserving compression, lossy compression of quality values, long read compression and random access. SPRING achieves substantially better compression than existing tools, for example, SPRING compresses 195 GB of 25× whole genome human FASTQ from Illumina's NovaSeq sequencer to less than 7 GB, around 1.6× smaller than previous state-of-the-art FASTQ compressors. SPRING achieves this improvement while using comparable computational resources. AVAILABILITY AND IMPLEMENTATION: SPRING can be downloaded from https://github.com/shubhamchandak94/SPRING. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
9
Compression of FASTQ and SAM Format Sequencing Data
James Bonfield, Matthew V. Mahoney · PLoS ONE · 2013 · 205 citations · Full text
SCALCE: boosting sequence compression algorithms using locally consistent encoding
Faraz Hach, Ibrahim Numanagić, Can Alkan et al. · Bioinformatics · 2012 · 158 citations · Full text
Comparison of high-throughput sequencing data compression tools
Ibrahim Numanagić, James Bonfield, Faraz Hach et al. · Nature Methods · 2016 · 114 citations · Full text
DSRC 2—Industry-oriented compression of FASTQ files
Łukasz Roguski, Sebastian Deorowicz · Bioinformatics · 2014 · 109 citations · Full text
Effect of lossy compression of quality scores on variant calling
Idoia Ochoa, Mikel Hernáez, Rachel L. Goldfeder et al. · Briefings in Bioinformatics · 2016 · 67 citations · Full text