iMeta · 2023 · 2K citations · 7 references
Life SciencesBioinformaticsGenomic Data AnalysisGenomicsSequence AnalysisData DeduplicationDna SequencingNext-generation SequencingSequence Quality ControlAdapter Contamination DetectionAdapter RemovalData ProcessingDuplicate Read HandlingSequence Deduplication
High‑throughput sequencing generates vast amounts of FASTQ data, driving costs and processing complexity and creating a demand for faster, simpler, and energy‑efficient preprocessing tools. This study introduces fastp’s new features and explains its design and implementation. fastp has been widely adopted, continuously updated, and now includes enhanced duplication evaluation and a new deduplication module, making it faster and more powerful.
Abstract A large amount of sequencing data is generated and processed every day with the continuous evolution of sequencing technology and the expansion of sequencing applications. One consequence of such sequencing data explosion is the increasing cost and complexity of data processing. The preprocessing of FASTQ data, which means removing adapter contamination, filtering low‐quality reads, and correcting wrongly represented bases, is an indispensable but resource intensive part of sequencing data analysis. Therefore, although a lot of software applications have been developed to solve this problem, bioinformatics scientists and engineers are still pursuing faster, simpler, and more energy‐efficient software. Several years ago, the author developed fastp, which is an ultrafast all‐in‐one FASTQ data preprocessor with many modern features. This software has been approved by many bioinformatics users and has been continuously maintained and updated. Since the first publication on fastp, it has been greatly improved, making it even faster and more powerful. For instance, the duplication evaluation module has been improved, and a new deduplication module has been added. This study aimed to introduce the new features of fastp and demonstrate how it was designed and implemented.
7
Trimmomatic: a flexible trimmer for Illumina sequence data
Anthony Bolger, Marc Lohse, Björn Usadel · Bioinformatics · 2014 · 69.7K citations · Full text
Cutadapt removes adapter sequences from high-throughput sequencing reads
Marcel Martin · EMBnet journal · 2011 · 35.8K citations · Full text
fastp: an ultra-fast all-in-one FASTQ preprocessor
Shifu Chen, Yanqing Zhou, Yaru Chen et al. · Bioinformatics · 2018 · 29.7K citations · Full text