ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection

TLDR

ASVspoof 2021, the fourth bi‑annual challenge, advances spoofing research and countermeasure design for protecting automatic speaker‑verification systems. The paper presents the three tasks, their new databases, evaluation metrics, four baselines, the evaluation platform, and a summary of results. The challenge builds on logical and physical access tasks and introduces a deepfake speech detection task, offering new databases, evaluation metrics, four baselines, and an evaluation platform. Results indicate that logical access and deepfake tasks are comparable to prior editions, physical access remains challenging, and overall performance is encouraging, demonstrating substantial progress despite channel and compression variability and the absence of matched training data.

Abstract

ASVspoof 2021 is the forth edition in the series of bi-annual challenges which aim to promote the study of spoofing and the design of countermeasures to protect automatic speaker verification systems from manipulation. In addition to a continued focus upon logical and physical access tasks in which there are a number of advances compared to previous editions, ASVspoof 2021 introduces a new task involving deepfake speech detection. This paper describes all three tasks, the new databases for each of them, the evaluation metrics, four challenge baselines, the evaluation platform and a summary of challenge results. Despite the introduction of channel and compression variability which compound the difficulty, results for the logical access and deepfake tasks are close to those from previous ASVspoof editions. Results for the physical access task show the difficulty in detecting attacks in real, variable physical spaces. With ASVspoof 2021 being the first edition for which participants were not provided with any matched training or development data and with this reflecting real conditions in which the nature of spoofed and deepfake speech can never be predicated with confidence, the results are extremely encouraging and demonstrate the substantial progress made in the field in recent years.