2020 · 142 citations · 29 references
ComputingComputer ScienceComputer VisionMachine LearningNatural Language ProcessingMultimodal CorporaSpeech RecognitionAnnotation Of Video DataAudio-visual CorporaLabelsSpeaker AnnotationSpeaker RecognitionVideo Corpus Analysis
The goal of this paper is speaker diarisation of videos collected ‘in the wild’.\n<br>\nWe make three key contributions. First, we propose an automatic audio-visual diarisation method for YouTube videos. Our method consists of active speaker detection using audio-visual methods and speaker verification using self-enrolled speaker models. Second, we integrate our method into a semi-automatic dataset creation pipeline which significantly reduces the number of hours required to annotate videos with diarisation labels. Finally, we use this pipeline to create a large-scale diarisation dataset called VoxConverse, collected from ‘in the wild’ videos, which we will release publicly to the research community. Our dataset consists of overlapping speech, a large and diverse speaker pool, and challenging background conditions.
29
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Omkar Parkhi, Andrea Vedaldi, Andrew Zisserman · 2015 · 5.1K citations · Full text
X-Vectors: Robust DNN Embeddings for Speaker Recognition
David Snyder, Daniel Garcia-Romero, Gregory Sell et al. · 2018 · 2.7K citations
VoxCeleb2: Deep Speaker Recognition
Joon Son Chung, Arsha Nagrani, Andrew Zisserman · 2018 · 2.3K citations · Full text