2019 · 13 citations · 22 references
ComputingData ScienceDigital ForensicsFeature EngineeringInformation RetrievalComputer ForensicsForensic AnalysisMultimedia ForensicsBenchmark DatasetsDataset DescriptionsForensicsImage ForensicsMultimedia Provenance AnalysisProvenance Annotation
The paper introduces a benchmark for Media Forensics Challenge evaluations, outlining objectives, challenges, and methods for building and annotating large‑scale forensic datasets. The dataset includes over 176,000 high‑provenance images and 11,000 videos, plus more than 100,000 manipulated images and 4,000 videos, and an infrastructure that selects customized evaluation subsets based on specified queries. Using these datasets, the authors assessed progress and analyzed system performance across media forensics tasks over the past two years, presenting evaluation results from recent challenges.
We provide a benchmark for digital Media Forensics Challenge (MFC) evaluations. Our comprehensive data comprises over 176,000 high provenance (HP) images and 11,000 HP videos; more than 100,000 manipulated images and 4,000 manipulated videos; 35 million internet images and 300,000 video clips. We have designed and generated a series of development, evaluation, and challenge datasets, and used them to assess the progress and thoroughly analyze the performance of diverse systems on a variety of media forensics tasks in the past two years. In this paper, we first introduce the objectives, challenges, and approaches to building media forensics evaluation datasets. We then discuss our approaches to forensic dataset collection, annotation, and manipulation, and present the design and infrastructure to effectively and efficiently build the evaluation datasets to support various evaluation tasks. Given a specified query, we build an infrastructure that selects the customized evaluation subsets for the targeted analysis report. Finally, we demonstrate the evaluation results in the past evaluations.
22
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Vision meets robotics: The KITTI dataset
Andreas Geiger, Philip Lenz, Christoph Stiller et al. · The International Journal of Robotics Research · 2013 · 9.7K citations
The Pascal Visual Object Classes Challenge: A Retrospective
Mark Everingham, S. M. Ali Eslami, Luc Van Gool et al. · International Journal of Computer Vision · 2014 · 7.3K citations · Full text
SUN database: Large-scale scene recognition from abbey to zoo
Jianxiong Xiao, James Hays, Krista A. Ehinger et al. · 2010 · 3.2K citations · Full text