A framework for video forensics based on local and temporal fingerprints

Abstract

This paper presents a framework for the forensic analysis of video content, for example those illegal copies of feature films proliferating in peer-to-peer networks or on bootleg DVDs. Compact and discriminant feature vectors, so called ¿fingerprints¿, are computed for a catalog of master contents. They combine global (image-based) and local (keypoint-based) signal properties extracted on representative keyframes, together with a one-dimensional signature capturing the temporal evolution of the video. We demonstrate that the extracted fingerprints not only allow accurate copy detection but also enable precise temporal and geometric alignment of candidate videos with master content. Besides making possible watermark decoding in the presence of geometric distortion, this opens the door to the reconstruction of the history of signal manipulations. The performance of the proposed scheme is assessed through a realistic copy detection and registration scenario.