Rapid scene analysis on compressed video

TLDR

DC images comprise only a small fraction of the original data yet preserve most global visual information. The study proposes rapid scene analysis algorithms that detect scene changes and flashlight scenes directly on compressed video. These algorithms analyze the DC sequence extracted from Motion JPEG or MPEG streams without full-frame decompression. Operating on DC images yields substantial computational savings, and experiments demonstrate the algorithms are fast and effective at detecting abrupt and gradual transitions, flashlight scenes, and intrashot variations.

Abstract

Several rapid scene analysis algorithms for detecting scene changes and flashlight scenes directly on compressed video are proposed. These algorithms operate on the DC sequence which can be readily extracted from video compressed using Motion JPEG or MPEG without full-frame decompression. The DC images occupy only a small fraction of the original data size while retaining most of the essential "global" information. Operating on these images offers a significant computation saving. Experimental results show that the proposed algorithms are fast and effective in detecting abrupt scene changes, gradual transitions including fade-ins and fade-outs, flashlight scenes and in deriving intrashot variations.