Online Video Stabilization Based on Particle Filters

Abstract

Particle filters have been introduced as a powerful tool to estimate the posterior density of nonlinear systems. These filters are also capable of processing data online as required in many practical applications. In this paper, we propose a novel technique for video stabilization based on the particle filtering framework. Scale-invariant feature points are extracted to form a rough estimate which is used to model the importance density. We use a constant-velocity Kalman filter model to estimate intentional camera movement. We also prove that the particle filtering estimate will lower the error variance. The superior performance and robustness of our algorithm is demonstrated by computer simulations.