Temporally consistent stereo matching using coherence function

Abstract

This paper proposes a novel method for estimating temporally consistent disparity maps. The proposed approach utilizes a coherence function that represents the temporal consistency between the disparity maps of consecutive frames. The coherence function is computed according to a motion probability between consecutive frames based on the assumption that a disparity varies smoothly over time. The temporal consistency between consecutive disparity maps is enforced based on the coherence function. In order to cope with scene changes, the similarity of consecutive frames is also considered in the coherence function. Experimental results show that the proposed method yields satisfactory disparity maps and synthesized views on several challenging stereo videos, including clips with fast object and camera motions as well as scene change.