Using Multiple Frame Integration for the Text Recognition of Video

Abstract

This paper proposes a new approach for the multiple frame integration of video, whose novelty mainly lies in three phases: Firstly, in the text-block group (TBG) identification, we identify the blocks with the same text by considering jointly the location, edge distribution and contrast of the text block. Then, in the TBG filtering, to avoid the bad effects of the blurred text on the result of integration, we measure the clarity of the text using the proposed text-intensity map, and select the blocks with the clear text for the integration.Finally, in the TBG integration, we integrate the text blocks by using the average and minimum integrations in the text and background of the image respectively,which can obtain the clean background and clear text with high contrast for the effective text recognition.The experimental results show our method can improve the performance of text recognition in video significantly.