Image inpainting

TLDR

Inpainting is an ancient technique used to restore damaged art and to remove or replace objects in images. This paper presents a novel digital inpainting algorithm that emulates the methods of professional restorators. After a user selects regions to restore, the algorithm automatically fills them using surrounding pixels while completing isophote lines at the boundaries. Unlike prior methods, the algorithm infers missing content automatically and quickly, handles multiple regions of diverse structures without topology constraints, and can restore old photographs, remove text, or delete objects.

Abstract

Inpainting, the technique of modifying an image in an undetectable form, is as ancient as art itself. The goals and applications of inpainting are numerous, from the restoration of damaged paintings and photographs to the removal/replacement of selected objects. In this paper, we introduce a novel algorithm for digital inpainting of still images that attempts to replicate the basic techniques used by professional restorators. After the user selects the regions to be restored, the algorithm automatically fills-in these regions with information surrounding them. The fill-in is done in such a way that isophote lines arriving at the regions' boundaries are completed inside. In contrast with previous approaches, the technique here introduced does not require the user to specify where the novel information comes from. This is automatically done (and in a fast way), thereby allowing to simultaneously fill-in numerous regions containing completely different structures and surrounding backgrounds. In addition, no limitations are imposed on the topology of the region to be inpainted. Applications of this technique include the restoration of old photographs and damaged film; removal of superimposed text like dates, subtitles, or publicity; and the removal of entire objects from the image like microphones or wires in special effects.