Removing unwanted scratches or objects from an image in an undetectable manner is a technique that has been researched for its many useful and varied applications, such as removing scratches, defects, super-imposed text, or even entire objects from a scene. Currently there is a wide variety of algorithms that fill in unwanted regions, none of which incorporate user preferences into the structure completion process. By building a framework to incorporate user preferences into the filling-in process, user input can be utilized to more effectively fill in damaged regions in an image. User input can influence the filling-in process in a variety of ways, including identifying the region to remove, guiding the completion of structure in the damaged region, influencing priority in the searching process for texture completion, and picking the best combination of structure and texture completion in the damaged region. The framework to achieve the interactive filling-in process contains five main steps. First, the scratch or deformity is detected. Second, the edges outside the deformity are detected. Third, curves are fit to the detected edges. Fourth, the structure is completed across the damaged region. Finally, texture synthesis constrained by the previously computed curves is used to fill in the intensities in the damaged region. Scratch detection, structure completion, and texture synthesis can be influenced or guided by user input when given. Defects have successfully been removed from images that contain structure, images that contain texture, and images that contain both structure and texture. A user is able to successfully complete images that contain ambiguous structure in more than one viable way by gesturing the cursor in the direction of desired structure completion.



College and Department

Physical and Mathematical Sciences; Computer Science



Date Submitted


Document Type





interactive, image, filling-in, user motion, inpainting, scratch removal