SIFT-guided multi-resolution video inpainting with innovative scheduling mechanism and irregular patch matching

NCUIR > College of Electrical Engineering & Computer Science > Department of Computer Science and information Engineering > journal & Dissertation > Item 987654321/107261

Please use this identifier to cite or link to this item: https://ir.lib.ncu.edu.tw/handle/987654321/107261

Title:	SIFT-guided multi-resolution video inpainting with innovative scheduling mechanism and irregular patch matching
Authors:	蘇柏齊;Kuo, Tien-Ying;Su, Po-Chyi;Kuan, Yun-Ping
Contributors:	資訊電機學院資訊工程學系
Keywords:	Algorithms;Clips;Inpainting;Matching;Motion vector field;Multi-resolution;Scheduling;Sift;Similarity;Surface layer;Television;Texture;Video
Date:	2016-12-10
Issue Date:	2026-04-23 14:03:17 (UTC+8)
Publisher:	Elsevier Inc.;Elsevier Inc
Abstract:	摘要： •An effective video inpainting method for repairing damaged video, or removing such unwanted objects as burned–in subtitles in TV programs.•A classifier and scheduler scheme to prioritize inpainting order, which significantly affects the inpainting results.•A multi–resolution approach with SIFT guiding the inpainting path to resolve uncertainty in large inpainting regions.•Irregular patch–filling to better preserve visually significant areas and speed up the process. Effective video inpainting that maintains both temporal and spatial continuity is required in many applications. This research presents a new video inpainting algorithm targeted at achieving a better tradeoff between visual quality and computational complexity. The inpainting regions in video frames are classified into two types, i.e., structure and smooth. A scheduling mechanism considering texture data amount, inpainting confidence and motion vector uniformity is proposed to determine an appropriate processing order of inpainting points. A novel patch comparison function to evaluate the similarity and an irregular patch-filling method are developed to ensure decent visual quality and faster inpainting speed. The ideas of multi-resolution processing and scale-invariant feature transform are further adopted such that larger inpainting areas can still be processed well. To evaluate the effectiveness of the proposed algorithm, inpainting on television programs and video clips from literature is tested. The experimental results demonstrate better performance when compared with traditional methods. 出版者： Elsevier Inc 出版日期： 2016-12-10 出處： Information sciences, 2016-12, Vol.373, p.95-109 資源來源： Elsevier ScienceDirect Journals: Bodleian Libraries collection 版權： 2016 Elsevier Inc. 識別號： ISSN: 0020-0255 識別號： EISSN: 1872-6291 識別號： DOI: 10.1016/j.ins.2016.08.091
Appears in Collections:	[Department of Computer Science and information Engineering] journal & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	32	View/Open

社群 sharing

Loading...