English
Related papers

Related papers: Video Inpainting Localization with Contrastive Lea…

200 papers

Digital video inpainting techniques have been substantially improved with deep learning in recent years. Although inpainting is originally designed to repair damaged areas, it can also be used as malicious manipulation to remove important…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zijie Lou , Gang Cao , Man Lin

This paper studies video inpainting detection, which localizes an inpainted region in a video both spatially and temporally. In particular, we introduce VIDNet, Video Inpainting Detection Network, which contains a two-stream encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Peng Zhou , Ning Yu , Zuxuan Wu , Larry S. Davis , Abhinav Shrivastava , Ser-Nam Lim

With the advancement of deep learning-driven video editing technology, security risks have emerged. Malicious video tampering can lead to public misunderstanding, property losses, and legal disputes. Currently, detection methods are mostly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Pengfei Pei

Video inpainting aims to fill spatio-temporal holes with plausible content in a video. Despite tremendous progress of deep neural networks for image inpainting, it is challenging to extend these methods to the video domain due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

This paper addresses the problem of face video inpainting. Existing video inpainting methods target primarily at natural scenes with repetitive patterns. They do not make use of any prior knowledge of the face to help retrieve…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Wenqi Yang , Zhenfang Chen , Chaofeng Chen , Guanying Chen , Kwan-Yee K. Wong

We present a new data-driven video inpainting method for recovering missing regions of video frames. A novel deep learning architecture is proposed which contains two sub-networks: a temporal structure inference network and a spatial detail…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chuan Wang , Haibin Huang , Xiaoguang Han , Jue Wang

Image and video inpainting is a classic problem in computer vision and computer graphics, aiming to fill in the plausible and realistic content in the missing areas of images and videos. With the advance of deep learning, this problem has…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Weize Quan , Jiaxi Chen , Yanli Liu , Dong-Ming Yan , Peter Wonka

Blind video decaptioning is a problem of automatically removing text overlays and inpainting the occluded parts in videos without any input masks. While recent deep learning based inpainting methods deal with a single image and mostly…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

We propose a novel framework for video inpainting by adopting an internal learning strategy. Unlike previous methods that use optical flow for cross-frame context propagation to inpaint unknown regions, we show that this can be achieved…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Hao Ouyang , Tengfei Wang , Qifeng Chen

Video inpainting aims to fill spatio-temporal "corrupted" regions with plausible content. To achieve this goal, it is necessary to find correspondences from neighbouring frames to faithfully hallucinate the unknown content. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Xueyan Zou , Linjie Yang , Ding Liu , Yong Jae Lee

Image forgery localization, which aims to segment tampered regions in an image, is a fundamental yet challenging digital forensic task. While some deep learning-based forensic methods have achieved impressive results, they directly learn…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zijie Lou , Gang Cao , Kun Guo , Haochen Zhu , Lifang Yu

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

Visual Geo-localization (VG) refers to the process to identify the location described in query images, which is widely applied in robotics field and computer vision tasks, such as autonomous driving, metaverse, augmented reality, and SLAM.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Chen Mao , Jingqi Hu

Contrastive learning has recently narrowed the gap between self-supervised and supervised methods in image and video domain. State-of-the-art video contrastive learning methods such as CVRL and $\rho$-MoCo spatiotemporally augment two clips…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 David Fan , Deyu Yang , Xinyu Li , Vimal Bhat , Rohith MV

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Image inpainting is a challenging problem as it needs to fill the information of the corrupted regions. Most of the existing inpainting algorithms assume that the positions of the corrupted regions are known. Different from the existing…

Computer Vision and Pattern Recognition · Computer Science 2017-12-27 Yang Liu , Jinshan Pan , Zhixun Su

Upscaled video detection is a helpful tool in multimedia forensics, but it is a challenging task that involves various upscaling and compression algorithms. There are many resolution-enhancement methods, including interpolation and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Viacheslav Meshchaninov , Ivan Molodetskikh , Dmitriy Vatolin

We propose a novel video inpainting algorithm that simultaneously hallucinates missing appearance and motion (optical flow) information, building upon the recent 'Deep Image Prior' (DIP) that exploits convolutional network architectures to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Haotian Zhang , Long Mai , Ning Xu , Zhaowen Wang , John Collomosse , Hailin Jin

Image inpainting, the process of restoring missing or corrupted regions of an image by reconstructing pixel information, has recently seen considerable advancements through deep learning-based approaches. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Kourosh Kiani , Razieh Rastgoo , Alireza Chaji , Sergio Escalera
‹ Prev 1 2 3 10 Next ›