English
Related papers

Related papers: Video Inpainting Localization with Contrastive Lea…

200 papers

Modern self-supervised learning algorithms typically enforce persistency of instance representations across views. While being very effective on learning holistic image and video representations, such an objective becomes sub-optimal for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Liangzhe Yuan , Rui Qian , Yin Cui , Boqing Gong , Florian Schroff , Ming-Hsuan Yang , Hartwig Adam , Ting Liu

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Visual Place Recognition (VPR) is aimed at predicting the location of a query image by referencing a database of geotagged images. For VPR task, often fewer discriminative local regions in an image produce important effects while mundane…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Changwei Wang , Shunpeng Chen , Yukun Song , Rongtao Xu , Zherui Zhang , Jiguang Zhang , Haoran Yang , Yu Zhang , Kexue Fu , Shide Du , Zhiwei Xu , Longxiang Gao , Li Guo , Shibiao Xu

Learning visual representations with self-supervised learning has become popular in computer vision. The idea is to design auxiliary tasks where labels are free to obtain. Most of these tasks end up providing data to learn specific kinds of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Xiaolong Wang , Kaiming He , Abhinav Gupta

Perceptual video quality assessment (VQA) is an integral component of many streaming and video sharing platforms. Here we consider the problem of learning perceptually relevant video quality representations in a self-supervised manner.…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Pavan C. Madhusudana , Neil Birkbeck , Yilin Wang , Balu Adsumilli , Alan C. Bovik

Video representation learning has recently attracted attention in computer vision due to its applications for activity and scene forecasting or vision-based planning and control. Video prediction models often learn a latent representation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Rama Krishna Kandukuri , Jan Achterhold , Michael Möller , Jörg Stückler

Learning representations of images that are invariant to sensitive or unwanted attributes is important for many tasks including bias removal and cross domain retrieval. Here, our objective is to learn representations that are invariant to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jonathan Kahana , Yedid Hoshen

Visual localization is the problem of estimating a camera within a scene and a key component in computer vision applications such as self-driving cars and Mixed Reality. State-of-the-art approaches for accurate visual localization use…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Qunjie Zhou , Torsten Sattler , Marc Pollefeys , Laura Leal-Taixe

We propose an automatic video inpainting algorithm which relies on the optimisation of a global, patch-based functional. Our algorithm is able to deal with a variety of challenging situations which naturally arise in video inpainting, such…

Computer Vision and Pattern Recognition · Computer Science 2017-12-08 Alasdair Newson , Andrés Almansa , Matthieu Fradet , Yann Gousseau , Patrick Pérez

MoCo is effective for unsupervised image representation learning. In this paper, we propose VideoMoCo for unsupervised video representation learning. Given a video sequence as an input sample, we improve the temporal feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Tian Pan , Yibing Song , Tianyu Yang , Wenhao Jiang , Wei Liu

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Contrastive learning has shown promising potential in self-supervised spatio-temporal representation learning. Most works naively sample different clips to construct positive and negative pairs. However, we observe that this formulation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Shuangrui Ding , Rui Qian , Hongkai Xiong

Semantic segmentation in autonomous driving predominantly focuses on learning from large-scale data with a closed set of known classes without considering unknown objects. Motivated by safety reasons, we address the video class agnostic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Mennatullah Siam , Alex Kendall , Martin Jagersand

Current polyp detection methods from colonoscopy videos use exclusively normal (i.e., healthy) training images, which i) ignore the importance of temporal information in consecutive video frames, and ii) lack knowledge about the polyps.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Yu Tian , Guansong Pang , Fengbei Liu , Yuyuan Liu , Chong Wang , Yuanhong Chen , Johan W Verjans , Gustavo Carneiro

Visual place recognition (VPR) is a fundamental task of computer vision for visual localization. Existing methods are trained using image pairs that either depict the same place or not. Such a binary indication does not consider continuous…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Maria Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov

Our target is to learn visual correspondence from unlabeled videos. We develop LIIR, a locality-aware inter-and intra-video reconstruction framework that fills in three missing pieces, i.e., instance discrimination, location awareness, and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Liulei Li , Tianfei Zhou , Wenguan Wang , Lu Yang , Jianwu Li , Yi Yang

Visual localization techniques rely upon some underlying scene representation to localize against. These representations can be explicit such as 3D SFM map or implicit, such as a neural network that learns to encode the scene. The former…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Maxime Pietrantoni , Gabriela Csurka , Martin Humenberger , Torsten Sattler

Capturing high dynamic range (HDR) images (videos) is attractive because it can reveal the details in both dark and bright regions. Since the mainstream screens only support low dynamic range (LDR) content, tone mapping algorithm is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Cong Cao , Huanjing Yue , Xin Liu , Jingyu Yang

Deeplearning has been used to solve complex problems in various domains. As it advances, it also creates applications which become a major threat to our privacy, security and even to our Democracy. Such an application which is being…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Rahul U , Ragul M , Raja Vignesh K , Tejeswinee K

Detecting manipulated images and videos is an important topic in digital media forensics. Most detection methods use binary classification to determine the probability of a query being manipulated. Another important topic is locating…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Huy H. Nguyen , Fuming Fang , Junichi Yamagishi , Isao Echizen