English
Related papers

Related papers: Do It Yourself: Learning Semantic Correspondence f…

200 papers

While pre-trained large-scale vision models have shown significant promise for semantic correspondence, their features often struggle to grasp the geometry and orientation of instances. This paper identifies the importance of being…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Junyi Zhang , Charles Herrmann , Junhwa Hur , Eric Chen , Varun Jampani , Deqing Sun , Ming-Hsuan Yang

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer

Learning feature correspondence is a foundational task in computer vision, holding immense importance for downstream applications such as visual odometry and 3D reconstruction. Despite recent progress in data-driven models, feature…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Zitong Zhan , Dasong Gao , Yun-Jou Lin , Youjie Xia , Chen Wang

Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool.…

Computation and Language · Computer Science 2022-12-21 Mozhdeh Gheini , Tatiana Likhomanenko , Matthias Sperber , Hendra Setiawan

Foundation features from self-supervised vision models and text-to-image diffusion models have proven effective for semantic correspondence estimation. However, because these features are learned primarily from 2D image objectives, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Artur Jesslen , Olaf Dünkel , Adam Kortylewski

Establishing dense correspondences across image pairs is essential for tasks such as shape reconstruction and robot manipulation. In the challenging setting of matching across different categories, the function of an object, i.e., the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Stefan Stojanov , Linan Zhao , Yunzhi Zhang , Daniel L. K. Yamins , Jiajun Wu

Self-supervised depth estimation has made a great success in learning depth from unlabeled image sequences. While the mappings between image and pixel-wise depth are well-studied in current methods, the correlation between image, depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Rui Li , Xiantuo He , Danna Xue , Shaolin Su , Qing Mao , Yu Zhu , Jinqiu Sun , Yanning Zhang

Semantic segmentation of 3D LiDAR point clouds, essential for autonomous driving and infrastructure management, is best achieved by supervised learning, which demands extensive annotated datasets and faces the problem of domain shifts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Andrew Caunes , Thierry Chateau , Vincent Frémont

Deep features have been proven powerful in building accurate dense semantic correspondences in various previous works. However, the multi-scale and pyramidal hierarchy of convolutional neural networks has not been well studied to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Dongyang Zhao , Ziyang Song , Zhenghao Ji , Gangming Zhao , Weifeng Ge , Yizhou Yu

Establishing semantic correspondence across images when the objects in the images have undergone complex deformations remains a challenging task in the field of computer vision. In this paper, we propose a hierarchical method to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Akila Pemasiri , Kien Nguyen , Sridha Sridhara , and Clinton Fookes

This paper addresses the problem of establishing semantic correspondences between images depicting different instances of the same object or scene category. Previous approaches focus on either combining a spatial regularizer with…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Kai Han , Rafael S. Rezende , Bumsub Ham , Kwan-Yee K. Wong , Minsu Cho , Cordelia Schmid , Jean Ponce

We present a self-supervised method to improve an agent's abilities in describing arbitrary objects while actively exploring a generic environment. This is a challenging problem, as current models struggle to obtain coherent image captions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Tommaso Galliena , Tommaso Apicella , Stefano Rosa , Pietro Morerio , Alessio Del Bue , Lorenzo Natale

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

Traditionally, training neural networks to perform semantic segmentation required expensive human-made annotations. But more recently, advances in the field of unsupervised learning have made significant progress on this issue and towards…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski

With the recent growth of urban mapping and autonomous driving efforts, there has been an explosion of raw 3D data collected from terrestrial platforms with lidar scanners and color cameras. However, due to high labeling costs, ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Kyle Genova , Xiaoqi Yin , Abhijit Kundu , Caroline Pantofaru , Forrester Cole , Avneesh Sud , Brian Brewington , Brian Shucker , Thomas Funkhouser

We explore semantic correspondence estimation through the lens of unsupervised learning. We thoroughly evaluate several recently proposed unsupervised methods across multiple challenging datasets using a standardized evaluation protocol…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Mehmet Aygün , Oisin Mac Aodha

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

Competitive point cloud semantic segmentation results usually rely on a large amount of labeled data. However, data annotation is a time-consuming and labor-intensive task, particularly for three-dimensional point cloud data. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Puzuo Wang , Wei Yao

We introduce a self-supervised method for learning visual correspondence from unlabeled video. The main idea is to use cycle-consistency in time as free supervisory signal for learning visual representations from scratch. At training time,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Xiaolong Wang , Allan Jabri , Alexei A. Efros

In recent years, supervised person re-identification (re-ID) models have received increasing studies. However, these models trained on the source domain always suffer dramatic performance drop when tested on an unseen domain. Existing…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Hao Feng , Minghao Chen , Jinming Hu , Dong Shen , Haifeng Liu , Deng Cai