English
Related papers

Related papers: Looking Beyond Corners: Contrastive Learning of Vi…

200 papers

In this paper, we focus on the self-supervised learning of visual correspondence using unlabeled videos in the wild. Our method simultaneously considers intra- and inter-video representation associations for reliable correspondence…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Ning Wang , Wengang Zhou , Houqiang Li

Recent advances in self-supervised learning have attracted significant attention from both machine learning and neuroscience. This is primarily because self-supervised methods do not require annotated supervisory information, making them…

Neurons and Cognition · Quantitative Biology 2025-12-05 Asaki Kataoka , Yoshihiro Nagano , Masafumi Oizumi

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

Salient object detection has recently witnessed substantial progress due to powerful features extracted using deep convolutional neural networks (CNNs). However, existing CNN-based methods operate at the patch level instead of the pixel…

Computer Vision and Pattern Recognition · Computer Science 2016-03-08 Guanbin Li , Yizhou Yu

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

This paper introduces a new algorithm for unsupervised learning of keypoint detectors and descriptors, which demonstrates fast convergence and good performance across different datasets. The training procedure uses homographic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Anatoly Belikov , Alexey Potapov

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiquan Li , Xianzhong Long , Yun Li

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

We propose Corder, a self-supervised contrastive learning framework for source code model. Corder is designed to alleviate the need of labeled data for code retrieval and code summarization tasks. The pre-trained model of Corder can be used…

Software Engineering · Computer Science 2021-05-25 Nghi D. Q. Bui , Yijun Yu , Lingxiao Jiang

Recent progress in pretrained Transformer-based language models has shown great success in learning contextual representation of text. However, due to the quadratic self-attention complexity, most of the pretrained Transformers models can…

Computation and Language · Computer Science 2021-10-22 Peng Xu , Xinchi Chen , Xiaofei Ma , Zhiheng Huang , Bing Xiang

The corner-based detection paradigm enjoys the potential to produce high-quality boxes. But the development is constrained by three factors: 1) Hard to match corners. Heuristic corner matching algorithms can lead to incorrect boxes,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chenglong Liu , Jintao Liu , Haorao Wei , Jinze Yang , Liangyu Xu , Yuchen Guo , Lu Fang

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Image and Point Clouds provide different information for robots. Finding the correspondences between data from different sensors is crucial for various tasks such as localization, mapping, and navigation. Learning-based descriptors have…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Peng Jiang , Srikanth Saripalli

The prior self-supervised learning researches mainly select image-level instance discrimination as pretext task. It achieves a fantastic classification performance that is comparable to supervised learning methods. However, with degraded…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Bing Zhao , Jun Li , Hong Zhu

Labeling videos at scale is impractical. Consequently, self-supervised visual representation learning is key for efficient video analysis. Recent success in learning image representations suggests contrastive learning is a promising…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nishant Rai , Ehsan Adeli , Kuan-Hui Lee , Adrien Gaidon , Juan Carlos Niebles

While self-supervised learning techniques are often used to mining implicit knowledge from unlabeled data via modeling multiple views, it is unclear how to perform effective representation learning in a complex and inconsistent context. To…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Farid Razzak , Ji-Rong Wen , Hui Xiong

Infrared and visible image fusion targets to provide an informative image by combining complementary information from different sensors. Existing learning-based fusion approaches attempt to construct various loss functions to preserve…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jinyuan Liu , Runjia Lin , Guanyao Wu , Risheng Liu , Zhongxuan Luo , Xin Fan

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord