English
Related papers

Related papers: Fast-MoCo: Boost Momentum-based Contrastive Learni…

200 papers

Self-supervised representation learning approaches have recently surpassed their supervised learning counterparts on downstream tasks like object detection and image classification. Somewhat mysteriously the recent gains in performance come…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Senthil Purushwalkam , Abhinav Gupta

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Contrastive learning is a form of self-supervision that can leverage unlabeled data to produce pretrained models. While contrastive learning has demonstrated promising results on natural image classification tasks, its application to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Hari Sowrirajan , Jingbo Yang , Andrew Y. Ng , Pranav Rajpurkar

Estimating correspondences between pairs of non-rigid deformable 3D shapes remains a significant challenge in computer vision and graphics. While deep functional map methods have become the go-to solution for addressing this problem, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Feifan Luo , Hongyang Chen

Contrastive learning operates on a simple yet effective principle: Embeddings of positive pairs are pulled together, while those of negative pairs are pushed apart. In this paper, we propose a unified framework for understanding contrastive…

Machine Learning · Computer Science 2025-07-16 Chungpa Lee , Sehee Lim , Kibok Lee , Jy-yong Sohn

Recent unsupervised contrastive representation learning follows a Single Instance Multi-view (SIM) paradigm where positive pairs are usually constructed with intra-image data augmentation. In this paper, we propose an effective approach…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xiangxiang Chu , Xiaohang Zhan , Bo Zhang

This work presents improvements in monocular hand shape estimation by building on top of recent advances in unsupervised learning. We extend momentum contrastive learning and contribute a structured collection of hand images, well suited…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Christian Zimmermann , Max Argus , Thomas Brox

Learning-based multi-view stereo (MVS) methods have made impressive progress and surpassed traditional methods in recent years. However, their accuracy and completeness are still struggling. In this paper, we propose a new method to enhance…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Yikang Ding , Zhenyang Li , Dihe Huang , Zhiheng Li , Kai Zhang

In recent years, self-supervised contrastive learning has emerged as a distinguished paradigm in the artificial intelligence landscape. It facilitates unsupervised feature learning through contrastive delineations at the instance level.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Jiansong Zhang , Linlin Shen , Peizhong Liu

Current multimodal models leveraging contrastive learning often face limitations in developing fine-grained conceptual understanding. This is due to random negative samples during pretraining, causing almost exclusively very dissimilar…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Philipp J. Rösch , Norbert Oswald , Michaela Geierhos , Jindřich Libovický

Contrastive learning is a prevalent technique in self-supervised vision representation learning, typically generating positive pairs by applying two data augmentations to the same image. Designing effective data augmentation strategies is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Contrastive learning has recently narrowed the gap between self-supervised and supervised methods in image and video domain. State-of-the-art video contrastive learning methods such as CVRL and $\rho$-MoCo spatiotemporally augment two clips…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 David Fan , Deyu Yang , Xinyu Li , Vimal Bhat , Rohith MV

In this paper, we propose Parametric Contrastive Learning (PaCo) to tackle long-tailed recognition. Based on theoretical analysis, we observe supervised contrastive loss tends to bias on high-frequency classes and thus increases the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Jiequan Cui , Zhisheng Zhong , Shu Liu , Bei Yu , Jiaya Jia

In this paper, we propose a genuine group-level contrastive visual representation learning method whose linear evaluation performance on ImageNet surpasses the vanilla supervised learning. Two mainstream unsupervised learning schemes are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Bo Pang , Yifan Zhang , Yaoyi Li , Jia Cai , Cewu Lu

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on supervised learning and thus require vast amounts of training data. Due to their scarcity and minuscule…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Xiaochen Zheng

Self-supervised learning is a central component in recent approaches to deep multi-view clustering (MVC). However, we find large variations in the development of self-supervision-based methods for deep MVC, potentially slowing the progress…

Machine Learning · Statistics 2023-03-20 Daniel J. Trosten , Sigurd Løkse , Robert Jenssen , Michael C. Kampffmeyer

This work aims to improve unsupervised audio-visual pre-training. Inspired by the efficacy of data augmentation in visual contrastive learning, we propose a novel speed co-augmentation method that randomly changes the playback speeds of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiangliu Wang , Jianbo Jiao , Yibing Song , Stephen James , Zhan Tong , Chongjian Ge , Pieter Abbeel , Yun-hui Liu

Accurately predicting the future trajectories of traffic agents is essential in autonomous driving. However, due to the inherent imbalance in trajectory distributions, tail data in natural datasets often represents more complex and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Bin Rao , Haicheng Liao , Yanchen Guan , Chengyue Wang , Bonan Wang , Jiaxun Zhang , Zhenning Li

In this paper, we introduce a contrastive learning framework for keypoint detection (CoKe). Keypoint detection differs from other visual tasks where contrastive learning has been applied because the input is a set of images in which…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yutong Bai , Angtian Wang , Adam Kortylewski , Alan Yuille