English
Related papers

Related papers: Representation Learning via Non-Contrastive Mutual…

200 papers

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Tianyu Guo , Hong Liu , Zhan Chen , Mengyuan Liu , Tao Wang , Runwei Ding

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

Multimodal image-tabular learning is gaining attention, yet it faces challenges due to limited labeled data. While earlier work has applied self-supervised learning (SSL) to unlabeled data, its task-agnostic nature often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyi Du , Xinzhe Luo , Declan P. O'Regan , Chen Qin

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

We study the discriminative probabilistic modeling on a continuous domain for the data prediction task of (multimodal) self-supervised representation learning. To address the challenge of computing the integral in the partition function for…

Machine Learning · Computer Science 2025-03-06 Bokun Wang , Yunwen Lei , Yiming Ying , Tianbao Yang

Learning representations that transfer well to diverse downstream tasks remains a central challenge in representation learning. Existing paradigms -- contrastive learning, self-supervised masking, and denoising auto-encoders -- balance this…

Machine Learning · Computer Science 2025-09-29 Micha Livne

The focus of this study is on Unsupervised Continual Learning (UCL), as it presents an alternative to Supervised Continual Learning which needs high-quality manual labeled data. The experiments under the UCL paradigm indicate a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chen Cheng , Jingkuan Song , Xiaosu Zhu , Junchen Zhu , Lianli Gao , Hengtao Shen

Representation learning constitutes a pivotal cornerstone in contemporary deep learning paradigms, offering a conduit to elucidate distinctive features within the latent space and interpret the deep models. Nevertheless, the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Siyuan Dai , Kai Ye , Kun Zhao , Ge Cui , Haoteng Tang , Liang Zhan

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

The underlying correlation between audio and visual modalities can be utilized to learn supervised information for unlabeled videos. In this paper, we propose an end-to-end self-supervised framework named Audio-Visual Contrastive Learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yang Liu , Ying Tan , Haoyuan Lan

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

In this study, a novel self-supervised learning (SSL) method is proposed, which considers SSL in terms of variational inference to learn not only representation but also representation uncertainties. SSL is a method of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Hiroki Nakamura , Masashi Okada , Tadahiro Taniguchi

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

Self-supervised learning has shown its great potential to extract powerful visual representations without human annotations. Various works are proposed to deal with self-supervised learning from different perspectives: (1) contrastive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Chenxin Tao , Honghui Wang , Xizhou Zhu , Jiahua Dong , Shiji Song , Gao Huang , Jifeng Dai

In this paper, we study contrastive learning from an optimization perspective, aiming to analyze and address a fundamental issue of existing contrastive learning methods that either rely on a large batch size or a large dictionary of…

Machine Learning · Computer Science 2022-09-22 Zhuoning Yuan , Yuexin Wu , Zi-Hao Qiu , Xianzhi Du , Lijun Zhang , Denny Zhou , Tianbao Yang

We propose SigCLR: Sigmoid Contrastive Learning of Visual Representations. SigCLR utilizes the logistic loss that only operates on pairs and does not require a global view as in the cross-entropy loss used in SimCLR. We show that logistic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ömer Veysel Çağatan

Contrastive self supervised learning(CSSL) usually makes use of the multi-view assumption which states that all relevant information must be shared between all views. The main objective of CSSL is to maximize the mutual information(MI)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yash Kumar Sharma , Vineet Padmanabhan