English
Related papers

Related papers: A Principled Framework for Multi-View Contrastive …

200 papers

Effective suppression of surface-related multiples is essential to prevent imaging artifacts and erroneous structural interpretations. While conventional approaches rely on accurate priors or subsurface model knowledge, and supervised…

Geophysics · Physics 2026-05-01 Huan Song , Shijun Cheng , Huanhuan Tang , Wei Ouyang , Weijian Mao

Contrastive learning (CL) has recently been applied to adversarial learning tasks. Such practice considers adversarial samples as additional positive views of an instance, and by maximizing their agreements with each other, yields better…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Qiying Yu , Jieming Lou , Xianyuan Zhan , Qizhang Li , Wangmeng Zuo , Yang Liu , Jingjing Liu

Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so far in applying this…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

Information Retrieval · Computer Science 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Self-supervised learning is a central component in recent approaches to deep multi-view clustering (MVC). However, we find large variations in the development of self-supervision-based methods for deep MVC, potentially slowing the progress…

Machine Learning · Statistics 2023-03-20 Daniel J. Trosten , Sigurd Løkse , Robert Jenssen , Michael C. Kampffmeyer

In contrastive learning, two views of an original image, generated by different augmentations, are considered a positive pair, and their similarity is required to be high. Similarly, two views of distinct images form a negative pair, with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Lei Wang , Piotr Koniusz , Tom Gedeon , Liang Zheng

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Jansel Herrera-Gerena , Ramakrishnan Sundareswaran , John Just , Matthew Darr , Ali Jannesari

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

The Information Contrastive (I-Con) framework revealed that over 23 representation learning methods implicitly minimize KL divergence between data and learned distributions that encode similarities between data points. However, a KL-based…

Machine Learning · Computer Science 2025-12-05 Jasmine Shone , Zhening Li , Shaden Alshammari , Mark Hamilton , William Freeman

Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Shohreh Deldari , Hao Xue , Aaqib Saeed , Daniel V. Smith , Flora D. Salim

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Contrastive learning (CL), which can extract the information shared between different contrastive views, has become a popular paradigm for vision representation learning. Inspired by the success in computer vision, recent work introduces CL…

Machine Learning · Computer Science 2022-12-15 Xumeng Gong , Cheng Yang , Chuan Shi

In this paper, we propose the $K$-Shot Contrastive Learning (KSCL) of visual features by applying multiple augmentations to investigate the sample variations within individual instances. It aims to combine the advantages of inter-instance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Haohang Xu , Hongkai Xiong , Guo-Jun Qi

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

What do different contrastive learning (CL) losses actually optimize for? Although multiple CL methods have demonstrated remarkable representation learning capabilities, the differences in their inner workings remain largely opaque. In this…

Machine Learning · Computer Science 2024-05-29 Panagiotis Koromilas , Giorgos Bouritsas , Theodoros Giannakopoulos , Mihalis Nicolaou , Yannis Panagakis

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Multimodal Contrastive Learning (MCL) advances in aligning different modalities and generating multimodal representations in a joint space. By leveraging contrastive learning across diverse modalities, large-scale multimodal data enhances…

Machine Learning · Computer Science 2025-09-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Wenbin Li , Meihao Kong , Xuesong Yang , Lei Wang , Jing Huo , Yang Gao , Jiebo Luo