中文
相关论文

相关论文: Joint Contrastive Learning with Infinite Possibili…

200 篇论文

Self-supervised contrastive learning (CL) has achieved state-of-the-art performance in representation learning by minimizing the distance between positive pairs while maximizing that of negative ones. Recently, it has been verified that the…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Jin-Young Kim , Soonwoo Kwon , Hyojun Go , Yunsung Lee , Seungtaek Choi , Hyun-Gyoon Kim

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

高能物理 - 实验 · 物理学 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

In this paper, we propose the $K$-Shot Contrastive Learning (KSCL) of visual features by applying multiple augmentations to investigate the sample variations within individual instances. It aims to combine the advantages of inter-instance…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Haohang Xu , Hongkai Xiong , Guo-Jun Qi

In recent years, graph contrastive learning (GCL) has received increasing attention in recommender systems due to its effectiveness in reducing bias caused by data sparsity. However, most existing GCL models rely on heuristic approaches and…

信息检索 · 计算机科学 2024-07-23 Jiakai Tang , Sunhao Dai , Zexu Sun , Xu Chen , Jun Xu , Wenhui Yu , Lantao Hu , Peng Jiang , Han Li

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

In contrastive learning, two views of an original image, generated by different augmentations, are considered a positive pair, and their similarity is required to be high. Similarly, two views of distinct images form a negative pair, with…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Lei Wang , Piotr Koniusz , Tom Gedeon , Liang Zheng

Contrastive learning is a prevalent technique in self-supervised vision representation learning, typically generating positive pairs by applying two data augmentations to the same image. Designing effective data augmentation strategies is…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

Contrastive learning has shown impressive success in enhancing feature discriminability for various visual tasks in a self-supervised manner, but the standard contrastive paradigm (features+$\ell_{2}$ normalization) has limited benefits…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Junjie Li , Yixin Zhang , Zilei Wang , Saihui Hou , Keyu Tu , Man Zhang

Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are…

机器学习 · 计算机科学 2026-01-27 Viet Anh Khoa Tran , Emre Neftci , Willem A. M. Wybo

A lot of recent advances in unsupervised feature learning are based on designing features which are invariant under semantic data augmentations. A common way to do this is contrastive learning, which uses positive and negative samples. Some…

机器学习 · 计算机科学 2022-03-30 Ashwini Pokle , Jinjin Tian , Yuchen Li , Andrej Risteski

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Xiao Wang , Guo-Jun Qi

Learning contrastive representations from pairwise comparisons has achieved remarkable success in various fields, such as natural language processing, computer vision, and information retrieval. Collaborative filtering algorithms based on…

信息检索 · 计算机科学 2023-08-01 Bin Liu , Qin Luo , Bang Wang

This paper proposes to perform online clustering by conducting twin contrastive learning (TCL) at the instance and cluster level. Specifically, we find that when the data is projected into a feature space with a dimensionality of the target…

机器学习 · 计算机科学 2022-10-24 Yunfan Li , Mouxing Yang , Dezhong Peng , Taihao Li , Jiantao Huang , Xi Peng

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Swati Jindal , Roberto Manduchi

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

机器学习 · 计算机科学 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Deep neural networks suffer from catastrophic forgetting when continually learning new concepts. In this paper, we analyze this problem from a data imbalance point of view. We argue that the imbalance between old task and new task data…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Leyuan Wang , Liuyu Xiang , Yunlong Wang , Huijia Wu , Zhaofeng He

This paper proposes a probabilistic contrastive loss function for self-supervised learning. The well-known contrastive loss is deterministic and involves a temperature hyperparameter that scales the inner product between two normed feature…

机器学习 · 计算机科学 2021-12-06 Shen Li , Jianqing Xu , Bryan Hooi

Contrastive learning (CL) has been successful as a powerful representation learning method. In this paper, we propose a contrastive learning framework for cross-domain sentiment classification. We aim to induce domain invariant optimal…

计算与语言 · 计算机科学 2020-12-08 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

机器学习 · 计算机科学 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu