中文
相关论文

相关论文: Towards Domain-Agnostic Contrastive Learning

200 篇论文

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

计算机视觉与模式识别 · 计算机科学 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which…

计算机视觉与模式识别 · 计算机科学 2022-02-02 Jansel Herrera-Gerena , Ramakrishnan Sundareswaran , John Just , Matthew Darr , Ali Jannesari

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

机器学习 · 计算机科学 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

机器学习 · 计算机科学 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Continual Learning has been challenging, especially when dealing with unsupervised scenarios such as Unsupervised Online General Continual Learning (UOGCL), where the learning agent has no prior knowledge of class boundaries or task change…

机器学习 · 计算机科学 2023-09-14 Nicolas Michel , Romain Negrel , Giovanni Chierchia , Jean-François Bercher

Graph contrastive learning (GCL) learns node and graph representations by contrasting multiple views of the same graph. Existing methods typically rely on fixed, handcrafted views-usually a local and a global perspective, which limits their…

机器学习 · 计算机科学 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Keyue Jiang , Kai Zhao , Wee Peng Tay

Self-supervised learning attempts to learn representations from un-labeled data; it does so via a loss function that encourages the embedding of a point to be close to that of its augmentations. This simple idea performs remarkably well,…

机器学习 · 计算机科学 2026-01-30 Parikshit Bansal , Ali Kavis , Sujay Sanghavi

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the…

机器学习 · 计算机科学 2024-02-07 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

机器学习 · 计算机科学 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

机器学习 · 统计学 2025-12-03 Ali Alvandi , Mina Rezaei

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail…

In this paper, we propose Domain Agnostic Meta Score-based Learning (DAMSL), a novel, versatile and highly effective solution that delivers significant out-performance over state-of-the-art methods for cross-domain few-shot learning. We…

机器学习 · 计算机科学 2021-06-08 John Cai , Bill Cai , Shengmei Shen

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

The deep learning technique has been shown to be effectively addressed several image analysis tasks in the computer-aided diagnosis scheme for mammography. The training of an efficacious deep learning model requires large data with diverse…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Zheren Li , Zhiming Cui , Lichi Zhang , Sheng Wang , Chenjin Lei , Xi Ouyang , Dongdong Chen , Xiangyu Zhao , Yajia Gu , Zaiyi Liu , Chunling Liu , Dinggang Shen , Jie-Zhi Cheng

The pretasks are mainly built on mutual information estimation, which requires data augmentation to construct positive samples with similar semantics to learn invariant signals and negative samples with dissimilar semantics in order to…

机器学习 · 计算机科学 2023-03-07 Haifeng Li , Jun Cao , Jiawei Zhu , Qinyao Luo , Silu He , Xuyin Wang

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

信息检索 · 计算机科学 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang