English
Related papers

Related papers: Adaptive Data Augmentation for Contrastive Learnin…

200 papers

As trustworthy AI continues to advance, the fairness issue in recommendations has received increasing attention. A recommender system is considered unfair when it produces unequal outcomes for different user groups based on user-sensitive…

Artificial Intelligence · Computer Science 2024-10-24 Wei Chen , Meng Yuan , Zhao Zhang , Ruobing Xie , Fuzhen Zhuang , Deqing Wang , Rui Liu

Data augmentation has proved extremely useful by increasing training data variance to alleviate overfitting and improve deep neural networks' generalization performance. In medical image analysis, a well-designed augmentation policy usually…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yunhe Gao , Zhiqiang Tang , Mu Zhou , Dimitris Metaxas

Micro-video recommender systems suffer from the ubiquitous noises in users' behaviors, which might render the learned user representation indiscriminating, and lead to trivial recommendations (e.g., popular items) or even weird ones that…

Information Retrieval · Computer Science 2022-08-18 Shengyu Zhang , Bofang Li , Dong Yao , Fuli Feng , Jieming Zhu , Wenyan Fan , Zhou Zhao , Xiaofei He , Tat-seng Chua , Fei Wu

Recent works have shown that self-supervised learning can achieve remarkable robustness when integrated with adversarial training (AT). However, the robustness gap between supervised AT (sup-AT) and self-supervised AT (self-AT) remains…

Machine Learning · Computer Science 2023-03-06 Rundong Luo , Yifei Wang , Yisen Wang

The adaptive gradient online learning method known as AdaGrad has seen widespread use in the machine learning community in stochastic and adversarial online learning problems and more recently in deep learning methods. The method's…

Machine Learning · Computer Science 2016-10-05 Nishant A. Mehta , Alistair Rendell , Anish Varghese , Christfried Webers

Deformable multi-contrast image registration is a challenging yet crucial task due to the complex, non-linear intensity relationships across different imaging contrasts. Conventional registration methods typically rely on iterative…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yinsong Wang , Xinzhe Luo , Siyi Du , Chen Qin

Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been gradually replaced…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huafeng Qin , Xin Jin , Yun Jiang , Mounim A. El-Yacoubi , Xinbo Gao

Unsupervised domain adaptation (UDA) provides a strategy for improving machine learning performance in data-rich (target) domains where ground truth labels are inaccessible but can be found in related (source) domains. In cases where…

Machine Learning · Computer Science 2023-07-24 Garrett Wilson , Janardhan Rao Doppa , Diane J. Cook

To deal with the exhausting annotations, self-supervised representation learning from unlabeled point clouds has drawn much attention, especially centered on augmentation-based contrastive methods. However, specific augmentations hardly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zhuheng Lu , Yuewei Dai , Weiqing Li , Zhiyong Su

Recent advancements in self-supervised audio-visual representation learning have demonstrated its potential to capture rich and comprehensive representations. However, despite the advantages of data augmentation verified in many learning…

Machine Learning · Computer Science 2024-06-21 Jongsuk Kim , Hyeongkeun Lee , Kyeongha Rho , Junmo Kim , Joon Son Chung

Contrastive representation learning has shown to be effective to learn representations from unlabeled data. However, much progress has been made in vision domains relying on data augmentations carefully designed using domain knowledge. In…

Machine Learning · Computer Science 2021-03-19 Kibok Lee , Yian Zhu , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin , Honglak Lee

Contrastive learning has led to substantial improvements in the quality of learned embedding representations for tasks such as image classification. However, a key drawback of existing contrastive augmentation methods is that they may lead…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Zhibo Zhang , Jongseong Jang , Chiheb Trabelsi , Ruiwen Li , Scott Sanner , Yeonjeong Jeong , Dongsub Shim

Self-supervised pre-training methods based on contrastive learning or regression tasks can utilize more unlabeled data to improve the performance of automatic speech recognition (ASR). However, the robustness impact of combining the two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-28 Qiu-Shi Zhu , Long Zhou , Jie Zhang , Shu-Jie Liu , Yu-Chen Hu , Li-Rong Dai

Self-supervised contrastive learning has become a key technique in deep learning, particularly in time series analysis, due to its ability to learn meaningful representations without explicit supervision. Augmentation is a critical…

Machine Learning · Computer Science 2024-07-15 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the…

Machine Learning · Computer Science 2024-02-07 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

In this paper, we introduce a novel neural network training framework that increases model's adversarial robustness to adversarial attacks while maintaining high clean accuracy by combining contrastive learning (CL) with adversarial…

Machine Learning · Computer Science 2022-09-13 Adir Rahamim , Itay Naeh

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

Information Retrieval · Computer Science 2022-07-08 Abhijit Anand , Jurek Leonhardt , Koustav Rudra , Avishek Anand

Data augmentation (DA) is widely used to improve the generalization of neural networks by enforcing the invariances and symmetries to pre-defined transformations applied to input data. However, a fixed augmentation policy may have different…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Chengkai Hou , Jieyu Zhang , Tianyi Zhou

Automated animal censuses with aerial imagery are a vital ingredient towards wildlife conservation. Recent models are generally based on supervised learning and thus require vast amounts of training data. Due to their scarcity and minuscule…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Xiaochen Zheng

This work focuses on unsupervised representation learning in person re-identification (ReID). Recent self-supervised contrastive learning methods learn invariance by maximizing the representation similarity between two augmented views of a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Hao Chen , Yaohui Wang , Benoit Lagadec , Antitza Dantcheva , Francois Bremond