English
Related papers

Related papers: Adversarial Self-Supervised Contrastive Learning

200 papers

The use of unsupervised data in addition to supervised data in training discriminative neural networks has improved the performance of this clas- sification scheme. However, the best results were achieved with a training process that is…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Juan Maroñas Molano , Alberto Albiol Colomer , Roberto Paredes Palacios

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

Contrastive learning (CL) can learn generalizable feature representations and achieve the state-of-the-art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Lijie Fan , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Chuang Gan

Cloud networks increasingly rely on machine learning based Network Intrusion Detection Systems to defend against evolving cyber threats. However, real-world deployments are challenged by limited labeled data, non-stationary traffic, and…

Machine Learning · Computer Science 2026-04-15 Anasuya Chattopadhyay , Daniel Reti , Hans D. Schotten

The usage of machine learning models has grown substantially and is spreading into several application domains. A common need in using machine learning models is collecting the data required to train these models. In some cases, labeling a…

Machine Learning · Computer Science 2019-09-19 Chidubem Arachie , Bert Huang

We study the problem of robust domain adaptation in the context of unavailable target labels and source data. The considered robustness is against adversarial perturbations. This paper aims at answering the question of finding the right…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peshal Agarwal , Danda Pani Paudel , Jan-Nico Zaech , Luc Van Gool

In recent years, graph contrastive learning (GCL) has received increasing attention in recommender systems due to its effectiveness in reducing bias caused by data sparsity. However, most existing GCL models rely on heuristic approaches and…

Information Retrieval · Computer Science 2024-07-23 Jiakai Tang , Sunhao Dai , Zexu Sun , Xu Chen , Jun Xu , Wenhui Yu , Lantao Hu , Peng Jiang , Han Li

Contrastive learning has shown outstanding performances in both supervised and unsupervised learning, and has recently been introduced to solve weakly supervised learning problems such as semi-supervised learning and noisy label learning.…

Machine Learning · Computer Science 2023-06-08 Jingyi Cui , Weiran Huang , Yifei Wang , Yisen Wang

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

Contrastive self-supervised learning has been successfully used in many domains, such as images, texts, graphs, etc., to learn features without requiring label information. In this paper, we propose a new local contrastive feature learning…

Machine Learning · Computer Science 2022-11-22 Zhabiz Gharibshah , Xingquan Zhu

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

Machine Learning · Statistics 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Supervised learning of deep neural networks heavily relies on large-scale datasets annotated by high-quality labels. In contrast, mislabeled samples can significantly degrade the generalization of models and result in memorizing samples,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

Deep networks are well-known to be fragile to adversarial attacks, and adversarial training is one of the most popular methods used to train a robust model. To take advantage of unlabeled data, recent works have applied adversarial training…

Machine Learning · Computer Science 2023-02-22 Xin Zou , Weiwei Liu

Adversarial examples are carefully crafted attack points that are supposed to fool machine learning classifiers. In the last years, the field of adversarial machine learning, especially the study of perturbation-based adversarial examples,…

Machine Learning · Computer Science 2023-09-19 Roland Rauter , Martin Nocker , Florian Merkle , Pascal Schöttle

Deep learning models are known to be vulnerable to adversarial examples that are elaborately designed for malicious purposes and are imperceptible to the human perceptual system. Autoencoder, when trained solely over benign examples, has…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Jinyu Tian , Jiantao Zhou

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

Machine Learning · Computer Science 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos