中文
相关论文

相关论文: On the Difficulty of Defending Contrastive Learnin…

200 篇论文

Deep Neural Networks are well known to be vulnerable to adversarial attacks and backdoor attacks, where minor modifications on the input are able to mislead the models to give wrong results. Although defenses against adversarial attacks…

机器学习 · 计算机科学 2022-08-01 Kaidi Jin , Tianwei Zhang , Chao Shen , Yufei Chen , Ming Fan , Chenhao Lin , Ting Liu

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Due to its distributed methodology alongside its privacy-preserving features, Federated Learning (FL) is vulnerable to training time adversarial attacks. In this study, our focus is on backdoor attacks in which the adversary's goal is to…

机器学习 · 计算机科学 2021-02-11 Omid Aramoon , Pin-Yu Chen , Gang Qu , Yuan Tian

Contrastive Learning first extracts features from unlabeled data, followed by linear probing with labeled data. Adversarial Contrastive Learning (ACL) integrates Adversarial Training into the first phase to enhance feature robustness…

机器学习 · 计算机科学 2025-10-28 Ngoc N. Tran , Lam Tran , Hoang Phan , Anh Bui , Tung Pham , Toan Tran , Dinh Phung , Trung Le

Transfer learning provides an effective solution for feasibly and fast customize accurate \textit{Student} models, by transferring the learned knowledge of pre-trained \textit{Teacher} models over large datasets via fine-tuning. Many…

机器学习 · 计算机科学 2020-08-11 Shuo Wang , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen , Tianle Chen

This work provides the community with a timely comprehensive review of backdoor attacks and countermeasures on deep learning. According to the attacker's capability and affected stage of the machine learning pipeline, the attack surfaces…

密码学与安全 · 计算机科学 2020-08-04 Yansong Gao , Bao Gia Doan , Zhi Zhang , Siqi Ma , Jiliang Zhang , Anmin Fu , Surya Nepal , Hyoungshick Kim

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Transfer-based adversarial attacks raise a severe threat to real-world deep learning systems since they do not require access to target models. Adversarial training (AT), which is recognized as the strongest defense against white-box…

密码学与安全 · 计算机科学 2023-10-17 Yulong Yang , Chenhao Lin , Xiang Ji , Qiwei Tian , Qian Li , Hongshan Yang , Zhibo Wang , Chao Shen

Despite the promise of Federated Learning (FL) for privacy-preserving model training on distributed data, it remains susceptible to backdoor attacks. These attacks manipulate models by embedding triggers (specific input patterns) in the…

密码学与安全 · 计算机科学 2024-07-12 Tuan Nguyen , Dung Thuy Nguyen , Khoa D Doan , Kok-Seng Wong

Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the unlabeled data so that when a victim trains an SSL model on…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Ajinkya Tejankar , Maziar Sanjabi , Qifan Wang , Sinong Wang , Hamed Firooz , Hamed Pirsiavash , Liang Tan

Cross-domain recommendation (CDR) is a task that aims to improve the recommendation performance in a target domain by leveraging the information from source domains. Contrastive learning methods have been widely adopted among intra-domain…

信息检索 · 计算机科学 2025-02-25 Heng Chang , Liang Gu , Cheng Hu , Zhinan Zhang , Hong Zhu , Yuhui Xu , Yuan Fang , Zhen Chen

Federated learning (FL) is a machine learning (ML) approach that allows the use of distributed data without compromising personal privacy. However, the heterogeneous distribution of data among clients in FL can make it difficult for the…

机器学习 · 计算机科学 2023-03-07 Thuy Dung Nguyen , Tuan Nguyen , Phi Le Nguyen , Hieu H. Pham , Khoa Doan , Kok-Seng Wong

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

计算与语言 · 计算机科学 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

Deep learning is becoming increasingly popular in real-life applications, especially in natural language processing (NLP). Users often choose training outsourcing or adopt third-party data and models due to data and computation resources…

计算与语言 · 计算机科学 2022-11-23 Xuan Sheng , Zhaoyang Han , Piji Li , Xiangmao Chang

Due to the popularity of Artificial Intelligence (AI) techniques, we are witnessing an increasing number of backdoor injection attacks that are designed to maliciously threaten Deep Neural Networks (DNNs) causing misclassification. Although…

机器学习 · 计算机科学 2022-05-18 Zhihao Yue , Jun Xia , Zhiwei Ling , Ming Hu , Ting Wang , Xian Wei , Mingsong Chen

As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden…

密码学与安全 · 计算机科学 2021-01-21 Ximing Qiao , Yuhua Bai , Siping Hu , Ang Li , Yiran Chen , Hai Li

Deep learning solutions are instrumental in cybersecurity, harnessing their ability to analyze vast datasets, identify complex patterns, and detect anomalies. However, malevolent actors can exploit these capabilities to orchestrate…

密码学与安全 · 计算机科学 2024-12-19 Shalini Saini , Anitha Chennamaneni , Babatunde Sawyerr

To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities…

机器学习 · 计算机科学 2023-06-08 Fatemeh Ghofrani , Mehdi Yaghouti , Pooyan Jamshidi

Backdoor attacks pose a serious threat to the security of large language models (LLMs), causing them to exhibit anomalous behavior under specific trigger conditions. The design of backdoor triggers has evolved from fixed triggers to dynamic…

密码学与安全 · 计算机科学 2026-04-15 Haotian Jin , Yang Li , Haihui Fan , Lin Shen , Xiangfang Li , Bo Li