English
Related papers

Related papers: Adversarial Contrastive Learning for LLM Quantizat…

200 papers

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial…

Cryptography and Security · Computer Science 2024-02-13 Raha Moraffah , Shubh Khandelwal , Amrita Bhattacharjee , Huan Liu

Availability attacks can prevent the unauthorized use of private data and commercial datasets by generating imperceptible noise and making unlearnable examples before release. Ideally, the obtained unlearnability prevents algorithms from…

Machine Learning · Computer Science 2024-02-07 Yihan Wang , Yifan Zhu , Xiao-Shan Gao

Large Language Models (LLMs) are valuable for text classification, but their vulnerabilities must not be disregarded. They lack robustness against adversarial examples, so it is pertinent to understand the impacts of different types of…

Computation and Language · Computer Science 2024-06-13 João Vitorino , Eva Maia , Isabel Praça

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

Machine Learning · Computer Science 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

Large language models (LLMs) have demonstrated impressive performance across various domains but remain susceptible to safety concerns. Prior research indicates that gradient-based adversarial attacks are particularly effective against…

Computation and Language · Computer Science 2024-10-30 Jingbo Su

In this paper, we introduce a novel neural network training framework that increases model's adversarial robustness to adversarial attacks while maintaining high clean accuracy by combining contrastive learning (CL) with adversarial…

Machine Learning · Computer Science 2022-09-13 Adir Rahamim , Itay Naeh

Adversarial training (AT) with imperfect supervision is significant but receives limited attention. To push AT towards more practical scenarios, we explore a brand new yet challenging setting, i.e., AT with complementary labels (CLs), which…

Machine Learning · Computer Science 2022-11-02 Jianan Zhou , Jianing Zhu , Jingfeng Zhang , Tongliang Liu , Gang Niu , Bo Han , Masashi Sugiyama

Reinforcement learning (RL) has achieved remarkable success in fields like robotics and autonomous driving, but adversarial attacks designed to mislead RL systems remain challenging. Existing approaches often rely on modifying the…

Machine Learning · Computer Science 2025-07-25 Junyong Jiang , Buwei Tian , Chenxing Xu , Songze Li , Lu Dong

With the emergence of large language models, such as LLaMA and OpenAI GPT-3, In-Context Learning (ICL) gained significant attention due to its effectiveness and efficiency. However, ICL is very sensitive to the choice, order, and verbaliser…

Computation and Language · Computer Science 2024-10-10 Simon Yu , Jie He , Pasquale Minervini , Jeff Z. Pan

As Large Language Models (LLMs) are widely used, understanding them systematically is key to improving their safety and realizing their full potential. Although many models are aligned using techniques such as reinforcement learning from…

Machine Learning · Computer Science 2025-05-16 Sajib Biswas , Mao Nishino , Samuel Jacob Chacko , Xiuwen Liu

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

Machine Learning · Computer Science 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

The field of chemistry and Artificial Intelligence (AI) intersection is an area of active research that aims to accelerate scientific discovery. The integration of large language models (LLMs) with scientific modalities has shown…

Computation and Language · Computer Science 2024-07-16 Dimitris Gkoumas

With the emergence of more powerful large language models (LLMs), such as ChatGPT and GPT-4, in-context learning (ICL) has gained significant prominence in leveraging these models for specific tasks by utilizing data-label pairs as…

Computation and Language · Computer Science 2023-10-17 Jiongxiao Wang , Zichen Liu , Keun Hee Park , Zhuojun Jiang , Zhaoheng Zheng , Zhuofeng Wu , Muhao Chen , Chaowei Xiao

Despite its success in self-supervised learning, contrastive learning is less studied in the supervised setting. In this work, we first use a set of pilot experiments to show that in the supervised setting, the cross-entropy loss objective…

Computation and Language · Computer Science 2026-02-13 Liz Li , Wei Zhu

Contrastive Learning (CL) has attracted enormous attention due to its remarkable capability in unsupervised representation learning. However, recent works have revealed the vulnerability of CL to backdoor attacks: the feature extractor…

Cryptography and Security · Computer Science 2024-04-12 Weiyu Sun , Xinyu Zhang , Hao Lu , Yingcong Chen , Ting Wang , Jinghui Chen , Lu Lin

To circumvent the alignment of large language models (LLMs), current optimization-based adversarial attacks usually craft adversarial prompts by maximizing the likelihood of a so-called affirmative response. An affirmative response is a…

In-context learning (ICL) has demonstrated remarkable success in large language models (LLMs) due to its adaptability and parameter-free nature. However, it also introduces a critical vulnerability to backdoor attacks, where adversaries can…

Machine Learning · Computer Science 2025-07-03 Zhiyao Ren , Siyuan Liang , Aishan Liu , Dacheng Tao

Recent research indicates that large language models (LLMs) are susceptible to jailbreaking attacks that can generate harmful content. This paper introduces a novel token-level attack method, Adaptive Dense-to-Sparse Constrained…

Machine Learning · Computer Science 2025-02-13 Kai Hu , Weichen Yu , Yining Li , Kai Chen , Tianjun Yao , Xiang Li , Wenhe Liu , Lijun Yu , Zhiqiang Shen , Matt Fredrikson

In this paper we proposed a novel Adversarial Training (AT) approach for end-to-end speech recognition using a Criticizing Language Model (CLM). In this way the CLM and the automatic speech recognition (ASR) model can challenge and learn…

Computation and Language · Computer Science 2018-11-05 Alexander H. Liu , Hung-yi Lee , Lin-shan Lee

With the widespread application of Large Language Models (LLMs), it has become a significant concern to ensure their safety and prevent harmful responses. While current safe-alignment methods based on instruction fine-tuning and…

Computation and Language · Computer Science 2025-12-16 Xiaoyun Zhang , Zhengyue Zhao , Wenxuan Shi , Kaidi Xu , Di Huang , Xing Hu