中文
相关论文

相关论文: On Adversarial Robustness of Language Models in Tr…

200 篇论文

Large Language Models (LLMs) are powerful tools with profound societal impacts, yet their ability to generate responses to diverse and uncontrolled inputs leaves them vulnerable to adversarial attacks. While existing defenses often struggle…

计算与语言 · 计算机科学 2025-12-30 Samuel Simko , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

Evaluating on adversarial examples has become a standard procedure to measure robustness of deep learning models. Due to the difficulty of creating white-box adversarial examples for discrete text input, most analyses of the robustness of…

计算与语言 · 计算机科学 2018-06-26 Javid Ebrahimi , Daniel Lowd , Dejing Dou

There has been emerging interest in using transductive learning for adversarial robustness (Goldwasser et al., NeurIPS 2020; Wu et al., ICML 2020; Wang et al., ArXiv 2021). Compared to traditional defenses, these defense mechanisms…

机器学习 · 计算机科学 2022-02-18 Jiefeng Chen , Xi Wu , Yang Guo , Yingyu Liang , Somesh Jha

Machine translation and other NLP systems often contain significant biases regarding sensitive attributes, such as gender or race, that worsen system performance and perpetuate harmful stereotypes. Recent preliminary research suggests that…

计算与语言 · 计算机科学 2022-03-22 Eve Fleisig , Christiane Fellbaum

Large language models (LLMs) are typically aligned to refuse harmful instructions through safety fine-tuning. A recent attack, termed abliteration, identifies and suppresses the single latent direction most responsible for refusal behavior,…

计算与语言 · 计算机科学 2025-10-08 Harethah Abu Shairah , Hasan Abed Al Kader Hammoud , Bernard Ghanem , George Turkiyyah

Transformer-based models, such as BERT and GPT, have been widely adopted in natural language processing (NLP) due to their exceptional performance. However, recent studies show their vulnerability to textual adversarial attacks where the…

计算与语言 · 计算机科学 2023-12-01 Lujia Shen , Yuwen Pu , Shouling Ji , Changjiang Li , Xuhong Zhang , Chunpeng Ge , Ting Wang

Deep neural networks are highly vulnerable to adversarial examples, i.e.,small perturbations that can significantly degrade model performance. While adversarial training has become the primary defense strategy, most studies focus on…

机器学习 · 计算机科学 2026-05-14 Lilin Zhang , Yimo Guo , Yue Li , Jiancheng Shi , Xianggen Liu

Large Language Models (LLMs) have become central to numerous natural language processing tasks, but their vulnerabilities present significant security and ethical challenges. This systematic survey explores the evolving landscape of attack…

密码学与安全 · 计算机科学 2025-05-05 Zhiyu Liao , Kang Chen , Yuanguo Lin , Kangkang Li , Yunxuan Liu , Hefeng Chen , Xingwang Huang , Yuanhui Yu

Existing frameworks for assessing robustness of large language models (LLMs) overly depend on specific benchmarks, increasing costs and failing to evaluate performance of LLMs in professional domains due to dataset limitations. This paper…

计算与语言 · 计算机科学 2024-06-18 Aihua Pei , Zehua Yang , Shunan Zhu , Ruoxi Cheng , Ju Jia , Lina Wang

Despite the considerable success enjoyed by machine learning techniques in practice, numerous studies demonstrated that many approaches are vulnerable to attacks. An important class of such attacks involves adversaries changing features at…

机器学习 · 计算机科学 2018-06-07 Liang Tong , Sixie Yu , Scott Alfeld , Yevgeniy Vorobeychik

Vision-Language Models (VLMs) have witnessed a surge in both research and real-world applications. However, as they are becoming increasingly prevalent, ensuring their robustness against adversarial attacks is paramount. This work…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Rishika Bhagwatkar , Shravan Nayak , Reza Bayat , Alexis Roger , Daniel Z Kaplan , Pouya Bashivan , Irina Rish

Growing at a fast pace, modern autonomous systems will soon be deployed at scale, opening up the possibility for cooperative multi-agent systems. Sharing information and distributing workloads allow autonomous agents to better perform tasks…

机器学习 · 计算机科学 2021-10-13 James Tu , Tsunhsuan Wang , Jingkang Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

机器学习 · 计算机科学 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for…

机器人学 · 计算机科学 2023-01-27 Mathias Lechner , Alexander Amini , Daniela Rus , Thomas A. Henzinger

Despite the impressive adaptability of large language models (LLMs), challenges remain in ensuring their security, transparency, and interpretability. Given their susceptibility to adversarial attacks, LLMs need to be defended with an…

人工智能 · 计算机科学 2024-10-11 Tomas Bueno Momcilovic , Beat Buesser , Giulio Zizzo , Mark Purcell , Dian Balta

Artificial neural networks in general and deep learning networks in particular established themselves as popular and powerful machine learning algorithms. While the often tremendous sizes of these networks are beneficial when solving…

机器学习 · 计算机科学 2020-05-28 Moritz Seiler , Heike Trautmann , Pascal Kerschke

Rapid advancements of deep learning are accelerating adoption in a wide variety of applications, including safety-critical applications such as self-driving vehicles, drones, robots, and surveillance systems. These advancements include…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Firuz Juraev , Mohammed Abuhamad , Simon S. Woo , George K Thiruvathukal , Tamer Abuhmed

In Federated Learning (FL), models are as fragile as centrally trained models against adversarial examples. However, the adversarial robustness of federated learning remains largely unexplored. This paper casts light on the challenge of…

机器学习 · 计算机科学 2023-02-21 Jie Zhang , Bo Li , Chen Chen , Lingjuan Lyu , Shuang Wu , Shouhong Ding , Chao Wu

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

计算与语言 · 计算机科学 2025-11-07 Pankaj Kumar , Subhankar Mishra

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

计算与语言 · 计算机科学 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao