中文
相关论文

相关论文: On Adversarial Robustness of Language Models in Tr…

200 篇论文

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

计算与语言 · 计算机科学 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

We study the transfer of adversarial robustness of deep neural networks between different perturbation types. While most work on adversarial examples has focused on $L_\infty$ and $L_2$-bounded perturbations, these do not capture all types…

机器学习 · 计算机科学 2019-05-06 Daniel Kang , Yi Sun , Tom Brown , Dan Hendrycks , Jacob Steinhardt

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

计算与语言 · 计算机科学 2019-12-10 Tiffany Chien , Jugal Kalita

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

计算与语言 · 计算机科学 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Neural machine translation (MT) models achieve strong results across a variety of settings, but it is widely believed that they are highly sensitive to "noisy" inputs, such as spelling errors, abbreviations, and other formatting issues. In…

计算与语言 · 计算机科学 2025-10-06 Ben Peters , André F. T. Martins

There has been emerging interest to use transductive learning for adversarial robustness (Goldwasser et al., NeurIPS 2020; Wu et al., ICML 2020). Compared to traditional "test-time" defenses, these defense mechanisms "dynamically retrain"…

机器学习 · 计算机科学 2021-06-17 Jiefeng Chen , Yang Guo , Xi Wu , Tianqi Li , Qicheng Lao , Yingyu Liang , Somesh Jha

Deep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can fool another model. In this paper, we…

机器学习 · 计算机科学 2021-09-23 Liping Yuan , Xiaoqing Zheng , Yi Zhou , Cho-Jui Hsieh , Kai-wei Chang

Pre-trained language models (PLMs) have consistently demonstrated outstanding performance across a diverse spectrum of natural language processing tasks. Nevertheless, despite their success with unseen data, current PLM-based…

计算与语言 · 计算机科学 2024-03-19 Javad Rafiei Asl , Prajwal Panzade , Eduardo Blanco , Daniel Takabi , Zhipeng Cai

The integration of Large Language Models (LLMs) into healthcare applications offers promising advancements in medical diagnostics, treatment recommendations, and patient care. However, the susceptibility of LLMs to adversarial attacks poses…

人工智能 · 计算机科学 2024-12-18 Yifan Yang , Qiao Jin , Furong Huang , Zhiyong Lu

Large language models (LLMs) are known to exhibit brittle behavior under adversarial prompts and jailbreak attacks, even after extensive alignment and fine-tuning. This fragility reflects a broader challenge of modern neural language…

计算与语言 · 计算机科学 2026-02-04 Patrick Cooper , Alireza Nadali , Ashutosh Trivedi , Alvaro Velasquez

Large Language Models (LLMs) have recently demonstrated significant potential in time series forecasting, offering impressive capabilities in handling complex temporal data. However, their robustness and reliability in real-world…

机器学习 · 计算机科学 2025-03-14 Fuqiang Liu , Sicong Jiang , Luis Miranda-Moreno , Seongjin Choi , Lijun Sun

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

机器学习 · 计算机科学 2023-06-14 Omar Montasser

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

机器学习 · 计算机科学 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

Large vision-language models (VLMs) such as GPT-4 have achieved unprecedented performance in response generation, especially with visual inputs, enabling more creative and adaptable interaction than large language models such as ChatGPT.…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Yunqing Zhao , Tianyu Pang , Chao Du , Xiao Yang , Chongxuan Li , Ngai-Man Cheung , Min Lin

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of…

计算与语言 · 计算机科学 2024-06-27 Alfonso Amayuelas , Xianjun Yang , Antonis Antoniades , Wenyue Hua , Liangming Pan , William Wang

Existing works have shown that fine-tuned textual transformer models achieve state-of-the-art prediction performances but are also vulnerable to adversarial text perturbations. Traditional adversarial evaluation is often done \textit{only…

机器学习 · 计算机科学 2024-07-03 Cuong Dang , Dung D. Le , Thai Le

Nowadays, we are more and more reliant on Deep Learning (DL) models and thus it is essential to safeguard the security of these systems. This paper explores the security issues in Deep Learning and analyses, through the use of experiments,…

机器学习 · 计算机科学 2022-04-26 Marco Marchetti , Edmond S. L. Ho

As the deployment of NLP systems in critical applications grows, ensuring the robustness of large language models (LLMs) against adversarial attacks becomes increasingly important. Large language models excel in various NLP tasks but remain…

计算与语言 · 计算机科学 2024-05-03 Zhenning Yang , Ryan Krawec , Liang-Yuan Wu

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

机器学习 · 统计学 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning using Chain-of-Thought (CoT) prompting. However, CoT can be biased by users' instruction. In this work, we study the reasoning robustness of LLMs to…

计算与语言 · 计算机科学 2024-11-11 Esther Gan , Yiran Zhao , Liying Cheng , Yancan Mao , Anirudh Goyal , Kenji Kawaguchi , Min-Yen Kan , Michael Shieh