中文
相关论文

相关论文: Contextualized Perturbation for Textual Adversaria…

200 篇论文

Retrieval-augmented generation (RAG) enhances the capabilities of large language models (LLMs) by incorporating external knowledge into their input prompts. However, when the retrieved context contradicts the LLM's parametric knowledge, it…

计算与语言 · 计算机科学 2025-09-29 Eunseong Choi , June Park , Hyeri Lee , Jongwuk Lee

Neural models enjoy widespread use across a variety of tasks and have grown to become crucial components of many industrial systems. Despite their effectiveness and extensive popularity, they are not without their exploitable flaws.…

声音 · 计算机科学 2019-02-26 Krishan Rajaratnam , Jugal Kalita

Large language models (LLMs) are becoming increasingly important for machine learning applications. However, it can be challenging to align LLMs with our intent, particularly when we want to generate content that is preferable over others…

计算与语言 · 计算机科学 2024-04-09 Xiang Gao , Kamalika Das

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

机器学习 · 计算机科学 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

This practical experience report explores Neural Machine Translation (NMT) models' capability to generate offensive security code from natural language (NL) descriptions, highlighting the significance of contextual understanding and its…

软件工程 · 计算机科学 2024-09-09 Pietro Liguori , Cristina Improta , Roberto Natella , Bojan Cukic , Domenico Cotroneo

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

计算与语言 · 计算机科学 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Lack of moderation in online communities enables participants to incur in personal aggression, harassment or cyberbullying, issues that have been accentuated by extremist radicalisation in the contemporary post-truth politics scenario. This…

计算与语言 · 计算机科学 2018-01-08 Nestor Rodriguez , Sergio Rojas-Galeano

Sparse attacks are to optimize the magnitude of adversarial perturbations for fooling deep neural networks (DNNs) involving only a few perturbed pixels (i.e., under the l0 constraint), suitable for interpreting the vulnerability of DNNs.…

机器学习 · 计算机科学 2025-06-24 Fudong Lin , Jiadong Lou , Hao Wang , Brian Jalaian , Xu Yuan

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

密码学与安全 · 计算机科学 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu

Large language models are now tuned to align with the goals of their creators, namely to be "helpful and harmless." These models should respond helpfully to user questions, but refuse to answer requests that could cause harm. However,…

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

人工智能 · 计算机科学 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

Adversarial examples have proven to threaten speaker identification systems, and several countermeasures against them have been proposed. In this paper, we propose a method to detect the presence of adversarial examples, i.e., a binary…

声音 · 计算机科学 2024-03-01 Sonal Joshi , Thomas Thebaud , Jesús Villalba , Najim Dehak

As the deployment of NLP systems in critical applications grows, ensuring the robustness of large language models (LLMs) against adversarial attacks becomes increasingly important. Large language models excel in various NLP tasks but remain…

计算与语言 · 计算机科学 2024-05-03 Zhenning Yang , Ryan Krawec , Liang-Yuan Wu

Adversarial purification using generative models demonstrates strong adversarial defense performance. These methods are classifier and attack-agnostic, making them versatile but often computationally intensive. Recent strides in diffusion…

机器学习 · 计算机科学 2026-04-10 Himanshu Singh , A V Subramanyam

Adversarial attacks on explainability models have drastic consequences when explanations are used to understand the reasoning of neural networks in safety critical systems. Path methods are one such class of attribution methods susceptible…

机器学习 · 计算机科学 2025-02-28 Lachlan Simpson , Federico Costanza , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

机器学习 · 计算机科学 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Deep neural networks (DNNs) have been found to be vulnerable to adversarial examples. Adversarial examples are malicious images with visually imperceptible perturbations. While these carefully crafted perturbations restricted with tight…

计算机视觉与模式识别 · 计算机科学 2021-07-06 Yajie Wang , Shangbo Wu , Wenyi Jiang , Shengang Hao , Yu-an Tan , Quanxin Zhang

Deep neural networks (DNNs) have achieved great success in various applications due to their strong expressive power. However, recent studies have shown that DNNs are vulnerable to adversarial examples which are manipulated instances…

机器学习 · 计算机科学 2020-07-06 Haonan Qiu , Chaowei Xiao , Lei Yang , Xinchen Yan , Honglak Lee , Bo Li

Large Language Models have become the de facto approach to sequence-to-sequence text generation tasks, but for specialized tasks/domains, a pretrained LLM lacks specific capabilities to produce accurate or well-formatted responses.…

计算与语言 · 计算机科学 2024-03-20 Jiuhai Chen , Jonas Mueller

Paraphrasing of offensive content is a better alternative to content removal and helps improve civility in a communication environment. Supervised paraphrasers; however, rely heavily on large quantities of labelled data to help preserve…

计算与语言 · 计算机科学 2024-06-11 Anirudh Som , Karan Sikka , Helen Gent , Ajay Divakaran , Andreas Kathol , Dimitra Vergyri