中文
相关论文

相关论文: Adversarial Text Purification: A Large Language Mo…

200 篇论文

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

计算与语言 · 计算机科学 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

Attackers can deliberately perturb classifiers' input with subtle noise, altering final predictions. Among proposed countermeasures, adversarial purification employs generative networks to preprocess input images, filtering out adversarial…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Dario Serez , Marco Cristani , Alessio Del Bue , Vittorio Murino , Pietro Morerio

Adversarial attacks can mislead neural network classifiers. The defense against adversarial attacks is important for AI safety. Adversarial purification is a family of approaches that defend adversarial attacks with suitable pre-processing.…

机器学习 · 计算机科学 2023-10-31 Boya Zhang , Weijian Luo , Zhihua Zhang

This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in…

人工智能 · 计算机科学 2024-10-25 Sudarshan Srinivasan , Maria Mahbub , Amir Sadovnik

Deep learning-based natural language processing (NLP) models, particularly pre-trained language models (PLMs), have been revealed to be vulnerable to adversarial attacks. However, the adversarial examples generated by many mainstream…

计算与语言 · 计算机科学 2023-11-21 Zimu Wang , Wei Wang , Qi Chen , Qiufeng Wang , Anh Nguyen

The recent growth in the use of Large Language Models has made them vulnerable to sophisticated adversarial assaults, manipulative prompts, and encoded malicious inputs. Existing countermeasures frequently necessitate retraining models,…

计算与语言 · 计算机科学 2026-03-10 Sheikh Samit Muhaimin , Spyridon Mastorakis

As Large Language Models quickly become ubiquitous, it becomes critical to understand their security vulnerabilities. Recent work shows that text optimizers can produce jailbreaking prompts that bypass moderation and alignment. Drawing from…

The widespread adoption of Large Language Models (LLMs), exemplified by OpenAI's ChatGPT, brings to the forefront the imperative to defend against adversarial threats on these models. These attacks, which manipulate an LLM's output by…

密码学与安全 · 计算机科学 2025-04-04 Amelia Kawasaki , Andrew Davis , Houssam Abbas

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

人工智能 · 计算机科学 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

人工智能 · 计算机科学 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Pre-trained contextualized language models (PrLMs) have led to strong performance gains in downstream natural language understanding tasks. However, PrLMs can still be easily fooled by adversarial word substitution, which is one of the most…

计算与语言 · 计算机科学 2021-06-01 Rongzhou Bao , Jiayi Wang , Hai Zhao

While Large Language Models (LLMs) have achieved tremendous success in various applications, they are also susceptible to jailbreaking attacks. Several primary defense strategies have been proposed to protect LLMs from producing harmful…

机器学习 · 计算机科学 2024-11-01 Yichuan Mo , Yuji Wang , Zeming Wei , Yisen Wang

Lexical Simplification (LS) aims to simplify text at the lexical level. Existing methods rely heavily on annotated data, making it challenging to apply in low-resource scenarios. In this paper, we propose a novel LS method without parallel…

计算与语言 · 计算机科学 2024-03-25 Keren Tan , Kangyang Luo , Yunshi Lan , Zheng Yuan , Jinlong Shu

Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing…

计算与语言 · 计算机科学 2024-06-18 Roy Xie , Chengxuan Huang , Junlin Wang , Bhuwan Dhingra

Large Language Models (LLMs) represent a transformative leap in artificial intelligence, enabling the comprehension, generation, and nuanced interaction with human language on an unparalleled scale. However, LLMs are increasingly vulnerable…

密码学与安全 · 计算机科学 2025-02-06 Nan Wang , Kane Walter , Yansong Gao , Alsharif Abuadbba

As the deployment of NLP systems in critical applications grows, ensuring the robustness of large language models (LLMs) against adversarial attacks becomes increasingly important. Large language models excel in various NLP tasks but remain…

计算与语言 · 计算机科学 2024-05-03 Zhenning Yang , Ryan Krawec , Liang-Yuan Wu

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

人工智能 · 计算机科学 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

Adversarial attacks meticulously generate minuscule, imperceptible perturbations to images to deceive neural networks. Counteracting these, adversarial purification methods seek to transform adversarial input samples into clean output…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Sitong Liu , Zhichao Lian , Shuangquan Zhang , Liang Xiao

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

计算与语言 · 计算机科学 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

The widespread adoption of code language models in software engineering tasks has exposed vulnerabilities to adversarial attacks, especially the identifier substitution attacks. Although existing identifier substitution attackers…

软件工程 · 计算机科学 2025-04-29 Wenhan Mu , Ling Xu , Shuren Pei , Le Mi , Huichi Zhou