English
Related papers

Related papers: Adversarial Paraphrasing: A Universal Attack for H…

200 papers

Modern language models often rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors. However, they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of…

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

Computation and Language · Computer Science 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He

The robustness of AI-content detection models against sophisticated adversarial strategies, such as paraphrasing or word switching, is a rising concern in natural language generation (NLG) applications. This study proposes ToBlend, a novel…

Computation and Language · Computer Science 2024-10-17 Fan Huang , Haewoon Kwak , Jisun An

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

Computation and Language · Computer Science 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

Large Language Model (LLM) - based Automated Program Repair (APR) systems are increasingly integrated into modern software development workflows, offering automated patches in response to natural language bug reports. However, this reliance…

Software Engineering · Computer Science 2026-05-26 Piotr Przymus , Andreas Happe , Jürgen Cito

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

Language models are prone to memorizing their training data, making them vulnerable to extraction attacks. While existing research often examines isolated setups, such as a single model or a fixed prompt, real-world adversaries have a…

Cryptography and Security · Computer Science 2025-08-11 Yash More , Prakhar Ganesh , Golnoosh Farnadi

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

Machine Learning · Statistics 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

Recent progress in large language models (LLMs) for code generation has raised serious concerns about intellectual property protection. Malicious users can exploit LLMs to produce paraphrased versions of proprietary code that closely…

Artificial Intelligence · Computer Science 2026-01-12 Shinwoo Park , Hyundong Jin , Jeong-won Cha , Yo-Sub Han

The rise of text-to-image (T2I) models has enabled the synthesis of photorealistic human portraits, raising serious concerns about identity misuse and the robustness of AIGC detectors. In this work, we propose an automated adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Run Hao , Peng Ying

Detecting content generated by large language models (LLMs) is crucial for preventing misuse and building trustworthy AI systems. Although existing detection methods perform well, their robustness in out-of-distribution (OOD) scenarios is…

Computation and Language · Computer Science 2025-08-19 Xin Chen , Junchao Wu , Shu Yang , Runzhe Zhan , Zeyu Wu , Ziyang Luo , Di Wang , Min Yang , Lidia S. Chao , Derek F. Wong

Large pre-trained Vision-Language Models (VLMs) like CLIP, despite having remarkable generalization ability, are highly vulnerable to adversarial examples. This work studies the adversarial robustness of VLMs from the novel perspective of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Lin Li , Haoyan Guan , Jianing Qiu , Michael Spratling

Large language models (LLMs) have grown more powerful in language generation, producing fluent text and even imitating personal style. Yet, this ability also heightens the risk of identity impersonation. To the best of our knowledge, no…

Computation and Language · Computer Science 2026-05-01 Lang Gao , Xuhui Li , Chenxi Wang , Mingzhe Li , Wei Liu , Zirui Song , Jinghui Zhang , Rui Yan , Preslav Nakov , Xiuying Chen

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

Cryptography and Security · Computer Science 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

Automatic hate speech detection using deep neural models is hampered by the scarcity of labeled datasets, leading to poor generalization. To mitigate this problem, generative AI has been utilized to generate large amounts of synthetic hate…

Computation and Language · Computer Science 2023-11-17 Sagi Pendzel , Tomer Wullach , Amir Adler , Einat Minkov

Advanced Persistent Threats (APTs) are prolonged, stealthy intrusions by skilled adversaries that compromise high-value systems to steal data or disrupt operations. Reconstructing complete attack chains from massive, heterogeneous logs is…

Cryptography and Security · Computer Science 2025-09-03 Rujie Dai , Peizhuo Lv , Yujiang Gui , Qiujian Lv , Yuanyuan Qiao , Yan Wang , Degang Sun , Weiqing Huang , Yingjiu Li , XiaoFeng Wang

Large Language Models (LLMs) have revolutionized text generation, making detecting machine-generated text increasingly challenging. Although past methods have achieved good performance on detecting pure machine-generated text, those…

Computation and Language · Computer Science 2024-12-24 Jiaqi Chen , Xiaoye Zhu , Tianyang Liu , Ying Chen , Xinhui Chen , Yiwen Yuan , Chak Tou Leong , Zuchao Li , Tang Long , Lei Zhang , Chenyu Yan , Guanghao Mei , Jie Zhang , Lefei Zhang

Adversarial samples are strategically modified samples, which are crafted with the purpose of fooling a classifier at hand. An attacker introduces specially crafted adversarial samples to a deployed classifier, which are being…

Machine Learning · Computer Science 2017-07-11 Suranjana Samanta , Sameep Mehta

Peer review is essential for maintaining academic quality, but the increasing volume of submissions places a significant burden on reviewers. Large language models (LLMs) offer potential assistance in this process, yet their susceptibility…

Computation and Language · Computer Science 2025-10-10 Tzu-Ling Lin , Wei-Chih Chen , Teng-Fang Hsiao , Hou-I Liu , Ya-Hsin Yeh , Yu Kai Chan , Wen-Sheng Lien , Po-Yen Kuo , Philip S. Yu , Hong-Han Shuai