English
Related papers

Related papers: "Someone Hid It": Query-Agnostic Black-Box Attacks…

200 papers

In the current cybersecurity landscape, protecting military devices such as communication and battlefield management systems against sophisticated cyber attacks is crucial. Malware exploits vulnerabilities through stealth methods, often…

Cryptography and Security · Computer Science 2024-05-16 Pedro Miguel Sánchez Sánchez , Alberto Huertas Celdrán , Gérôme Bovet , Gregorio Martínez Pérez

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

Artificial Intelligence · Computer Science 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun

LLMs are now an integral part of information retrieval. As such, their role as question answering chatbots raises significant concerns due to their shown vulnerability to adversarial man-in-the-middle (MitM) attacks. Here, we propose the…

Cryptography and Security · Computer Science 2026-03-25 Alina Fastowski , Bardh Prenkaj , Yuxiao Li , Gjergji Kasneci

With the great advancements in large language models (LLMs), adversarial attacks against LLMs have recently attracted increasing attention. We found that pre-existing adversarial attack methodologies exhibit limited transferability and are…

Computation and Language · Computer Science 2024-09-10 Zelin Li , Kehai Chen , Lemao Liu , Xuefeng Bai , Mingming Yang , Yang Xiang , Min Zhang

Large language models (LLMs) are increasingly trained on massive, heterogeneous text corpora, raising serious concerns about the unauthorised use of proprietary or personal data during model training. In this work, we address the problem of…

Computation and Language · Computer Science 2026-01-08 Ruihan Zhang , Jun Sun

The fast advancements in Large Language Models (LLMs) are driving an increasing number of applications. Together with the growing number of users, we also see an increasing number of attackers who try to outsmart these systems. They want…

Cryptography and Security · Computer Science 2024-05-31 Patrick Levi , Christoph P. Neumann

Recent research on reinforcement learning (RL) has suggested that trained agents are vulnerable to maliciously crafted adversarial samples. In this work, we show how such samples can be generalised from White-box and Grey-box attacks to a…

Machine Learning · Computer Science 2019-11-25 Yiren Zhao , Ilia Shumailov , Han Cui , Xitong Gao , Robert Mullins , Ross Anderson

Recent advances in large language models (LLMs) significantly boost their usage in software engineering. However, training a well-performing LLM demands a substantial workforce for data collection and annotation. Moreover, training datasets…

Software Engineering · Computer Science 2023-11-01 Zongjie Li , Chaozheng Wang , Pingchuan Ma , Chaowei Liu , Shuai Wang , Daoyuan Wu , Cuiyun Gao , Yang Liu

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for defending against jailbreak attacks are primarily based on auxiliary models. These strategies, however, often require extensive data collection or…

Cryptography and Security · Computer Science 2025-11-21 Zhuoran Yang , Yanyong Zhang

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without accessing the model's…

Computation and Language · Computer Science 2025-01-31 Sunbowen Lee , Shiwen Ni , Chi Wei , Shuaimin Li , Liyang Fan , Ahmadreza Argha , Hamid Alinejad-Rokny , Ruifeng Xu , Yicheng Gong , Min Yang

Black-box adversarial attacks on Large Vision-Language Models (LVLMs) are challenging due to missing gradients and complex multimodal boundaries. While prior state-of-the-art transfer-based approaches like M-Attack perform well using local…

Machine Learning · Computer Science 2026-02-20 Xiaohan Zhao , Zhaoyi Li , Yaxin Luo , Jiacheng Cui , Zhiqiang Shen

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge, making them adaptable and cost-effective for various applications. However, the growing reliance on these systems also…

Cryptography and Security · Computer Science 2024-10-31 Yucheng Zhang , Qinfeng Li , Tianyu Du , Xuhong Zhang , Xinkui Zhao , Zhengwen Feng , Jianwei Yin

While safety-aligned large language models (LLMs) are increasingly used as the cornerstone for powerful systems such as multi-agent frameworks to solve complex real-world problems, they still suffer from potential adversarial queries, such…

Cryptography and Security · Computer Science 2025-01-03 Miao Yu , Junfeng Fang , Yingjie Zhou , Xing Fan , Kun Wang , Shirui Pan , Qingsong Wen

Retrieval-Augmented Generation (RAG) increases the reliability and trustworthiness of the LLM response and reduces hallucination by eliminating the need for model retraining. It does so by adding external data into the LLM's context. We…

Cryptography and Security · Computer Science 2026-05-25 Aritra Dhar , Vasilije Stambolic , Lukas Cavigelli

Large language models (LLMs) have shown remarkable performance across a range of NLP tasks. However, their strong instruction-following capabilities and inability to distinguish instructions from data content make them vulnerable to…

Cryptography and Security · Computer Science 2025-10-07 Yulin Chen , Haoran Li , Yuexin Li , Yue Liu , Yangqiu Song , Bryan Hooi

Textual adversarial attacks pose a serious security threat to Natural Language Processing (NLP) systems by introducing imperceptible perturbations that mislead deep learning models. While adversarial example detection offers a lightweight…

Computation and Language · Computer Science 2026-03-16 He Zhu , Yanshu Li , Wen Liu , Haitian Yang

This paper investigates a class of attacks targeting the confidentiality aspect of security in Deep Reinforcement Learning (DRL) policies. Recent research have established the vulnerability of supervised machine learning models (e.g.,…

Machine Learning · Computer Science 2019-06-05 Vahid Behzadan , William Hsu

Large Language Models (LLMs) have become integral to many domains, making their safety a critical priority. Prior jailbreaking research has explored diverse approaches, including prompt optimization, automated red teaming, obfuscation, and…

Computation and Language · Computer Science 2026-02-09 Sung-Hoon Yoon , Ruizhi Qian , Minda Zhao , Weiyue Li , Mengyu Wang

Large Reasoning Models (LRMs) are increasingly integrated into systems requiring reliable multi-step inference, yet this growing dependence exposes new vulnerabilities related to computational availability. In particular, LRMs exhibit a…

Cryptography and Security · Computer Science 2026-05-15 Shuqiang Wang , Wei Cao , Jiaqi Weng , Jialing Tao , Licheng Pan , Hui Xue , Zhixuan Chu

Video-based multimodal large language models (V-MLLMs) have shown vulnerability to adversarial examples in video-text multimodal tasks. However, the transferability of adversarial videos to unseen models - a common and practical real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Linhao Huang , Xue Jiang , Zhiqiang Wang , Wentao Mo , Xi Xiao , Yong-Jie Yin , Bo Han , Feng Zheng