English
Related papers

Related papers: VIGIL: Defending LLM Agents Against Tool Stream In…

200 papers

Multimodal large language models (MLLMs) offer a promising path toward interpretable deepfake detection by generating textual explanations. However, the reasoning process of current MLLM-based methods combines evidence generation and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xinghan Li , Junhao Xu , Jingjing Chen

As LLMs gain stronger reasoning capabilities, their extended chain-of-thought introduces new degrees of complexity for defending against adversarial jailbreaks and prompt injection. We study consistency training, a family of fine-tuning…

Machine Learning · Computer Science 2026-05-28 Avidan Shah , Jannik Brinkmann , Rico Angell

Text-to-image (T2I) models can generate not-safe-for-work (NSFW) content, motivating multi-stage safety pipelines with both text and image filters. Newer LLM-based filters detect latent intent beyond keywords, making token-level…

Machine Learning · Computer Science 2026-05-26 Zixuan Chen , Hao Lin , Ke Xu , Xinghao Jiang , Tanfeng Sun

The critical challenge of prompt injection attacks in Large Language Models (LLMs) integrated applications, a growing concern in the Artificial Intelligence (AI) field. Such attacks, which manipulate LLMs through natural language inputs,…

Cryptography and Security · Computer Science 2024-01-17 Xuchen Suo

Deep Neural Networks remain inherently vulnerable to backdoor attacks. Traditional test-time defenses largely operate under the paradigm of internal diagnosis methods like model repairing or input robustness, yet these approaches are often…

Machine Learning · Computer Science 2026-01-28 Binyan Xu , Fan Yang , Xilin Dai , Di Tang , Kehuan Zhang

In large-scale cloud service platforms, thousands of customer tickets are generated daily and are typically handled through on-call dialogues. This high volume of on-call interactions imposes a substantial workload on human support…

Artificial Intelligence · Computer Science 2026-04-14 Fengrui Liu , Xiao He , Tieying Zhang

The proliferation of powerful large language models (LLMs) has necessitated robust safety alignment, yet these models remain vulnerable to evolving adversarial attacks, including multi-turn jailbreaks that iteratively search for successful…

Cryptography and Security · Computer Science 2026-02-04 Weiliang Zhao , Jinjun Peng , Daniel Ben-Levi , Zhou Yu , Junfeng Yang

Recent research has explored that LLM agents are vulnerable to indirect prompt injection (IPI) attacks, where malicious tasks embedded in tool-retrieved information can redirect the agent to take unauthorized actions. Existing defenses…

Cryptography and Security · Computer Science 2025-06-12 Kaijie Zhu , Xianjun Yang , Jindong Wang , Wenbo Guo , William Yang Wang

Jailbreak attacks, where harmful prompts bypass generative models' built-in safety, raise serious concerns about model vulnerability. While many defense methods have been proposed, the trade-offs between safety and helpfulness, and their…

Cryptography and Security · Computer Science 2025-02-21 Zhuohang Long , Siyuan Wang , Shujun Liu , Yuhang Lai , Xuanjing Huang , Zhongyu Wei

The alignment between humans and machines is a critical challenge in artificial intelligence today. Reinforcement learning, which aims to maximize a reward function, is particularly vulnerable to the risks associated with poorly designed…

Artificial Intelligence · Computer Science 2025-10-29 Valentin Cuzin-Rambaud , Emilien Komlenovic , Alexandre Faure , Bruno Yun

Large Language Models (LLMs) have shown significant promise in real-world decision-making tasks for embodied artificial intelligence, especially when fine-tuned to leverage their inherent common sense and reasoning abilities while being…

Cryptography and Security · Computer Science 2025-05-01 Ruochen Jiao , Shaoyuan Xie , Justin Yue , Takami Sato , Lixu Wang , Yixuan Wang , Qi Alfred Chen , Qi Zhu

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

Cryptography and Security · Computer Science 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

Large language models have become increasingly prominent, also signaling a shift towards multimodality as the next frontier in artificial intelligence, where their embeddings are harnessed as prompts to generate textual content.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiachen Sun , Changsheng Wang , Jiongxiao Wang , Yiwei Zhang , Chaowei Xiao

Large-scale Vision-Language-Action (VLA) models offer semantic generalization but suffer from high inference latency, limiting them to low-frequency batch-and-execute paradigm. This frequency mismatch creates an execution blind spot,…

Robotics · Computer Science 2026-01-22 Yuteng Sun , Haoran Wang , Ruofei Bai , Zhengguo Li , Jun Li , Meng Yee , Chuah , Wei Yun Yau

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

Cryptography and Security · Computer Science 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi

Prompt injection poses a serious threat to the reliability and safety of LLM agents. Recent defenses against prompt injection, such as Instruction Hierarchy and SecAlign, have shown notable robustness against static attacks. However, to…

Cryptography and Security · Computer Science 2025-10-07 Yuxin Wen , Arman Zharmagambetov , Ivan Evtimov , Narine Kokhlikyan , Tom Goldstein , Kamalika Chaudhuri , Chuan Guo

System Instructions in Large Language Models (LLMs) are commonly used to enforce safety policies, define agent behavior, and protect sensitive operational context in agentic AI applications. These instructions may contain sensitive…

Cryptography and Security · Computer Science 2026-04-02 Anubhab Sahu , Diptisha Samanta , Reza Soosahabi

This paper presents a novel approach to evaluating the security of large language models (LLMs) against prompt leakage-the exposure of system-level prompts or proprietary configurations. We define prompt leakage as a critical threat to…

Cryptography and Security · Computer Science 2025-02-19 Tvrtko Sternak , Davor Runje , Dorian Granoša , Chi Wang

Traditional consensus mechanisms, such as Proof of Stake (PoS), increasingly reveal an excessive dependency on large liquidity providers. Although the Proof of Liquidity (PoL) mechanism serves as a critical paradigm for incentivizing…

Cryptography and Security · Computer Science 2026-04-07 Zekai Liu , Xiaoqi Li , Wenkai Li , Zongwei Li