English
Related papers

Related papers: When Alignment Isn't Enough: Response-Path Attacks…

200 papers

Multi-agent large language model (LLM) architectures increasingly rely on response-level aggregation, such as Majority Voting (MAJ), to raise reasoning ceilings. However, in open environments, agents are highly susceptible to stealthy…

Computation and Language · Computer Science 2026-04-21 Jiayuan Liu , Shiyi Du , Weihua Du , Mingyu Guo , Vincent Conitzer

Safely aligning large language models (LLMs) often demands extensive human-labeled preference data, a process that's both costly and time-consuming. While synthetic data offers a promising alternative, current methods frequently rely on…

Cryptography and Security · Computer Science 2025-06-13 Kyubyung Chae , Hyunbin Jin , Taesup Kim

Targeted bit-flip attacks (BFAs) exploit hardware faults to manipulate model parameters, posing a significant security threat. While prior work targets single-step inference models (e.g., image classifiers), LLM-based agents with…

Cryptography and Security · Computer Science 2026-03-12 Jialai Wang , Ya Wen , Zhongmou Liu , Yuxiao Wu , Bingyi He , Zongpeng Li , Ee-Chien Chang

Large language model (LLM) agents increasingly rely on external tools (file operations, API calls, database transactions) to autonomously complete complex multi-step tasks. Practitioners deploy defense-trained models to protect against…

Cryptography and Security · Computer Science 2026-03-23 Shawn Li , Yue Zhao

Retrieval-augmented generation (RAG) extends large language models (LLMs) with external knowledge, but this access path also introduces security risks that existing work often conflates with inherent LLM flaws. We frame secure RAG as…

Cryptography and Security · Computer Science 2026-05-28 Yuming Xu , Mingtao Zhang , Zhuohan Ge , Haoyang Li , Nicole Hu , Yongqi Zhang , Zhiyuan Wen , Jason Chen Zhang , Qing Li , Lei Chen

LLM-based agent systems increasingly rely on agent skills sourced from open registries to extend their capabilities, yet the openness of such ecosystems makes skills difficult to thoroughly vet. Existing attacks rely on injecting malicious…

Cryptography and Security · Computer Science 2026-04-08 Zenghao Duan , Yuxin Tian , Zhiyi Yin , Liang Pang , Jingcheng Deng , Zihao Wei , Shicheng Xu , Yuyao Ge , Xueqi Cheng

Low-Rank Adaptation (LoRA) has become a popular solution for fine-tuning large language models (LLMs) in federated settings, dramatically reducing update costs by introducing trainable low-rank matrices. However, when integrated with…

Cryptography and Security · Computer Science 2026-01-05 Yueyan Dong , Minghui Xu , Qin Hu , Yinhao Xiao , Qi Luo , Yechao Zhang , Yue Zhang , Xiuzhen Cheng

We stress-tested 16 leading models from multiple developers in hypothetical corporate environments to identify potentially risky agentic behaviors before they cause real harm. In the scenarios, we allowed models to autonomously send emails…

Cryptography and Security · Computer Science 2025-10-17 Aengus Lynch , Benjamin Wright , Caleb Larson , Stuart J. Ritchie , Soren Mindermann , Evan Hubinger , Ethan Perez , Kevin Troy

Large Language Models (LLMs) have enabled agents to move beyond conversation toward end-to-end task execution and become more helpful. However, this helpfulness introduces new security risks stem less from direct interface abuse than from…

Cryptography and Security · Computer Science 2026-01-19 Fengchao Chen , Tingmin Wu , Van Nguyen , Carsten Rudolph

Reasoning-capable LLMs have achieved major breakthroughs in solving complex problems, but recent work shows that acquiring and deploying strong reasoning can introduce significant safety risks. A common mitigation is to apply a secondary…

Artificial Intelligence · Computer Science 2026-02-03 Yihao Xue , Baharan Mirzasoleiman

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning using Chain-of-Thought (CoT) prompting. However, CoT can be biased by users' instruction. In this work, we study the reasoning robustness of LLMs to…

Computation and Language · Computer Science 2024-11-11 Esther Gan , Yiran Zhao , Liying Cheng , Yancan Mao , Anirudh Goyal , Kenji Kawaguchi , Min-Yen Kan , Michael Shieh

Beyond simple text generation, Large Language Models (LLMs) have evolved into agentic systems capable of planning and interacting with external tools to solve complex tasks. This evolution involves fine-tuning LLMs on agent-specific tasks…

Computation and Language · Computer Science 2025-11-18 Dongyoon Hahm , Taywon Min , Woogyeol Jin , Kimin Lee

LLMs are increasingly deployed as autonomous agents with access to tools, databases, and external services, yet practitioners (across different sectors) lack systematic methods to assess how known threat classes translate into concrete…

Artificial Intelligence · Computer Science 2026-05-12 Tim Van hamme , Thomas Vissers , Javier Carnerero-Cano , Mario Fritz , Emil C. Lupu , Lieven Desmet , Dinil Mon Divakaran

Low rank adaptation (LoRA) has emerged as a prominent technique for fine-tuning large language models (LLMs) thanks to its superb efficiency gains over previous methods. While extensive studies have examined the performance and structural…

Machine Learning · Computer Science 2025-05-20 Zi Liang , Haibo Hu , Qingqing Ye , Yaxin Xiao , Ronghua Li

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding, code generation, and complex planning. Simultaneously, Multi-Agent Systems (MAS) have garnered attention for their potential to enable…

Computation and Language · Computer Science 2025-06-06 Can Zheng , Yuhan Cao , Xiaoning Dong , Tianxing He

Large language model (LLM) agents increasingly rely on third-party API routers to dispatch tool-calling requests across multiple upstream providers. These routers operate as application-layer proxies with full plaintext access to every…

Cryptography and Security · Computer Science 2026-04-10 Hanzhi Liu , Chaofan Shou , Hongbo Wen , Yanju Chen , Ryan Jingyang Fang , Yu Feng

Multi-agent LLM systems have shown promise for complex reasoning, yet recent evaluations reveal they often underperform single-model baselines. We identify a structural failure mode in sequential fine-tuning of shared-context teams:…

Machine Learning · Computer Science 2026-05-18 Yi Xie , Siao Liu , Falong Fan , Yuanqi Yao , Yue Zhao , Bo Liu

Large Language Model (LLM)-powered agents demonstrate strong capabilities in autonomous task execution, tool use, and multi-step reasoning. However, their increasing autonomy also introduces a new attack surface: adversarial interactions…

Artificial Intelligence · Computer Science 2026-05-05 Sheldon Yu , Yingcheng Sun , Hanqing Guo , Julian McAuley , Qianqian Tong

LLM-based multi-agent systems have demonstrated impressive capabilities, but they also introduce significant safety risks when individual agents fail or behave adversarially. In this work, we study the automated design of agentic systems…

Machine Learning · Computer Science 2026-05-25 Jonathan Nöther , Adish Singla , Goran Radanovic

Large Language Models (LLMs) are increasingly deployed as autonomous agents that execute tool-augmented, multi-step tasks, where latency is a critical factor for real-world applications. Yet an overlooked threat is Reasoning-Level…

Machine Learning · Computer Science 2026-05-12 Xinyu Li , Ronghui Mu , Lin Li , Tianjin Huang , Gaojie Jin