English
Related papers

Related papers: Clawdrain: Exploiting Tool-Calling Chains for Stea…

200 papers

As LLMs advance into autonomous agents with tool-use capabilities, they introduce security challenges that extend beyond traditional content-based LLM safety concerns. This paper introduces Sequential Tool Attack Chaining (STAC), a novel…

Cryptography and Security · Computer Science 2026-02-03 Jing-Jing Li , Jianfeng He , Chao Shang , Devang Kulshreshtha , Xun Xian , Yi Zhang , Hang Su , Sandesh Swamy , Yanjun Qi

As LLM agents are increasingly built around reusable skills, a central challenge is no longer only whether agents can use provided skills, but whether they can generate correct, reusable, and executable skills from repositories and…

Artificial Intelligence · Computer Science 2026-05-19 Yifan Zhou , Zhentao Zhang , Ziming Cheng , Shuo Zhang , Qizhen Lan , Zhangquan Chen , Zhi Yang , QianyuXu , Ronghao Chen , Huacan Wang , Sen Hu

LLM-based agents are becoming increasingly capable, yet their safety lags behind. This creates a gap between what agents can do and should do. This gap widens as agents engage in multi-turn interactions and employ diverse tools, introducing…

Cryptography and Security · Computer Science 2026-02-17 Xu Li , Simon Yu , Minzhou Pan , Yiyou Sun , Bo Li , Dawn Song , Xue Lin , Weiyan Shi

Large language model agents are increasingly expected to perform operational work: calling APIs, manipulating files, assembling workflows, and acting inside enterprise systems. Yet the tool layer on which this execution depends is still…

Software Engineering · Computer Science 2026-05-28 Swanand Rao

Open software supply chain attacks, once successful, can exact heavy costs in mission-critical applications. As open-source ecosystems for deep learning flourish and become increasingly universal, they present attackers previously…

Cryptography and Security · Computer Science 2022-12-21 Tianrui Qin , Xianghuan He , Xitong Gao , Yiren Zhao , Kejiang Ye , Cheng-Zhong Xu

The integration of Large Language Models (LLMs) into life sciences has catalyzed the development of "AI Scientists." However, translating these theoretical capabilities into deployment-ready research environments exposes profound…

Artificial Intelligence · Computer Science 2026-04-02 Yao Qin , Yangyang Yan , Jinhua Pang , Xiaoming Zhang

Automating scientific discovery requires more than generating papers from ideas. Real research is iterative: hypotheses are challenged from multiple perspectives, experiments fail and inform the next attempt, and lessons accumulate across…

Large Transformer networks are increasingly used in settings where low inference latency can improve the end-user experience and enable new applications. However, autoregressive inference is resource intensive and requires parallelism for…

Machine Learning · Computer Science 2024-08-20 Rohan Baskar Prabhakar , Hengrui Zhang , David Wentzlaff

Tool-using automation systems, from scripts and CI bots to agentic assistants, fail in recurring patterns. Common failures include unsafe side effects, invalid arguments, uncontrolled retries, and leakage of sensitive outputs. Many…

Cryptography and Security · Computer Science 2026-03-20 Akshey Sigdel , Rista Baral

As AI agents become widely deployed as online services, users often rely on an agent developer's claim about how safety is enforced, which introduces a threat where safety measures are falsely advertised. To address the threat, we propose…

Cryptography and Security · Computer Science 2026-03-09 Xisen Jin , Michael Duan , Qin Lin , Aaron Chan , Zhenglun Chen , Junyi Du , Xiang Ren

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

Cryptography and Security · Computer Science 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

Deploying AI agents for repetitive periodic tasks exposes a critical tension: Large Language Models (LLMs) offer unmatched flexibility in tool orchestration, yet their inherent stochasticity causes unpredictable failures, and repeated…

Artificial Intelligence · Computer Science 2026-05-15 Xiaohua Wang , Kai Yu , XuXiao Liang , Liang Wang , Chao Han

While real-world applications of reinforcement learning are becoming popular, the security and robustness of RL systems are worthy of more attention and exploration. In particular, recent works have revealed that, in a multi-agent RL…

Machine Learning · Computer Science 2023-09-15 Junfeng Guo , Ang Li , Cong Liu

Embodied AI research is increasingly moving beyond single-task, single-environment policy learning toward multi-task, multi-scene, and multi-model settings. This shift substantially increases the engineering overhead and development time…

Robotics · Computer Science 2026-04-16 Xueyang Zhou , Yihan Sun , Xijie Gong , Guiyao Tie , Pan Zhou , Lichao Sun , Yongchao Chen

AI agents dynamically acquire tools, orchestrate sub-agents, and transact across organizational boundaries, yet no existing security layer verifies what an agent can do, whether it executed what it claims, or what happened in a multi-agent…

Cryptography and Security · Computer Science 2026-03-23 Ziling Zhou

Modern large reasoning models (LRMs) exhibit impressive multi-step problem-solving via chain-of-thought (CoT) reasoning. However, this iterative thinking mechanism introduces a new vulnerability surface. We present the Deadlock Attack, a…

Machine Learning · Computer Science 2025-10-21 Mohan Zhang , Yihua Zhang , Jinghan Jia , Zhangyang Wang , Sijia Liu , Tianlong Chen

The emergence of large language models (LLMs) enables the development of intelligent agents capable of engaging in complex and multi-turn dialogues. However, multi-agent collaboration faces critical safety challenges, such as hallucination…

Artificial Intelligence · Computer Science 2025-10-16 Jialong Zhou , Lichao Wang , Xiao Yang

Tool-using LLM agents increasingly coordinate real workloads by selecting and chaining third-party tools based on text-visible metadata such as tool names, descriptions, and return messages. We show that this convenience creates a…

Computation and Language · Computer Science 2026-02-17 Yohan Lee , Jisoo Jang , Seoyeon Choi , Sangyeop Kim , Seungtaek Choi

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

LLM-based coding agents rely on \emph{skills}, pre-packaged instruction sets that extend agent capabilities, yet every token of skill content injected into the context window incurs both monetary cost and attention dilution. To understand…

Software Engineering · Computer Science 2026-04-01 Yudong Gao , Zongjie Li , Yuanyuanyuan , Zimo Ji , Pingchuan Ma , Shuai Wang