English
Related papers

Related papers: Malicious Agent Skills in the Wild: A Large-Scale …

200 papers

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

We report an exploratory red-teaming study of autonomous language-model-powered agents deployed in a live laboratory environment with persistent memory, email accounts, Discord access, file systems, and shell execution. Over a two-week…

Autonomous coding agents are increasingly integrated into software development workflows, offering capabilities that extend beyond code suggestion to active system interaction and environment management. OpenClaw, a representative platform…

Cryptography and Security · Computer Science 2026-03-23 Fazhong Liu , Zhuoyan Chen , Tu Lan , Haozhen Tan , Zhenyu Xu , Xiang Li , Guoxing Chen , Yan Meng , Haojin Zhu

A high volume of recent ML security literature focuses on attacks against aligned large language models (LLMs). These attacks may extract private information or coerce the model into producing harmful outputs. In real-world deployments,…

Machine Learning · Computer Science 2025-02-13 Ang Li , Yin Zhou , Vethavikashini Chithrra Raghuram , Tom Goldstein , Micah Goldblum

As AI agents become integral to enterprise workflows, their reliance on shared tool libraries and pre-trained components creates significant supply chain vulnerabilities. While previous work has demonstrated behavioral backdoor detection…

Cryptography and Security · Computer Science 2025-11-26 Arun Chowdary Sanna

Agentic AI systems, specifically LLM-driven agents that plan, invoke tools, maintain persistent memory, and delegate tasks to peer agents via protocols such as MCP and A2A, introduce a threat surface that differs materially from standalone…

Cryptography and Security · Computer Science 2026-05-08 Javad Forough , Marios Kogias , Hamed Haddadi

The rapid advancement of Large Language Model (LLM)-driven multi-agent systems has significantly streamlined software developing tasks, enabling users with little technical expertise to develop executable applications. While these systems…

Cryptography and Security · Computer Science 2025-11-25 Xiaoqing Wang , Keman Huang , Bin Liang , Hongyu Li , Xiaoyong Du

Large Language Models (LLMs) have transformed software development, enabling AI-powered applications known as LLM-based agents that promise to automate tasks across diverse apps and workflows. Yet, the security implications of deploying…

Cryptography and Security · Computer Science 2025-11-07 Chenghao Du , Quanfeng Huang , Tingxuan Tang , Zihao Wang , Adwait Nadkarni , Yue Xiao

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

Computation and Language · Computer Science 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

Enabling continual learning in LLMs remains a key unresolved research challenge. In a recent announcement, a frontier LLM company made a step towards this by introducing Agent Skills, a framework that equips agents with new knowledge based…

Machine Learning · Computer Science 2025-10-31 David Schmotz , Sahar Abdelnabi , Maksym Andriushchenko

Users often interpret and select agent skills through their SKILL markdown specifications. To protect users, existing audits mainly focus on malicious or unsafe skills. We study the complementary question of whether specifications help…

Human-Computer Interaction · Computer Science 2026-05-21 Zikai Alex Wen

Safety risks of AI models have been widely studied at deployment time, such as jailbreak attacks that elicit harmful outputs. In contrast, safety risks emerging during training remain largely unexplored. Beyond explicit reward hacking that…

Computation and Language · Computer Science 2026-02-05 Zhexin Zhang , Yida Lu , Junfeng Fang , Junxiao Yang , Shiyao Cui , Hao Zhou , Fandong Meng , Jie Zhou , Hongning Wang , Minlie Huang , Tat-Seng Chua

Language models (LMs) are increasingly used in collaboration: multiple LMs trained by different parties collaborate through routing systems, multi-agent debate, model merging, and more. Critical safety risks remain in this decentralized…

Computation and Language · Computer Science 2026-02-06 Ziyuan Yang , Wenxuan Ding , Shangbin Feng , Yulia Tsvetkov

Agent tools are becoming a core interface through which LLM agents access external data, services, and execution environments. As these tools are distributed through public marketplaces, raw tool counts may substantially overstate ecosystem…

Software Engineering · Computer Science 2026-05-19 Taein Kim , David Jiang , Yuepeng Hu , Yuqi Jia , Neil Gong

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

Autonomous Large Language Model (LLM) agents, exemplified by OpenClaw, demonstrate remarkable capabilities in executing complex, long-horizon tasks. However, their tightly coupled instant-messaging interaction paradigm and high-privilege…

Today's AI agents are built on large language models (LLMs) equipped with tools to access and modify external environments, such as corporate file systems, API-accessible platforms and websites. AI agents offer the promise of automating…

Computers and Society · Computer Science 2026-03-26 Merlin Stein

Large language models (LLMs) are increasingly deployed in human-AI teams as support agents for complex tasks such as information retrieval, programming, and decision-making assistance. While these agents' autonomy and contextual knowledge…

Machine Learning · Computer Science 2026-03-24 Abed K. Musaffar , Ambuj Singh , Francesco Bullo

Large language models (LLMs) and LLM-based agents have been widely deployed in a wide range of applications in the real world, including healthcare diagnostics, financial analysis, customer support, robotics, and autonomous driving,…

Cryptography and Security · Computer Science 2025-05-20 Wenrui Xu , Keshab K. Parhi

Computer-use agents extend language models from text generation to persistent action over tools, files, and execution environments. Unlike chat systems, they maintain state across interactions and translate intermediate outputs into…

Artificial Intelligence · Computer Science 2026-04-06 Yunhao Feng , Yifan Ding , Yingshui Tan , Xingjun Ma , Yige Li , Yutao Wu , Yifeng Gao , Kun Zhai , Yanming Guo