English
Related papers

Related papers: SafeClaw-R: Towards Safe and Secure Multi-Agent Pe…

200 papers

The indexing-retrieval-generation paradigm of retrieval-augmented generation (RAG) has been highly successful in solving knowledge-intensive tasks by integrating external knowledge into large language models (LLMs). However, the…

Cryptography and Security · Computer Science 2025-02-25 Xun Liang , Simin Niu , Zhiyu Li , Sensen Zhang , Hanyu Wang , Feiyu Xiong , Jason Zhaoxin Fan , Bo Tang , Shichao Song , Mengwei Wang , Jiawei Yang

Multi-agent reinforcement learning (MARL) has achieved notable success in cooperative tasks, demonstrating impressive performance and scalability. However, deploying MARL agents in real-world applications presents critical safety…

Machine Learning · Computer Science 2024-11-25 Zeyang Li , Navid Azizan

Despite their growing adoption across domains, large language model (LLM)-powered agents face significant security risks from backdoor attacks during training and fine-tuning. These compromised agents can subsequently be manipulated to…

Cryptography and Security · Computer Science 2025-06-12 Li Changjiang , Liang Jiacheng , Cao Bochuan , Chen Jinghui , Wang Ting

Large language model (LLM)-based AI agents extend LLM capabilities by enabling access to tools such as data sources, APIs, search engines, code sandboxes, and even other agents. While this empowers agents to perform complex tasks, LLMs may…

Software Engineering · Computer Science 2026-01-14 Aarya Doshi , Yining Hong , Congying Xu , Eunsuk Kang , Alexandros Kapravelos , Christian Kästner

Large language models (LLMs) have evolved AI assistants into autonomous reasoning engines that maintain context, invoke tools, and pursue long-horizon tasks. This has spurred Agent Operating Systems (Agent OS) as kernel-like layers for…

Human-Computer Interaction · Computer Science 2026-05-18 Heyuan Huang , Yeyi Guan , Jihong Wang , Mingzhi Wang , Jiamu Zhou , Xiangmou Qu , Jiaxin Yin , Xin Liao , Xingyu Lou , Jun Wang

Large Language Models (LLMs) have shown significant promise in real-world decision-making tasks for embodied artificial intelligence, especially when fine-tuned to leverage their inherent common sense and reasoning abilities while being…

Cryptography and Security · Computer Science 2025-05-01 Ruochen Jiao , Shaoyuan Xie , Justin Yue , Takami Sato , Lixu Wang , Yixuan Wang , Qi Alfred Chen , Qi Zhu

Evaluating the security of multi-agent systems (MASs) powered by large language models (LLMs) is challenging, primarily because of the systems' complex internal dynamics and the evolving nature of LLM vulnerabilities. Traditional attack…

Cryptography and Security · Computer Science 2025-06-04 Parth Atulbhai Gandhi , Akansha Shukla , David Tayouri , Beni Ifland , Yuval Elovici , Rami Puzis , Asaf Shabtai

The alignment of Multi-Agent Systems (MAS) for autonomous software engineering is constrained by evaluator epistemic uncertainty. Current paradigms, such as Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF),…

Artificial Intelligence · Computer Science 2026-04-14 Kun Liu , Liqun Chen

The tool-use ability of Large Language Models (LLMs) has a profound impact on a wide range of industrial applications. However, LLMs' self-control and calibration capability in appropriately using tools remains understudied. The problem is…

Machine Learning · Computer Science 2024-12-18 Yuanhao Shen , Xiaodan Zhu , Lei Chen

As large language models (LLMs) evolve into autonomous "AI scientists," they promise transformative advances but introduce novel vulnerabilities, from potential "biosafety risks" to "dangerous explosions." Ensuring trustworthy deployment in…

Cryptography and Security · Computer Science 2026-03-20 Saket Sanjeev Chaturvedi , Joshua Bergerson , Tanwi Mallick

Large Language Model-based Multi-Agent Systems (LLM-based MAS), where multiple LLM agents collaborate to solve complex tasks, have shown impressive performance in many areas. However, MAS are typically distributed across different devices…

Artificial Intelligence · Computer Science 2026-01-09 Zhilun Zhou , Zihan Liu , Jiahe Liu , Qingyu Shao , Yihan Wang , Kun Shao , Depeng Jin , Fengli Xu

As LLMs advance into autonomous agents with tool-use capabilities, they introduce security challenges that extend beyond traditional content-based LLM safety concerns. This paper introduces Sequential Tool Attack Chaining (STAC), a novel…

Cryptography and Security · Computer Science 2026-02-03 Jing-Jing Li , Jianfeng He , Chao Shang , Devang Kulshreshtha , Xun Xian , Yi Zhang , Hang Su , Sandesh Swamy , Yanjun Qi

LLM agents are evolving rapidly, powered by code execution, tools, and the recently introduced agent skills feature. Skills allow users to extend LLM applications with specialized third-party code, knowledge, and instructions. Although this…

Cryptography and Security · Computer Science 2026-02-26 David Schmotz , Luca Beurer-Kellner , Sahar Abdelnabi , Maksym Andriushchenko

Agentic AI systems automate enterprise workflows but existing defenses--guardrails, semantic filters--are probabilistic and routinely bypassed. We introduce authenticated workflows, the first complete trust layer for enterprise agentic AI.…

Cryptography and Security · Computer Science 2026-02-12 Mohan Rajagopalan , Vinay Rao

MediaClaw is a multimodal agent platform built on the OpenClaw ecosystem. Its core design follows a three-layer architecture of unified abstraction, pluginized extension, and workflow orchestration. The system is intended to address…

Artificial Intelligence · Computer Science 2026-05-15 Shaoan Zhao , Huanlin Gao , Qiang Hui , Ting Lu , Xueqiang Guo , Yantao Li , Xinpei Su , Fuyuan Shi , Chao Tan , Fang Zhao , Kai Wang , Shiguo Lian

Autonomous LLM agents operate as long-running processes with persistent workspaces, memory files, scheduled task state, and messaging integrations. These features create a new propagation risk: attacker-influenced content can be written…

Cryptography and Security · Computer Science 2026-05-05 Mingming Zha , Xiaofeng Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding, code generation, and complex planning. Simultaneously, Multi-Agent Systems (MAS) have garnered attention for their potential to enable…

Computation and Language · Computer Science 2025-06-06 Can Zheng , Yuhan Cao , Xiaoning Dong , Tianxing He

In recent years, safety risks associated with large language models have become increasingly prominent, highlighting the urgent need to mitigate the generation of toxic and harmful content. The mainstream paradigm for LLM safety alignment…

Machine Learning · Computer Science 2026-02-02 Zhewen Tan , Wenhan Yu , Jianfeng Si , Tongxin Liu , Kaiqi Guan , Huiyan Jin , Jiawen Tao , Xiaokun Yuan , Duohe Ma , Xiangzheng Zhang , Tong Yang , Lin Sun

Autonomous large language model (LLM) agents such as OpenClaw are pushing agentic commerce from human-supervised assistance toward machine actors that can negotiate, purchase services, manage digital assets, and execute transactions across…

Cryptography and Security · Computer Science 2026-05-04 Qian'ang Mao , Jiaxin Wang , Ya Liu , Li Zhu , Cong Ma , Jiaqi Yan

Vision-Language-Action (VLA) systems have shown strong potential for language-driven robotic manipulation. However, scaling them to long-horizon tasks remains challenging. Existing pipelines typically separate data collection, policy…