English
Related papers

Related papers: Enforcing Benign Trajectories: A Behavioral Firewa…

200 papers

Large language models (LLMs) are increasingly deployed as tool-augmented agents capable of executing system-level operations. While existing benchmarks primarily assess textual alignment or task success, less attention has been paid to the…

Artificial Intelligence · Computer Science 2026-05-26 Shasha Yu , Fiona Carroll , Barry L. Bentley

While powerful, the inherent non-determinism of large language model (LLM) agents limits their application in structured operational environments where procedural fidelity and predictable execution are strict requirements. This limitation…

Software Engineering · Computer Science 2025-08-06 Libin Qiu , Yuhang Ye , Zhirong Gao , Xide Zou , Junfu Chen , Ziming Gui , Weizhi Huang , Xiaobo Xue , Wenkai Qiu , Kun Zhao

AI agents dynamically acquire tools, orchestrate sub-agents, and transact across organizational boundaries, yet no existing security layer verifies what an agent can do, whether it executed what it claims, or what happened in a multi-agent…

Cryptography and Security · Computer Science 2026-03-23 Ziling Zhou

Powerful autonomous systems, which reason, plan, and converse using and between numerous tools and agents, are made possible by Large Language Models (LLMs), Vision-Language Models (VLMs), and new agentic AI systems, like LangChain and…

Cryptography and Security · Computer Science 2025-12-30 Toqeer Ali Syed , Mishal Ateeq Almutairi , Mahmoud Abdel Moaty

Connecting large language models (LLMs) to defensive enforcement requires more than asking a model whether an attack is happening. A defender must decide which model outputs may change the system state, which outputs must be rejected, and…

Cryptography and Security · Computer Science 2026-05-22 Sidnei Barbieri , Ágney Lopes Roth Ferraz , Lourenço Alves Pereira Júnior

The rise of AI agents introduces complex safety and security challenges arising from autonomous tool use and environmental interactions. Current guardrail models lack agentic risk awareness and transparency in risk diagnosis. To introduce…

Anomaly-based intrusion detection systems are essential defenses against cybersecurity threats because they can identify anomalies in current activities. However, these systems have difficulties providing entity processing independence…

Formal Languages and Automata Theory · Computer Science 2022-07-25 El Jabri Chaymae , Frappier Marc , Ecarot Thibaud , Tardif Pierre-Martin

Despite the potential of language model-based agents to solve real-world tasks such as web navigation, current methods still struggle with long-horizon tasks with complex action trajectories. In contrast, humans can flexibly solve complex…

Computation and Language · Computer Science 2024-09-12 Zora Zhiruo Wang , Jiayuan Mao , Daniel Fried , Graham Neubig

The rapid deployment of large language model (LLM)-based agents introduces a new class of risks, driven by their capacity for autonomous planning, multi-step tool integration, and emergent interactions. It raises some risk factors for…

Multiagent Systems · Computer Science 2025-12-04 Rafflesia Khan , Declan Joyce , Mansura Habiba

The integration of large language models (LLMs) into robotic control pipelines enables natural language interfaces that translate user prompts into executable commands. However, this digital-to-physical interface introduces a critical and…

Robotics · Computer Science 2026-04-07 Mingyang Xie , Jin Wei-Kocsis

AI agents are increasingly embedded in real software systems, where they execute multi-step workflows through multi-turn dialogue, tool invocations, and intermediate decisions. These long execution histories, called agentic traces, make…

Software Engineering · Computer Science 2026-05-12 Reshabh K Sharma , Shraddha Barke , Benjamin Zorn

Reactive anomaly detection methods, which are commonly deployed to identify anomalies after they occur based on observed deviations, often fall short in applications that demand timely intervention, such as industrial monitoring, finance,…

Machine Learning · Computer Science 2026-02-13 Luis Olmos , Rashida Hasan

AI agent frameworks connecting large language model (LLM) reasoning to host execution surfaces -- shell, filesystem, containers, and messaging -- introduce security challenges structurally distinct from conventional software. We present a…

Cryptography and Security · Computer Science 2026-05-15 Surada Suwansathit , Yuxuan Zhang , Guofei Gu

Large language model (LLM) agents have demonstrated remarkable capabilities in complex reasoning and decision-making by leveraging external tools. However, this tool-centric paradigm introduces a previously underexplored attack surface,…

Artificial Intelligence · Computer Science 2026-01-08 Kanghua Mo , Li Hu , Yucheng Long , Zhihao Li

As AI models scale to billions of parameters and operate with increasing autonomy, ensuring their safe, reliable operation demands engineering-grade security and assurance frameworks. This paper presents an enterprise-level, risk-aware,…

Cryptography and Security · Computer Science 2025-05-13 Krti Tallam

With the rapidly increasing capabilities and adoption of code agents for AI-assisted coding, safety concerns, such as generating or executing risky code, have become significant barriers to the real-world deployment of these agents. To…

Software Engineering · Computer Science 2024-11-13 Chengquan Guo , Xun Liu , Chulin Xie , Andy Zhou , Yi Zeng , Zinan Lin , Dawn Song , Bo Li

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

Cryptography and Security · Computer Science 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

Modern open-world agents such as OpenClaw exhibit powerful cross-environment execution capabilities yet introduce broad new safety risk sources. Meanwhile, advanced frontier AI models drastically lower attack barriers, rendering current…

The paper proposes an on-line monitoring framework for continuous real-time safety/security in learning-based control systems (specifically application to a unmanned ground vehicle). We monitor validity of mappings from sensor inputs to…

Machine Learning · Computer Science 2018-11-13 Naman Patel , Apoorva Nandini Saridena , Anna Choromanska , Prashanth Krishnamurthy , Farshad Khorrami

Generative Artificial Intelligence (GenAI) presents significant advancements but also introduces novel security challenges, particularly within agentic workflows where AI agents operate autonomously. These risks escalate in multi-agent…

Cryptography and Security · Computer Science 2025-06-24 Sunil Kumar Jang Bahadur , Gopala Dhar