English
Related papers

Related papers: Session Risk Memory (SRM): Temporal Authorization …

200 papers

Multi-agent AI systems exhibit emergent risks that no single agent produces in isolation. Existing safety frameworks rely on binary classifications of agent behavior, discarding the uncertainty inherent in proxy-based evaluation. We…

Multiagent Systems · Computer Science 2026-04-23 Aizierjiang Aiersilan , Raeli Savitt

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

Artificial Intelligence · Computer Science 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

Embodied agents powered by vision-language models (VLMs) are increasingly capable of executing complex real-world tasks, yet they remain vulnerable to hazardous instructions that may trigger unsafe behaviors. Runtime safety guardrails,…

Artificial Intelligence · Computer Science 2025-12-29 Le Wang , Zonghao Ying , Xiao Yang , Quanchen Zou , Zhenfei Yin , Tianlin Li , Jian Yang , Yaodong Yang , Aishan Liu , Xianglong Liu

AI agents today have passwords but no permission slips. They execute tool calls (fund transfers, database queries, shell commands, sub-agent delegation) with no standard mechanism to enforce authorization before the action executes. Current…

Cryptography and Security · Computer Science 2026-03-24 Uchi Uchibeke

Multi-agent collision-free trajectory planning and control subject to different goal requirements and system dynamics has been extensively studied, and is gaining recent attention in the realm of machine and reinforcement learning. However,…

Robotics · Computer Science 2021-06-03 Salar Asayesh , Mo Chen , Mehran Mehrandezh , Kamal Gupta

This paper presents a systematic verification and validation (V\&V) framework for the Evasive Minimum Risk Maneuver (EMRM) feature in autonomous vehicles, addressing a critical gap in existing safety assessment methods. We introduce the…

Systems and Control · Electrical Eng. & Systems 2026-04-30 Aliasghar Arab , Milad Khaleghi , Koorosh Aslansefat

As autonomous agents (e.g., OpenClaw) increasingly operate with deep system-level privileges to execute complex tasks, they introduce severe, unmitigated security risks. Current vulnerability analyses overwhelmingly focus on single-turn,…

Cryptography and Security · Computer Science 2026-05-22 Jianan Ma , Xiaohu Du , Ruixiao Lin , Yaoxiang Bian , Jialuo Chen , Jingyi Wang , Xiaofang Yang , Shiwen Cui , Changhua Meng , Xinhao Deng , Zhen Wang

State of the art reinforcement learning methods sometimes encounter unsafe situations. Identifying when these situations occur is of interest both for post-hoc analysis and during deployment, where it might be advantageous to call out to a…

Machine Learning · Computer Science 2025-05-29 Alexander Grushin , Walt Woods , Alvaro Velasquez , Simon Khan

In the real world, agents often have to operate in situations with incomplete information, limited sensing capabilities, and inherently stochastic environments, making individual observations incomplete and unreliable. Moreover, in many…

Machine Learning · Computer Science 2018-09-26 Akshat Agarwal , Abhinau Kumar , Kyle Dunovan , Erik Peterson , Timothy Verstynen , Katia Sycara

Agentic memory enables LLMs to persist information beyond a single context window and reuse it in later decisions, but it also introduces a new vulnerability: spurious correlations, where retrieved memory carries miscorrelated evidence and…

Machine Learning · Computer Science 2026-05-12 Luoxi Tang , Rupali Rajendra Vaje , Yuqiao Meng , Sakshi Sunil Narkar , Weicheng Ma , Zeyu Ding , Dazheng Zhang , Zhaohan Xi

Although large reasoning models (LRMs) have demonstrated impressive capabilities on complex tasks, recent studies reveal that these models frequently fulfill harmful user instructions, raising significant safety concerns. In this paper, we…

Artificial Intelligence · Computer Science 2025-08-04 Yeonjun In , Wonjoong Kim , Sangwu Park , Chanyoung Park

Long Short-Term Memory (LSTM) is one of the most widely used recurrent structures in sequence modeling. It aims to use gates to control information flow (e.g., whether to skip some information or not) in the recurrent computations, although…

Machine Learning · Computer Science 2018-06-11 Zhuohan Li , Di He , Fei Tian , Wei Chen , Tao Qin , Liwei Wang , Tie-Yan Liu

The field of Machine Learning has changed significantly since the 1970s. However, its most basic principle, Empirical Risk Minimization (ERM), remains unchanged. We propose Functional Risk Minimization~(FRM), a general framework where…

Deploying AI agents for repetitive periodic tasks exposes a critical tension: Large Language Models (LLMs) offer unmatched flexibility in tool orchestration, yet their inherent stochasticity causes unpredictable failures, and repeated…

Artificial Intelligence · Computer Science 2026-05-15 Xiaohua Wang , Kai Yu , XuXiao Liang , Liang Wang , Chao Han

Current stateless defences for multimodal agentic RAG fail to detect adversarial strategies that distribute malicious semantics across retrieval, planning, and generation components. We formulate this security challenge as a Partially…

LLM agents deployed in production operate under operator-defined behavioral policies (system-prompt instructions such as prohibitions on credential disclosure, data exfiltration, and unauthorized output) that safety evaluations assume hold…

Cryptography and Security · Computer Science 2026-04-24 Yeran Gamage

Transfer attacks optimize on a surrogate and deploy to a black-box target. While iterative optimization attacks in this paradigm are limited by their per-input cost limits efficiency and scalability due to multistep gradient updates for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Jongoh Jeong , Hunmin Yang , Jaeseok Jeong , Kuk-Jin Yoon

Multi-agent LLM debate improves factuality and reasoning, but most recipes pick a fixed round count, over-spending on easy items and under-spending on hard ones. We adapt Wald's Sequential Probability Ratio Test (SPRT) as a plug-in compute…

Machine Learning · Computer Science 2026-05-20 Andrea Morandi

Structured memory representations such as knowledge graphs are central to autonomous agents and other long-lived systems. However, most existing approaches model time as discrete metadata, either sorting by recency (burying…

Computation and Language · Computer Science 2026-04-14 Weixian Waylon Li , Jiaxin Zhang , Xianan Jim Yang , Tiejun Ma , Yiwen Guo

We present Springdrift, a persistent runtime for long-lived LLM agents. The system integrates an auditable execution substrate (append-only memory, supervised processes, git-backed recovery), a case-based reasoning memory layer with hybrid…

Artificial Intelligence · Computer Science 2026-04-07 Seamus Brady