中文
相关论文

相关论文: From Admission to Invariants: Measuring Deviation …

200 篇论文

Autonomous AI agents can remain fully authorized and still become unsafe as behavior drifts, adversaries adapt, and decision patterns shift without any code change. We propose the \textbf{Informational Viability Principle}: governing an…

人工智能 · 计算机科学 2026-04-28 German Marin , Jatin Chaudhary

Multi-agent Large Language Model (LLM) systems have emerged as powerful architectures for complex task decomposition and collaborative problem-solving. However, their long-term behavioral stability remains largely unexamined. This study…

人工智能 · 计算机科学 2026-01-08 Abhishek Rath

Behavioral evaluation is the dominant paradigm for assessing alignment in large language models (LLMs). In current practice, observed compliance under finite evaluation protocols is treated as evidence of latent alignment. However, the…

机器学习 · 计算机科学 2026-02-10 Igor Santos-Grueiro

LLM-based agents can execute actions that are syntactically valid, user-sanctioned, and semantically appropriate, yet still violate organizational policy because the facts needed for correct policy judgment are hidden at decision time. We…

人工智能 · 计算机科学 2026-04-15 Jie Wu , Ming Gong

We study inverse mechanism learning: recovering an unknown incentive-generating mechanism from observed strategic interaction traces of self-interested learning agents. Unlike inverse game theory and multi-agent inverse reinforcement…

人工智能 · 计算机科学 2026-01-27 Zhiyu An , Wan Du

AI agents dynamically acquire tools, orchestrate sub-agents, and transact across organizational boundaries, yet no existing security layer verifies what an agent can do, whether it executed what it claims, or what happened in a multi-agent…

密码学与安全 · 计算机科学 2026-03-23 Ziling Zhou

Multi-Agentic AI systems, powered by large language models (LLMs), are inherently non-deterministic and prone to silent failures such as drift, cycles, and missing details in outputs, which are difficult to detect. We introduce the task of…

人工智能 · 计算机科学 2025-11-07 Divya Pathak , Harshit Kumar , Anuska Roy , Felix George , Mudit Verma , Pratibha Moogi

A robot's deployment environment often involves perceptual changes that differ from what it has experienced during training. Standard practices such as data augmentation attempt to bridge this gap by augmenting source images in an effort to…

机器学习 · 计算机科学 2022-05-18 Takuma Yoneda , Ge Yang , Matthew R. Walter , Bradly Stadie

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

人工智能 · 计算机科学 2016-01-26 Kareem Amin , Satinder Singh

In standard Reinforcement Learning (RL) settings, the interaction between the agent and the environment is typically modeled as a Markov Decision Process (MDP), which assumes that the agent observes the system state instantaneously, selects…

机器学习 · 计算机科学 2025-06-18 John Wikman , Alexandre Proutiere , David Broman

As autonomous and agentic AI systems scale in robotic and human-machine environments, managing hallucination and persistent but unjustified action remains an open challenge. Rather than attributing these failures solely to model or…

人工智能 · 计算机科学 2026-05-28 Srini Ramaswamy

Deep reinforcement learning (DRL) provides a promising way for intelligent agents (e.g., autonomous vehicles) to learn to navigate complex scenarios. However, DRL with neural networks as function approximators is typically considered a…

机器人学 · 计算机科学 2023-11-28 Jiachen Li , David Isele , Kanghoon Lee , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

When an LLM agent reads a confidential file, then writes a summary, then emails it externally, no single step is unsafe, but the sequence is a data leak. We call this safety drift: individually safe actions compounding into violations.…

密码学与安全 · 计算机科学 2026-03-31 Aditya Dhodapkar , Farhaan Pishori

Can a multimodal language model learn to manipulate physical objects by reasoning about its own failures-without gradient updates, demonstrations, or reward engineering? We argue the answer is yes, under conditions we characterise…

机器人学 · 计算机科学 2026-03-06 Vaishak Kumar

Accurate and interpretable car-following models are essential for traffic simulation and autonomous vehicle development. However, classical models like the Intelligent Driver Model (IDM) are fundamentally limited by their parsimonious and…

应用统计 · 统计学 2025-06-18 Chengyuan Zhang , Cathy Wu , Lijun Sun

As autonomous coding agents become deeply embedded in software development workflows, their high operational velocity introduces a critical oversight challenge: the accumulating divergence between agentic actions and architectural intent.…

软件工程 · 计算机科学 2026-05-05 Matteo Casserini , Alessandro Facchini , Andrea Ferrario

Nonlinear systems of affine control inputs overarch many sensor fusion instances. Analyzing whether a state variable in such a nonlinear system can be estimated (i.e., observability) informs better estimator design. Among the research on…

系统与控制 · 电气工程与系统科学 2022-07-19 Jianzhu Huai , Yukai Lin , Yujia Zhang

Safety evaluation for advanced AI systems assumes that behavior observed under evaluation predicts behavior in deployment. This assumption weakens for agents with situational awareness, which may exploit regime leakage, cues distinguishing…

人工智能 · 计算机科学 2026-02-17 Igor Santos-Grueiro

As LLM-based systems increasingly operate as agents embedded within human social and technical systems, alignment can no longer be treated as a property of an isolated model, but must be understood in relation to the environments in which…

Reinforcement learning (RL) agents typically assume stationary environment dynamics. Yet in real-world applications such as healthcare, robotics, and finance, transition probabilities or reward functions may evolve, leading to model drift.…

机器学习 · 计算机科学 2025-09-16 Chang-Hwan Lee , Alexander Shim
‹ 上一页 1 2 3 10 下一页 ›