English
Related papers

Related papers: Shutdownable Agents through POST-Agency

200 papers

Assistive agents should make humans' lives easier. Classically, such assistance is studied through the lens of inverse reinforcement learning, where an assistive agent (e.g., a chatbot, a robot) infers a human's intention and then selects…

Artificial Intelligence · Computer Science 2025-01-17 Vivek Myers , Evan Ellis , Sergey Levine , Benjamin Eysenbach , Anca Dragan

Recent works began to automate the design of agentic systems using meta-agents that propose and iteratively refine new agent architectures. In this paper, we examine three key challenges in a common class of meta-agents. First, we…

Artificial Intelligence · Computer Science 2025-10-09 Batu El , Mert Yuksekgonul , James Zou

The actions of intelligent agents, such as chatbots, recommender systems, and virtual assistants are typically not fully transparent to the user. Consequently, using such an agent involves the user exposing themselves to the risk that the…

Computer Science and Game Theory · Computer Science 2020-07-23 The Anh Han , Cedric Perret , Simon T. Powers

This paper considers the hidden-action model of the principal-agent problem, in which a principal incentivizes an agent to work on a project using a contract. We investigate whether contracts with bounded payments are learnable and…

Computer Science and Game Theory · Computer Science 2024-02-23 Yurong Chen , Zhaohua Chen , Xiaotie Deng , Zhiyi Huang

Reinforcement learning (RL) agents optimize only the features specified in a reward function and are indifferent to anything left out inadvertently. This means that we must not only specify what to do, but also the much larger space of what…

Machine Learning · Computer Science 2019-04-22 Rohin Shah , Dmitrii Krasheninnikov , Jordan Alexander , Pieter Abbeel , Anca Dragan

Is transparency always beneficial in complex systems such as traffic networks and stock markets? How is transparency defined in multi-agent systems, and what is its optimal degree at which social welfare is highest? We take an agent-based…

Multiagent Systems · Computer Science 2024-01-12 Kshama Dwarakanath , Svitlana Vyetrenko , Toks Oyebode , Tucker Balch

This paper considers a network of agents, where each agent is assumed to take actions optimally with respect to a predefined payoff function involving the latest actions of the agent's neighbors. Neighborhood relationships stem from payoff…

Dynamical Systems · Mathematics 2021-01-19 Sadegh Arefizadeh , Sadjaad Ozgoli , Sadegh Bolouki , Tamer Başar

This paper establishes a rigorous measurement science for AI agent reliability, providing a foundational framework for quantifying consistency under semantically preserving perturbations. By leveraging $U$-statistics for output-level…

Artificial Intelligence · Computer Science 2026-05-12 Harsh Raj , Niranjan Orkat , Suvrorup Mukherjee , Aritra Guha , Cheryl Flynn , Subhabrata Majumdar

A principal has $m$ identical objects to allocate among a group of $n$ agents. Objects are desirable and the principal's value of assigning an object to an agent is the agent's private information. The principal can verify up to $k$ agents,…

Theoretical Economics · Economics 2024-09-04 Albin Erlanson , Andreas Kleiner

In multi-agent systems, the agents may have goals that depend on a social, shared interpretation about the facts occurring in the system. These are the so-called social goals. Artificial institutions provide such a social interpretation by…

Multiagent Systems · Computer Science 2021-05-04 Rafhael R. Cunha , Jomi Fred Hübner , Maiquel de Brito

We present a silent, self-stabilizing ranking protocol for the population protocol model of distributed computing, where agents interact in randomly chosen pairs to solve a common task. We are given $n$ anonymous agents, and the goal is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 Petra Berenbrink , Robert Elsässer , Thorsten Götte , Lukas Hintze , Dominik Kaaser

Reinforcement learners are agents that learn to pick actions that lead to high reward. Ideally, the value of a reinforcement learner's policy approaches optimality--where the optimal informed policy is the one which maximizes reward.…

Machine Learning · Computer Science 2021-05-27 Michael K. Cohen , Elliot Catt , Marcus Hutter

We consider the problem of creating assistants that can help agents solve new sequential decision problems, assuming the agent is not able to specify the reward function explicitly to the assistant. Instead of acting in place of the agent…

Machine Learning · Computer Science 2022-12-01 Sebastiaan De Peuter , Samuel Kaski

Modern multi-agent reinforcement learning (RL) algorithms hold great potential for solving a variety of real-world problems. However, they do not fully exploit cross-agent knowledge to reduce sample complexity and improve performance.…

Artificial Intelligence · Computer Science 2023-04-13 Haozhi Wang , Yinchuan Li , Qing Wang , Yunfeng Shao , Jianye Hao

Work on persona-persistent post-mortem agents typically frames design around a life/death binary. This framing neglects a consequential yet under-theorised condition: when individuals remain alive but have impaired decisional capacity.…

Human-Computer Interaction · Computer Science 2026-04-16 Kellie Yu Hui Sim , Pin Sym Foong , Darryl Lim , John-Henry Lim , Kenny Tsu Wei Choo

Affordances describe the possibilities for an agent to perform actions with an object. While the significance of the affordance concept has been previously studied from varied perspectives, such as psychology and cognitive science, these…

Artificial Intelligence · Computer Science 2021-05-17 Paola Ardón , Èric Pairet , Katrin S. Lohan , Subramanian Ramamoorthy , Ronald P. A. Petrick

This paper studies a dynamic screening model in which a principal hires an agent with limited liability. The agent's private cost of working is an i.i.d. draw from a continuous distribution. His working status is publicly observable. The…

Theoretical Economics · Economics 2025-11-26 Yijun Liu

Learning in multi-agent environments is difficult due to the non-stationarity introduced by an opponent's or partner's changing behaviors. Instead of reactively adapting to the other agent's (opponent or partner) behavior, we propose an…

Robotics · Computer Science 2021-10-18 Woodrow Z. Wang , Andy Shih , Annie Xie , Dorsa Sadigh

An unconventional approach for optimal stopping under model ambiguity is introduced. Besides ambiguity itself, we take into account how ambiguity-averse an agent is. This inclusion of ambiguity attitude, via an $\alpha$-maxmin nonlinear…

Mathematical Finance · Quantitative Finance 2021-07-15 Yu-Jui Huang , Xiang Yu

We initiate the study of a repeated principal-agent problem over a finite horizon $T$, where a principal sequentially interacts with $K\geq 2$ types of agents arriving in an adversarial order. At each round, the principal strategically…

Computer Science and Game Theory · Computer Science 2025-08-05 Junyan Liu , Arnab Maiti , Artin Tajdini , Kevin Jamieson , Lillian J. Ratliff