English
Related papers

Related papers: Principal-Agent Reinforcement Learning: Orchestrat…

200 papers

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

In dynamic mechanism design literature, one critical aspect has been typically ignored-the agents' periodic participation, which they can adapt and plan strategically. We propose a framework for dynamic principal-multiagent problems,…

Computer Science and Game Theory · Computer Science 2023-06-16 Tao Zhang , Quanyan Zhu

A principal uses payments conditioned on stochastic outcomes of a team project to elicit costly effort from the team members. We develop a multi-agent generalization of a classic first-order approach to contract optimization by leveraging…

Theoretical Economics · Economics 2026-03-13 Krishna Dasaratha , Benjamin Golub , Anant Shah

Assistance games (also known as cooperative inverse reinforcement learning games) have been proposed as a model for beneficial AI, wherein a robotic agent must act on behalf of a human principal but is initially uncertain about the humans…

Artificial Intelligence · Computer Science 2020-07-21 Arnaud Fickinger , Simon Zhuang , Dylan Hadfield-Menell , Stuart Russell

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

Optimization and Control · Mathematics 2019-12-09 Ather Gattami

The staggering feats of AI systems have brought to attention the topic of AI Alignment: aligning a "superintelligent" AI agent's actions with humanity's interests. Many existing frameworks/algorithms in alignment study the problem on a…

Machine Learning · Computer Science 2024-10-22 Hong Jun Jeon , Benjamin Van Roy

In the classical principal-agent problem, a principal must design a contract to incentivize an agent to perform an action on behalf of the principal. We study the classical principal-agent problem in a setting where the agent can be of one…

Computer Science and Game Theory · Computer Science 2020-10-15 Guru Guruganesh , Jon Schneider , Joshua Wang

We consider the classic principal-agent model of contract theory, in which a principal designs an outcome-dependent compensation scheme to incentivize an agent to take a costly and unobservable action. When all of the model…

Computer Science and Game Theory · Computer Science 2020-08-11 Paul Dütting , Tim Roughgarden , Inbal Talgam-Cohen

AI systems will soon have to navigate human environments and make decisions that affect people and other AI agents whose goals and values diverge. Contractualist alignment proposes grounding those decisions in agreements that diverse…

Reinforcement learning agents have been mostly developed and evaluated under the assumption that they will operate in a fully autonomous manner -- they will take all actions. In this work, our goal is to develop algorithms that, by learning…

Machine Learning · Computer Science 2023-07-04 Vahid Balazadeh , Abir De , Adish Singla , Manuel Gomez-Rodriguez

This study investigates cooperation evolution mechanisms in the spatial public goods game. A novel deep reinforcement learning framework, Proximal Policy Optimization with Adversarial Curriculum Transfer (PPO-ACT), is proposed to model…

Computer Science and Game Theory · Computer Science 2025-07-03 Zhaoqilin Yang , Chanchan Li , Xin Wang , Youliang Tian

This paper addresses the challenges of high resource dynamism and scheduling complexity in cloud-native database systems. It proposes an adaptive resource orchestration method based on multi-agent reinforcement learning. The method…

Machine Learning · Computer Science 2025-08-15 Guanzi Yao , Heyao Liu , Linyan Dai

Principal agent games are a growing area of research which focuses on the optimal behaviour of a principal and an agent, with the former contracting work from the latter, in return for providing a monetary award. While this field…

Mathematical Finance · Quantitative Finance 2022-06-28 Dena Firoozi , Arvind V Shrivats , Sebastian Jaimungal

We present a continuous-time contract whereby a top-level player can incentivize a hierarchy of players below him to act in his best interest despite only observing the output of his direct subordinate. This paper extends Sannikov's…

Optimization and Control · Mathematics 2015-11-25 Christopher W. Miller , Insoon Yang

Pricing decisions are increasingly made by AI. Thanks to their ability to train with live market data while making decisions on the fly, deep reinforcement learning algorithms are especially effective in taking such pricing decisions. In…

Artificial Intelligence · Computer Science 2021-07-06 Michael Schlechtinger , Damaris Kosack , Heiko Paulheim , Thomas Fetzer

Traditional methods plan feasible paths for multiple agents in the stochastic environment. However, the methods' iterations with the changes in the environment result in computation complexities, especially for the decentralized agents…

Robotics · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen , Jinhu Lü

Social dilemmas have been widely studied to explain how humans are able to cooperate in society. Considerable effort has been invested in designing artificial agents for social dilemmas that incorporate explicit agent motivations that are…

Multiagent Systems · Computer Science 2021-08-30 Nicolas Anastassacos , Stephen Hailes , Mirco Musolesi

Traditional multi-agent reinforcement learning algorithms are not scalable to environments with more than a few agents, since these algorithms are exponential in the number of agents. Recent research has introduced successful methods to…

Multiagent Systems · Computer Science 2021-01-26 Sriram Ganapathi Subramanian , Matthew E. Taylor , Mark Crowley , Pascal Poupart

As artificial intelligence (AI) agents are deployed across economic domains, understanding their strategic behavior and market-level impact becomes critical. This paper puts forward a groundbreaking new framework that is the first to…

Multiagent Systems · Computer Science 2025-12-05 Christopher Chiu , Simpson Zhang , Mihaela van der Schaar

In a multi-agent setting, the optimal policy of a single agent is largely dependent on the behavior of other agents. We investigate the problem of multi-agent reinforcement learning, focusing on decentralized learning in non-stationary…

Artificial Intelligence · Computer Science 2019-10-01 Anahita Mohseni-Kabir , David Isele , Kikuo Fujimura