English
Related papers

Related papers: Solving Dynamic Principal-Agent Problems with a Ra…

200 papers

Motivated by applications such as cloud platforms allocating GPUs to users or governments deploying mobile health units across competing regions, we study the dynamic allocation of a reusable resource to strategic agents with private…

Computer Science and Game Theory · Computer Science 2025-07-15 Yan Dai , Negin Golrezaei , Patrick Jaillet

Adversarial Imitation Learning (AIL) methods, while effective in settings with limited expert demonstrations, are often considered unstable. These approaches typically decompose into two components: Density Ratio (DR) estimation…

Artificial Intelligence · Computer Science 2026-02-27 Shashank Reddy Chirra , Jayden Teoh , Praveen Paruchuri , Pradeep Varakantham

In this paper we consider a principal agent problem where the agent is allowed to quit, by incurring a cost. When the current agent quits the job, the principal will hire a new one, possibly with a different type. We characterize the…

Optimization and Control · Mathematics 2024-09-04 Jianfeng Zhang , Zimu Zhu

In this paper, we consider a transfer Reinforcement Learning (RL) problem in continuous state and action spaces, under unobserved contextual information. For example, the context can represent the mental view of the world that an expert…

Machine Learning · Computer Science 2021-06-08 Chenyu Liu , Yan Zhang , Yi Shen , Michael M. Zavlanos

We study a robust contract design problem with deferred inspection, in which a principal allocates a scarce resource to an agent, observes the agent's realized outcome ex post at negligible cost, and conditions transfers on this information…

Theoretical Economics · Economics 2026-01-12 Halil I. Bayrak , Martin Bichler

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

Machine Learning · Computer Science 2024-10-22 Nadav Merlis

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate…

Multiagent Systems · Computer Science 2024-11-05 Weifan Long , Wen Wen , Peng Zhai , Lihua Zhang

Deep Reinforcement Learning (DRL) has become a powerful strategy to solve complex decision making problems based on Deep Neural Networks (DNNs). However, it is highly data demanding, so unfeasible in physical systems for most applications.…

Machine Learning · Computer Science 2018-10-02 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

In this work, we integrate `social' interactions into the MARL setup through a user-defined relational network and examine the effects of agent-agent relations on the rise of emergent behaviors. Leveraging insights from sociology and…

Artificial Intelligence · Computer Science 2022-07-15 Hossein Haeri , Reza Ahmadzadeh , Kshitij Jerath

We study a sequential mechanism design problem in which a principal seeks to elicit truthful reports from multiple rational agents while starting with no prior knowledge of agents' beliefs. We introduce Distributionally Robust Adaptive…

Computer Science and Game Theory · Computer Science 2026-04-22 Qiushi Han , David Simchi-Levi , Renfei Tan , Zishuo Zhao

We study the principal-agent problem with a third party that we call social planner, whose responsibility is to reconcile the conflicts of interest between the two players and induce socially optimal outcome in terms of some given social…

Computer Science and Game Theory · Computer Science 2024-11-07 Shiyun Lin , Zhihua Zhang

Reinforcement learning (RL) agents are often designed specifically for a particular problem and they generally have uninterpretable working processes. Statistical methods-based agent algorithms can be improved in terms of generalizability…

Artificial Intelligence · Computer Science 2020-07-14 Faruk Kucuksubasi , Elif Surer

Reinforcement learning (RL) has garnered significant attention for developing decision-making agents that aim to maximize rewards, specified by an external supervisor, within fully observable environments. However, many real-world problems…

Machine Learning · Computer Science 2024-06-03 Parvin Malekzadeh , Konstantinos N. Plataniotis

We seek to align agent policy with human expert behavior in a reinforcement learning (RL) setting, without any prior knowledge about dynamics, reward function, and unsafe states. There is a human expert knowing the rewards and unsafe states…

Machine Learning · Computer Science 2020-01-01 Daniel Hsu

We study the incentivized information acquisition problem, where a principal hires an agent to gather information on her behalf. Such a problem is modeled as a Stackelberg game between the principal and the agent, where the principal…

Machine Learning · Computer Science 2023-08-08 Siyu Chen , Jibang Wu , Yifan Wu , Zhuoran Yang

The Visibility-based Persistent Monitoring (VPM) problem seeks to find a set of trajectories (or controllers) for robots to persistently monitor a changing environment. Each robot has a sensor, such as a camera, with a limited field-of-view…

Robotics · Computer Science 2021-10-08 Jingxi Chen , Amrish Baskaran , Zhongshun Zhang , Pratap Tokekar

Recently, AI systems have made remarkable progress in various tasks. Deep Reinforcement Learning(DRL) is an effective tool for agents to learn policies in low-level state spaces to solve highly complex tasks. Researchers have introduced…

Artificial Intelligence · Computer Science 2025-08-25 Gabriele Sartor , Angelo Oddi , Riccardo Rasconi , Vieri Giuliano Santucci , Rosa Meo

Various methods for solving the inverse reinforcement learning (IRL) problem have been developed independently in machine learning and economics. In particular, the method of Maximum Causal Entropy IRL is based on the perspective of entropy…

Machine Learning · Computer Science 2021-03-05 Navyata Sanghvi , Shinnosuke Usami , Mohit Sharma , Joachim Groeger , Kris Kitani

Many emerging agentic paradigms require agents to collaborate with one another (or people) to achieve shared goals. Unfortunately, existing approaches to learning policies for such collaborative problems produce brittle solutions that fail…

Machine Learning · Computer Science 2026-03-02 Chengrui Qu , Yizhou Zhang , Nicolas Lanzetti , Eric Mazumdar

Alignment is vital for safely deploying large language models (LLMs). Existing techniques are either reward-based (training a reward model on preference pairs and optimizing with reinforcement learning) or reward-free (directly fine-tuning…

Computation and Language · Computer Science 2026-03-03 Ruoxi Cheng , Haoxuan Ma , Weixin Wang , Ranjie Duan , Jiexi Liu , Xiaoshuang Jia , Simeng Qin , Xiaochun Cao , Yang Liu , Xiaojun Jia