English
Related papers

Related papers: Robust Contracts with Exploration

200 papers

We study a setting in which a principal selects an agent to execute a collection of tasks according to a specified priority sequence. Agents, however, have their own individual priority sequences according to which they wish to execute the…

Computer Science and Game Theory · Computer Science 2024-10-30 Donya G. Dobakhshari , Lav R. Varshney , Vijay Gupta

Maximizing long-term rewards is the primary goal in sequential decision-making problems. The majority of existing methods assume that side information is freely available, enabling the learning agent to observe all features' states before…

Machine Learning · Computer Science 2023-07-19 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

We study Bayesian automated mechanism design in unstructured dynamic environments, where a principal repeatedly interacts with an agent, and takes actions based on the strategic agent's report of the current state of the world. Both the…

Computer Science and Game Theory · Computer Science 2021-05-14 Hanrui Zhang , Vincent Conitzer

We consider the martingale optimal transport duality for c\`adl\`ag processes with given initial and terminal laws. Strong duality and existence of dual optimizers (robust semi-static superhedging strategies) are proved for a class of…

Probability · Mathematics 2019-04-10 Sebastian Herrmann , Florian Stebegg

We study hidden-action principal-agent problems with multiple agents. Unlike previous work, we consider a general setting in which each agent has an arbitrary number of actions, and the joint action induces outcomes according to an…

Computer Science and Game Theory · Computer Science 2024-02-22 Federico Cacciamani , Martino Bernasconi , Matteo Castiglioni , Nicola Gatti

Modern AI systems increasingly operate inside markets and institutions where data, behavior, and incentives are endogenous. This paper develops an economic foundation for multi-agent learning by studying a principal-agent interaction in a…

Machine Learning · Statistics 2026-01-08 Nassim Helou

Contract theory studies how a principal can incentivize agents to exert costly, unobservable effort through performance-based payments. While classical economic models provide elegant characterizations of optimal solutions, modern…

Computer Science and Game Theory · Computer Science 2025-10-20 Michal Feldman

This paper addresses two classes of different, yet interrelated optimization problems. The first class of problems involves a robot that must locate a hidden target in an environment that consists of a set of concurrent rays. The second…

Artificial Intelligence · Computer Science 2015-04-28 Spyros Angelopoulos

Firms increasingly delegate decisions to learning algorithms in platform markets. Standard algorithms perform well when platform policies are stationary, but firms often face ambiguity about whether policies are stationary or adapt…

Theoretical Economics · Economics 2026-02-11 Kyohei Okumura

While $\mathcal{H}_\infty$ methods can introduce robustness against worst-case perturbations, their nominal performance under conventional stochastic disturbances is often drastically reduced. Though this fundamental tradeoff between…

Systems and Control · Electrical Eng. & Systems 2023-05-29 Bruce D. Lee , Thomas T. C. K. Zhang , Hamed Hassani , Nikolai Matni

Principal agent games are a growing area of research which focuses on the optimal behaviour of a principal and an agent, with the former contracting work from the latter, in return for providing a monetary award. While this field…

Mathematical Finance · Quantitative Finance 2022-06-28 Dena Firoozi , Arvind V Shrivats , Sebastian Jaimungal

The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to…

Machine Learning · Computer Science 2019-09-10 Lior Shani , Yonathan Efroni , Shie Mannor

This paper explores the capacity of artificial intelligence (AI) algorithms to autonomously design incentive-compatible contracts in dual-principal-agent settings, a relatively unexplored aspect of algorithmic mechanism design. We develop a…

Artificial Intelligence · Computer Science 2024-06-14 Qian Qi

We consider a general formulation of the random horizon Principal-Agent problem with a continuous payment and a lump-sum payment at termination. In the European version of the problem, the random horizon is chosen solely by the principal…

Optimization and Control · Mathematics 2022-02-11 Yiqing Lin , Zhenjie Ren , Nizar Touzi , Junjian Yang

A principal and an agent face symmetric uncertainty about the value of two correlated projects for the agent. The principal chooses which project values to publicly discover and makes a proposal to the agent, who accepts if and only if the…

Theoretical Economics · Economics 2022-11-22 Eitan Sapiro-Gheiler

A seller sells an object over time but is uncertain how the buyer learns their willingness-to-pay. We consider informational robustness under \textit{limited commitment}, where the seller offers a price \textit{each period} to maximize…

Theoretical Economics · Economics 2025-09-10 Zihao Li , Jonathan Libgober , Xiaosheng Mu

A principal selects a team of agents for collaborating on a joint project. The principal aims to design a revenue-optimal contract that incentivize the team of agents to exert costly effort while satisfying fairness constraints. We show…

Computer Science and Game Theory · Computer Science 2025-12-23 Matteo Castiglioni , Junjie Chen , Yingkai Li

In many two-sided markets, the parties to be matched have incomplete information about their characteristics. We consider the settings where the parties engaged are extremely patient and are interested in long-term partnerships. Hence, once…

Computer Science and Game Theory · Computer Science 2019-08-30 Kartik Ahuja , Mihaela van der Schaar

We present a novel bilateral negotiation model that allows a self-interested agent to learn how to negotiate over multiple issues in the presence of user preference uncertainty. The model relies upon interpretable strategy templates…

Multiagent Systems · Computer Science 2022-01-10 Pallavi Bagga , Nicola Paoletti , Kostas Stathis

When machine learning is outsourced to a rational agent, conflicts of interest might arise and severely impact predictive performance. In this work, we propose a theoretical framework for incentive-aware delegation of machine learning…

Machine Learning · Computer Science 2023-12-07 Eden Saig , Inbal Talgam-Cohen , Nir Rosenfeld