English
Related papers

Related papers: Algorithmic Contract Design with Reinforcement Lea…

200 papers

A contract is an economic tool used by a principal to incentivize one or more agents to exert effort on her behalf, by defining payments based on observable performance measures. A key challenge addressed by contracts -- known in economics…

Computer Science and Game Theory · Computer Science 2024-12-24 Paul Duetting , Michal Feldman , Inbal Talgam-Cohen

The deployment of multi-agent systems in dynamic, adversarial environments like robotic soccer necessitates real-time decision-making, sophisticated cooperation, and scalable algorithms to avoid the curse of dimensionality. While…

Robotics · Computer Science 2025-12-04 Aya Taourirte , Md Sohag Mia

Cooperative Multi-Agent Reinforcement Learning (MARL) faces two major design bottlenecks: crafting dense reward functions and constructing curricula that avoid local optima in high-dimensional, non-stationary environments. Existing…

Machine Learning · Computer Science 2025-12-11 Boyuan Wu

The study of online algorithms with machine-learned predictions has gained considerable prominence in recent years. One of the common objectives in the design and analysis of such algorithms is to attain (Pareto) optimal tradeoffs between…

Machine Learning · Computer Science 2024-08-09 Spyros Angelopoulos , Christoph Dürr , Alex Elenter , Yanni Lefki

We study a natural combinatorial single-principal multi-agent contract design problem, in which a principal motivates a team of agents to exert effort toward a given task. At the heart of our model is a reward function, which maps the agent…

Computer Science and Game Theory · Computer Science 2026-03-04 Paul Duetting , Tomer Ezra , Michal Feldman , Thomas Kesselheim

Multi-objective reinforcement learning (MORL) excels at handling rapidly changing preferences in tasks that involve multiple criteria, even for unseen preferences. However, previous dominating MORL methods typically generate a fixed policy…

Machine Learning · Computer Science 2025-05-09 Ruohong Liu , Yuxin Pan , Linjie Xu , Lei Song , Jiang Bian , Pengcheng You , Yize Chen

Algorithmic contract design studies scenarios where a principal incentivizes an agent to exert effort on her behalf. In this work, we focus on settings where the agent's type is drawn from an unknown distribution, and formalize an offline…

Computer Science and Game Theory · Computer Science 2025-01-27 Paul Duetting , Michal Feldman , Tomasz Ponitka , Ermis Soumalias

This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in…

Machine Learning · Computer Science 2020-06-23 Ruben Solozabal , Josu Ceberio , Martin Takáč

Multi-Robot-Arm Motion Planning (M-RAMP) is a challenging problem featuring complex single-agent planning and multi-agent coordination. Recent advancements in extending the popular Conflict-Based Search (CBS) algorithm have made large…

Robotics · Computer Science 2024-07-30 Yorai Shaoul , Rishi Veerapaneni , Maxim Likhachev , Jiaoyang Li

We present the first study on provably efficient randomized exploration in cooperative multi-agent reinforcement learning (MARL). We propose a unified algorithm framework for randomized exploration in parallel Markov Decision Processes…

Machine Learning · Computer Science 2025-03-04 Hao-Lun Hsu , Weixin Wang , Miroslav Pajic , Pan Xu

We study a Bayesian contract design problem in which a principal interacts with an unknown agent. We consider the single-parameter uncertainty model introduced by Alon et al. [2021], in which the agent's type is described by a single…

Computer Science and Game Theory · Computer Science 2025-02-21 Martino Bernasconi , Matteo Castiglioni , Andrea Celli

Expensive multi-objective optimization problems can be found in many real-world applications, where their objective function evaluations involve expensive computations or physical experiments. It is desirable to obtain an approximate Pareto…

Neural and Evolutionary Computing · Computer Science 2022-10-18 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang

We consider the robust contract design problem when the principal only has limited information about the actions the agent can take. The principal evaluates a contract according to its worst-case performance caused by the uncertain action…

Theoretical Economics · Economics 2024-06-18 Bo Peng , Zhihao Gavin Tang

A large amount of work has been done in Multi-Agent Systems (MAS) for modeling and solving problems with multiple interacting agents. However, most LLMs are pretrained independently and not specifically optimized for coordination. Existing…

Artificial Intelligence · Computer Science 2025-12-10 Shuo Liu , Tianle Chen , Zeyu Liang , Xueguang Lyu , Christopher Amato

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

This work studies the online contract design problem. The principal's goal is to learn the optimal contract that maximizes her utility through repeated interactions, without prior knowledge of the agent's type (i.e., the agent's cost and…

Computer Science and Game Theory · Computer Science 2025-06-11 Shiliang Zuo

Combinatorial contracts are emerging as a key paradigm in algorithmic contract design, paralleling the role of combinatorial auctions in algorithmic mechanism design. In this paper we study natural combinatorial contract settings involving…

Computer Science and Game Theory · Computer Science 2024-05-15 Paul Duetting , Tomer Ezra , Michal Feldman , Thomas Kesselheim

We consider the problem of constrained multi-objective blackbox optimization using expensive function evaluations, where the goal is to approximate the true Pareto set of solutions satisfying a set of constraints while minimizing the number…

Machine Learning · Computer Science 2020-11-24 Syrine Belakaria , Aryan Deshwal , Janardhan Rao Doppa

Real-time bidding (RTB) is an important mechanism in online display advertising, where a proper bid for each page view plays an essential role for good marketing results. Budget constrained bidding is a typical scenario in RTB where the…

Artificial Intelligence · Computer Science 2018-10-24 Di Wu , Xiujun Chen , Xun Yang , Hao Wang , Qing Tan , Xiaoxun Zhang , Jian Xu , Kun Gai

Reinforcement learning (RL) has emerged as a powerful approach for tackling complex problems. The recent introduction of multi-objective reinforcement learning (MORL) has further expanded the scope of RL by enabling agents to make…

Machine Learning · Computer Science 2023-10-26 Florian Felten , Daniel Gareev , El-Ghazali Talbi , Grégoire Danoy