English
Related papers

Related papers: Deep Incentive Design with Differentiable Equilibr…

200 papers

With the rising emergence of decentralized and opportunistic approaches to machine learning, end devices are increasingly tasked with training deep learning models on-devices using crowd-sourced data that they collect themselves. These…

Machine Learning · Computer Science 2023-04-12 Haoxiang Yu , Hsiao-Yuan Chen , Sangsu Lee , Sriram Vishwanath , Xi Zheng , Christine Julien

We consider decentralized restless multi-armed bandit problems with unknown dynamics and multiple players. The reward state of each arm transits according to an unknown Markovian rule when it is played and evolves according to an arbitrary…

Optimization and Control · Mathematics 2011-02-16 Haoyang Liu , Keqin Liu , Qing Zhao

Dynamic difficulty adjustment ($DDA$) is a process of automatically changing a game difficulty for the optimization of user experience. It is a vital part of almost any modern game. Most existing DDA approaches concentrate on the experience…

Machine Learning · Computer Science 2021-06-08 Dvir Ben Or , Michael Kolomenkin , Gil Shabat

We apply control theoretic and optimization techniques to adaptively design incentives. In particular, we consider the problem of a planner with an objective that depends on data from strategic decision makers. The planner does not know the…

Computer Science and Game Theory · Computer Science 2018-06-18 Lillian J. Ratliff , Tanner Fiez

Incentive design problems consider a system planner who steers self-interested agents toward a socially optimal Nash equilibrium by issuing incentives in the presence of information asymmetry, that is, uncertainty about the agents' cost…

Optimization and Control · Mathematics 2026-04-14 Georgios Vasileiou , Lantian Zhang , Silun Zhang

In practice, incentive providers (i.e., principals) often cannot observe the reward realizations of incentivized agents, which is in contrast to many principal-agent models that have been previously studied. This information asymmetry…

Machine Learning · Computer Science 2023-08-15 Ilgin Dogan , Zuo-Jun Max Shen , Anil Aswani

Recent work by Foster et al. (2021, 2022, 2023b) and Xu and Zeevi (2023) developed the framework of decision estimation coefficient (DEC) that characterizes the complexity of general online decision making problems and provides a general…

Machine Learning · Computer Science 2025-05-02 Haolin Liu , Chen-Yu Wei , Julian Zimmert

We train two neural networks adversarially to play static games. At each iteration, a row and column network observe a new random bimatrix game and output individual mixed strategies. The parameters of each network are independently updated…

Theoretical Economics · Economics 2025-05-09 Daniele Condorelli , Massimiliano Furlan

Decision-making problems are commonly formulated as optimization problems, which are then solved to make optimal decisions. In this work, we consider the inverse problem where we use prior decision data to uncover the underlying…

Optimization and Control · Mathematics 2022-12-27 Rishabh Gupta , Qi Zhang

As the dimension of a system increases, traditional methods for control and differential games rapidly become intractable, making the design of safe autonomous agents challenging in complex or team settings. Deep-learning approaches avoid…

Optimization and Control · Mathematics 2025-04-29 William Sharpless , Zeyuan Feng , Somil Bansal , Sylvia Herbert

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes…

Computer Science and Game Theory · Computer Science 2019-11-15 Federico Echenique , Siddharth Prasad

The design of punishment policies applied to specific domains linking agents actions to material penalties is an open research issue. The proposed framework applies principles of contract law to set penalties: expectation damages,…

Multiagent Systems · Computer Science 2013-04-23 Adrian Groza

Designing reward functions for efficiently guiding reinforcement learning (RL) agents toward specific behaviors is a complex task. This is challenging since it requires the identification of reward structures that are not sparse and that…

Machine Learning · Computer Science 2023-11-01 Dhawal Gupta , Yash Chandak , Scott M. Jordan , Philip S. Thomas , Bruno Castro da Silva

In fighting games, individual players of the same skill level often exhibit distinct strategies from one another through their gameplay. Despite this, the majority of AI agents for fighting games have only a single strategy for each "level"…

Machine Learning · Computer Science 2022-11-08 Emily Halina , Matthew Guzdial

Balancing game difficulty in video games is a key task to create interesting gaming experiences for players. Mismatching the game difficulty and a player's skill or commitment results in frustration or boredom on the player's side, and…

Artificial Intelligence · Computer Science 2024-08-14 Ronja Fuchs , Robin Gieseke , Alexander Dockhorn

Deep equilibrium models (DEQs) refrain from the traditional layer-stacking paradigm and turn to find the fixed point of a single layer. DEQs have achieved promising performance on different applications with featured memory efficiency. At…

Machine Learning · Computer Science 2023-06-05 Zonghan Yang , Tianyu Pang , Yang Liu

We consider the interaction among agents engaging in a driving task and we model it as general-sum game. This class of games exhibits a plurality of different equilibria posing the issue of equilibrium selection. While selecting the most…

This work considers a novel information design problem and studies how the craft of payoff-relevant environmental signals solely can influence the behaviors of intelligent agents. The agents' strategic interactions are captured by a Markov…

Multiagent Systems · Computer Science 2021-06-15 Tao Zhang , Quanyan Zhu

We consider the problem of designing incentive-compatible, ex-post individually rational (IR) mechanisms for covering problems in the Bayesian setting, where players' types are drawn from an underlying distribution and may be correlated,…

Computer Science and Game Theory · Computer Science 2016-09-30 Hadi Minooei , Chaitanya Swamy

We address Stackelberg models of combinatorial congestion games (CCGs); we aim to optimize the parameters of CCGs so that the selfish behavior of non-atomic players attains desirable equilibria. This model is essential for designing such…

Computer Science and Game Theory · Computer Science 2021-10-19 Shinsaku Sakaue , Kengo Nakamura