English
Related papers

Related papers: Learning from Manipulable Signals

200 papers

A principal who values an object allocates it to one or more agents. Agents learn private information (signals) from an information designer about the allocation payoff to the principal. Monetary transfer is not available but the principal…

Theoretical Economics · Economics 2022-10-31 Yi-Chun Chen , Gaoji Hu , Xiangqian Yang

In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this…

Artificial Intelligence · Computer Science 2019-10-25 Haifeng Zhang , Jun Wang , Zhiming Zhou , Weinan Zhang , Ying Wen , Yong Yu , Wenxin Li

General purpose intelligent learning agents cycle through (complex,non-MDP) sequences of observations, actions, and rewards. On the other hand, reinforcement learning is well-developed for small finite state Markov Decision Processes…

Artificial Intelligence · Computer Science 2009-12-30 Marcus Hutter

We study optimal dynamic persuasion in a bandit experimentation model where a principal, unlike in standard settings, has a single-peaked preference over the agent's stopping time. This non-monotonic preference arises because maximizing the…

Theoretical Economics · Economics 2026-03-24 Zhuo Chen , Yun Liu

We study the problem of online learning in two-sided non-stationary matching markets, where the objective is to converge to a stable match. In particular, we consider the setting where one side of the market, the arms, has fixed known set…

Machine Learning · Computer Science 2023-01-16 Deepan Muthirayan , Chinmay Maheshwari , Pramod P. Khargonekar , Shankar Sastry

We investigate the problem of learning an equilibrium in a generalized two-sided matching market, where agents can adaptively choose their actions based on their assigned matches. Specifically, we consider a setting in which matched agents…

Machine Learning · Computer Science 2025-06-05 Andreas Athanasopoulos , Christos Dimitrakakis

This paper introduces a high-order Markov chain task to investigate how transformers learn to integrate information from multiple past positions with varying statistical significance. We demonstrate that transformers learn this task…

Machine Learning · Computer Science 2026-02-24 Oğuz Kaan Yüksel , Rodrigo Alvarez Lucendo , Nicolas Flammarion

In this paper, we study multi-agent network games subject to affine time-varying coupling constraints and a time-varying communication network. We focus on the class of games adopting proximal dynamics and study their convergence to a…

Computer Science and Game Theory · Computer Science 2019-11-20 Carlo Cenedese , Giuseppe Belgioioso , Sergio Grammatico , Ming Cao

In this paper we consider a principal agent problem where the agent is allowed to quit, by incurring a cost. When the current agent quits the job, the principal will hire a new one, possibly with a different type. We characterize the…

Optimization and Control · Mathematics 2024-09-04 Jianfeng Zhang , Zimu Zhu

We consider the learning dynamics of a single reinforcement learning optimal execution trading agent when it interacts with an event driven agent-based financial market model. Trading takes place asynchronously through a matching engine in…

Trading and Market Microstructure · Quantitative Finance 2023-11-23 Matthew Dicks , Andrew Paskaramoorthy , Tim Gebbie

We explore unconstrained natural language feedback as a learning signal for artificial agents. Humans use rich and varied language to teach, yet most prior work on interactive learning from language assumes a particular form of input (e.g.,…

Artificial Intelligence · Computer Science 2021-07-06 Theodore R. Sumers , Mark K. Ho , Robert D. Hawkins , Karthik Narasimhan , Thomas L. Griffiths

Reinforcement learning (RL) is inspired by the way human infants and animals learn from the environment. The setting is somewhat idealized because, in actual tasks, other agents in the environment have their own goals and behave adaptively…

Computer Science and Game Theory · Computer Science 2023-10-31 Yue Lin , Wenhao Li , Hongyuan Zha , Baoxiang Wang

When deploying autonomous agents in the real world, we need effective ways of communicating objectives to them. Traditional skill learning has revolved around reinforcement and imitation learning, each with rigid constraints on the format…

Artificial Intelligence · Computer Science 2019-11-21 Mark Woodward , Chelsea Finn , Karol Hausman

We consider sequential search by an agent who cannot observe the quality of goods but can acquire information by buying signals from a profit-maximizing principal with limited commitment power. The principal can charge higher prices for…

Theoretical Economics · Economics 2024-08-13 Teddy Mekonnen , Zeky Murra-Anton , Bobak Pakzad-Hurson

This paper looks at predictability problems, i.e., wherein an agent must choose its strategy in order to optimize the predictions that an external observer could make. We address these problems while taking into account uncertainties on the…

Artificial Intelligence · Computer Science 2024-10-08 Salomé Lepers , Sophie Lemonnier , Vincent Thomas , Olivier Buffet

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2015-03-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell

In this paper, we consider a learning problem among non-cooperative agents interacting in a time-varying system. Specifically, we focus on repeated linear quadratic network games, in which the network of interactions changes with time and…

Computer Science and Game Theory · Computer Science 2023-10-23 Feras Al Taha , Kiran Rokade , Francesca Parise

We study the voting game where agents' preferences are endogenously decided by the information they receive, and they can collaborate in a group. We show that strategic voting behaviors have a positive impact on leading to the ``correct''…

Computer Science and Game Theory · Computer Science 2023-05-23 Qishen Han , Grant Schoenebeck , Biaoshuai Tao , Lirong Xia

Many large-scale platforms and networked control systems have a centralized decision maker interacting with a massive population of agents under strict observability constraints. Motivated by such applications, we study a cooperative Markov…

Multiagent Systems · Computer Science 2026-05-12 Emile Anand , Ishani Karmarkar

Observable social traits determine how we interact in society and remain pervasive even in our globalized world. While a popular hypothesis states that they may help promote cooperation, the alternative explanation that they facilitate…

Physics and Society · Physics 2020-09-14 Juan Ozaita , Andrea Baronchelli , Angel Sánchez