English
Related papers

Related papers: Accelerator and Brake: Dynamic Persuasion with Dea…

200 papers

In a decision-making scenario, a principal could use conditional predictions from an expert agent to inform their choice. However, this approach would introduce a fundamental conflict of interest. An agent optimizing for predictive accuracy…

Machine Learning · Computer Science 2024-12-31 Rubi Hudson

Reinforcement learning (RL) agents optimize only the features specified in a reward function and are indifferent to anything left out inadvertently. This means that we must not only specify what to do, but also the much larger space of what…

Machine Learning · Computer Science 2019-04-22 Rohin Shah , Dmitrii Krasheninnikov , Jordan Alexander , Pieter Abbeel , Anca Dragan

This study explores strategies for optimizing news headline recommendations through preference-based learning. Using real-world data of user interactions with French-language online news posts, we learn a headline recommender agent under a…

Information Retrieval · Computer Science 2025-06-10 Alexandre Bouras , Audrey Durand , Richard Khoury

Trajectory prediction is an essential step in the pipeline of an autonomous vehicle. Inaccurate or inconsistent predictions regarding the movement of agents in its surroundings lead to poorly planned maneuvers and potentially dangerous…

Machine Learning · Computer Science 2025-07-04 Caio Azevedo , Lina Achaji , Stefano Sabatini , Nicola Poerio , Grzegorz Bartyzel , Sascha Hornauer , Fabien Moutarde

User preference learning is generally a hard problem. Individual preferences are typically unknown even to users themselves, while the space of choices is infinite. Here we study user preference learning from information-theoretic…

Machine Learning · Computer Science 2023-11-27 Tanya Ignatenko , Kirill Kondrashov , Marco Cox , Bert de Vries

In a classical optimal stopping problem in continuous time, the agent can choose any stopping time without constraint. Dupuis and Wang (Optimal stopping with random intervention times, Advances in Applied Probability, 34, 141--157, 2002)…

Probability · Mathematics 2019-01-23 David Hobson , Matthew Zeng

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

Machine Learning · Computer Science 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

Biological systems often choose actions without an explicit reward signal, a phenomenon known as intrinsic motivation. The computational principles underlying this behavior remain poorly understood. In this study, we investigate an…

Artificial Intelligence · Computer Science 2023-01-05 Stas Tiomkin , Ilya Nemenman , Daniel Polani , Naftali Tishby

Learning how to learn efficiently is a fundamental challenge for biological agents and a growing concern for artificial ones. To learn effectively, an agent must regulate its learning speed, balancing the benefits of rapid improvement…

Machine Learning · Computer Science 2026-01-13 Valentina Njaradi , Rodrigo Carrasco-Davis , Peter E. Latham , Andrew Saxe

We study a variant of the principal-agent problem in which the principal does not directly observe the agent's effort outcome; rather, she gets a signal about the agent's action according to a variable information structure designed by a…

Computer Science and Game Theory · Computer Science 2024-09-06 Yakov Babichenko , Inbal Talgam-Cohen , Haifeng Xu , Konstantin Zabarnyi

A principal delegates choice to an agent whose decision depends on both beliefs and tastes. The principal can steer the delegated decision using two costly instruments: (i) an information policy that determines a Bayes--plausible…

Theoretical Economics · Economics 2026-02-12 Kemal Ozbek

We study the design of information acquisition games-environments where a designer contracts their action on Sender's choice of experiment and the realized signals about some state-and identify which predictions can be made absent knowledge…

Theoretical Economics · Economics 2026-01-22 Eric Gao , Daniel Luo

In this article, we explore the feasibility of applying proximal policy optimization, a state-of-the-art deep reinforcement learning algorithm for continuous control tasks, on the dual-objective problem of controlling an underactuated…

Machine Learning · Computer Science 2019-12-20 Eivind Meyer , Haakon Robinson , Adil Rasheed , Omer San

In principal-agent models, a principal offers a contract to an agent to perform a certain task. The agent exerts a level of effort that maximizes her utility. The principal is oblivious to the agent's chosen level of effort, and conditions…

Computer Science and Game Theory · Computer Science 2022-07-14 Alon Cohen , Moran Koren , Argyrios Deligkas

How should an agent (the sender) observing multi-dimensional data (the state vector) persuade another agent to take the desired action? We show that it is always optimal for the sender to perform a (non-linear) dimension reduction by…

Machine Learning · Statistics 2022-10-05 Semyon Malamud , Andreas Schrimpf

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes…

Computer Science and Game Theory · Computer Science 2019-11-15 Federico Echenique , Siddharth Prasad

We consider a continuous time Principal-Agent model on a finite time horizon, where we look for the existence of an optimal contract both parties agreed on. Contrary to the main stream, where the principal is modelled as risk-neutral, we…

Optimization and Control · Mathematics 2018-06-06 Kerem Ugurlu

Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and…

We introduce data-driven decision-making algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary bandit settings. These settings capture applications such as advertisement allocation, dynamic pricing, and…

Machine Learning · Computer Science 2021-03-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

A principal and an agent face symmetric uncertainty about the value of two correlated projects for the agent. The principal chooses which project values to publicly discover and makes a proposal to the agent, who accepts if and only if the…

Theoretical Economics · Economics 2022-11-22 Eitan Sapiro-Gheiler