English
Related papers

Related papers: Incentive design for learning in user-recommendati…

200 papers

As machine learning algorithms increasingly influence critical decision making in different application areas, understanding human strategic behavior in response to these systems becomes vital. We explore individuals' choice between…

Machine Learning · Computer Science 2026-03-17 Sura Alhanouti , Parinaz Naghizadeh

We study the design of optimal incentives in sequential processes. To do so, we consider a basic and fundamental model in which an agent initiates a value-creating sequential process through costly investment with random success. If…

Theoretical Economics · Economics 2023-11-22 Jens Gudmundsson , Jens Leth Hougaard , Juan D. Moreno-Ternero , Lars Peter Østerdal

Recommender system has been deployed in a large amount of real-world applications, profoundly influencing people's daily life and production.Traditional recommender models mostly collect as comprehensive as possible user behaviors for…

Information Retrieval · Computer Science 2022-11-03 Lei Wang , Xu Chen , Quanyu Dai , Zhenhua Dong

Many smart grid frameworks, such as demand response programs, require accurate information about consumers' parameters (e.g., flexibility) at the aggregator side to optimize grid operations. Existing works typically rely on perfect…

Computer Science and Game Theory · Computer Science 2026-03-05 Hassan Mohamad , Chao Zhang , Samson Lasaulce , Olivier Beaude , Vineeth Satheeskumar Varma , Mounir Ghogho , Vincent Poor

A contextual bandit problem is studied in a highly non-stationary environment, which is ubiquitous in various recommender systems due to the time-varying interests of users. Two models with disjoint and hybrid payoffs are considered to…

Machine Learning · Computer Science 2020-03-03 Xiao Xu , Fang Dong , Yanghua Li , Shaojian He , Xin Li

We study decentralized equilibrium selection in stochastic games under severe information and communication constraints. In such settings, convergence to equilibrium alone is insufficient, as stochastic games typically admit many equilibria…

Computer Science and Game Theory · Computer Science 2026-02-16 Seref Taha Kiremitci , Ahmed Said Donmez , Muhammed O. Sayin

For a real-world decision-making problem, the reward function often needs to be engineered or learned. A popular approach is to utilize human feedback to learn a reward function for training. The most straightforward way to do so is to ask…

Machine Learning · Computer Science 2023-10-31 Xiang Ji , Huazheng Wang , Minshuo Chen , Tuo Zhao , Mengdi Wang

Many real-world systems such as taxi systems, traffic networks and smart grids involve self-interested actors that perform individual tasks in a shared environment. However, in such systems, the self-interested behaviour of agents produces…

Multiagent Systems · Computer Science 2019-01-31 David Mguni , Joel Jennings , Sergio Valcarcel Macua , Emilio Sison , Sofia Ceppi , Enrique Munoz de Cote

When developing reinforcement learning agents, the standard approach is to train an agent to converge to a fixed policy that is as close to optimal as possible for a single fixed reward function. If different agent behaviour is required in…

Multiagent Systems · Computer Science 2021-01-29 David O'Callaghan , Patrick Mannion

Markovian processes have long been used to model stochastic environments. Reinforcement learning has emerged as a framework to solve sequential planning and decision-making problems in such environments. In recent years, attempts were made…

Artificial Intelligence · Computer Science 2014-01-17 Mahdi Milani Fard , Joelle Pineau

In this paper, we investigate discrete-time decision-making problems in uncertain systems with partially observed states. We consider a non-stochastic model, where uncontrolled disturbances acting on the system take values in bounded sets…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos

We study an online learning version of the generalized principal-agent model, where a principal interacts repeatedly with a strategic agent possessing private types, private rewards, and taking unobservable actions. The agent is non-myopic,…

Machine Learning · Computer Science 2025-06-11 Yuchen Wu , Xinyi Zhong , Zhuoran Yang

We characterize the optimal reward functions (scoring rules) that incentivize an agent to acquire information and report it truthfully to the principal. The optimal scoring rules let the agent make a simple binary bet in single-dimensional…

Computer Science and Game Theory · Computer Science 2025-10-03 Jason D. Hartline , Yingkai Li , Liren Shan , Yifan Wu

We study a repeated information design problem faced by an informed sender who tries to influence the behavior of a self-interested receiver. We consider settings where the receiver faces a sequential decision making (SDM) problem. At each…

Machine Learning · Computer Science 2022-09-09 Martino Bernasconi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti , Francesco Trovo

This paper presents an online method that learns optimal decisions for a discrete time Markov decision problem with an opportunistic structure. The state at time $t$ is a pair $(S(t),W(t))$ where $S(t)$ takes values in a finite set…

Optimization and Control · Mathematics 2024-08-13 Michael J. Neely

Evidence-based decision-making entails collecting (costly) observations about an underlying phenomenon of interest, and subsequently committing to an (informed) decision on the basis of accumulated evidence. In this setting, active sensing…

Machine Learning · Statistics 2020-06-26 Daniel Jarrett , Mihaela van der Schaar

We consider an infinite collection of agents who make decisions, sequentially, about an unknown underlying binary state of the world. Each agent, prior to making a decision, receives an independent private signal whose distribution depends…

Computer Science and Game Theory · Computer Science 2012-09-07 Kimon Drakopoulos , Asuman Ozdaglar , John Tsitsiklis

We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal. This class of learning problems is difficult because of the often large combined action and observation spaces. In the fully…

Many real-life decisions involve both perceptual processes and weighing the consequences of different actions. However, the neural mechanisms underlying perceptual decisions have typically been examined separately from those underlying…

Neurons and Cognition · Quantitative Biology 2025-02-07 Xiaoyue Zhu , Jeffrey C. Erlich

We study the problem of allocating $T$ sequentially arriving items among $n$ homogeneous agents under the constraint that each agent must receive a pre-specified fraction of all items, with the objective of maximizing the agents' total…

Computer Science and Game Theory · Computer Science 2022-09-27 Steven Yin , Shipra Agrawal , Assaf Zeevi