English
Related papers

Related papers: Exploration and Incentivizing Participation in Ran…

200 papers

We consider schemes for obtaining truthful reports on a common but hidden signal from large groups of rational, self-interested agents. One example are online feedback mechanisms, where users provide observations about the quality of a…

Computer Science and Game Theory · Computer Science 2014-01-16 Radu Jurca , Boi Faltings

We consider a team of reinforcement learning agents that concurrently learn to operate in a common environment. We identify three properties - adaptivity, commitment, and diversity - which are necessary for efficient coordinated exploration…

Artificial Intelligence · Computer Science 2018-12-18 Maria Dimakopoulou , Benjamin Van Roy

Challenge Theory (CT), a new approach to decision under risk departs significantly from expected utility, and is based on firmly psychological, rather than economic, assumptions. The paper demonstrates that a purely cognitive-psychological…

General Economics · Economics 2019-10-11 Samuel Shye , Ido Haber

Is there a canonical way to think of agency beyond reward maximisation? In this paper, we show that any type of behaviour complying with physically sound assumptions about how macroscopic biological agents interact with the world…

Artificial Intelligence · Computer Science 2024-01-24 Lancelot Da Costa , Samuel Tenka , Dominic Zhao , Noor Sajid

We study an online resource allocation problem under uncertainty about demand and about the reward of each type of demand (agents) for the resource. Even though dealing with demand uncertainty in resource allocation problems has been the…

Optimization and Control · Mathematics 2022-10-11 Negin Gorlezaei , Patrick Jaillet , Zijie Zhou

Agents are systems that optimize an objective function in an environment. Together, the goal and the environment induce secondary objectives, incentives. Modeling the agent-environment interaction using causal influence diagrams, we can…

Artificial Intelligence · Computer Science 2022-01-21 Tom Everitt , Pedro A. Ortega , Elizabeth Barnes , Shane Legg

Construction of just-in-time adaptive interventions, such as prompts delivered by mobile apps to promote and maintain behavioral change, requires knowledge about time-varying moderated effects to inform when and how we deliver intervention…

Methodology · Statistics 2022-12-06 Jieru Shi , Zhenke Wu , Walter Dempsey

In randomized clinical trials, adjustments for baseline covariates at both design and analysis stages are highly encouraged by regulatory agencies. A recent trend is to use a model-assisted approach for covariate adjustment to gain…

Methodology · Statistics 2021-07-14 Ting Ye , Jun Shao , Yanyao Yi , Qingyuan Zhao

To regulate a social system comprised of self-interested agents, economic incentives are often required to induce a desirable outcome. This incentive design problem naturally possesses a bilevel structure, in which a designer modifies the…

Computer Science and Game Theory · Computer Science 2022-10-14 Boyi Liu , Jiayang Li , Zhuoran Yang , Hoi-To Wai , Mingyi Hong , Yu Marco Nie , Zhaoran Wang

In this paper, we study belief elicitation about an uncertain future event, where the reports will affect a principal's decision. We study two problems that can arise in this setting: (1) Agents may have an interest in the outcome of the…

Computer Science and Game Theory · Computer Science 2023-03-01 Manuel Wuthrich , Mark York , David C. Parkes

Randomised Controlled Trials (RCTs) are the gold standard for estimating treatment effects across many fields of science. Technology companies have adopted A/B-testing methods as a modern RCT counterpart, where end-users are randomly…

Social and Information Networks · Computer Science 2024-09-20 Olivier Jeunen

Understanding the emergence of cooperation in systems of computational agents is crucial for the development of effective cooperative AI. Interaction among individuals in real-world settings are often sparse and occur within a broad…

Multiagent Systems · Computer Science 2024-01-24 Nicole Orzan , Erman Acar , Davide Grossi , Roxana Rădulescu

Online platforms in the Internet Economy commonly incorporate recommender systems that recommend products (or "arms") to users (or "agents"). A key challenge in this domain arises from myopic agents who are naturally incentivized to exploit…

Information Retrieval · Computer Science 2024-06-19 Xiaowu Dai , Wenlu Xu , Yuan Qi , Michael I. Jordan

We study the design of optimal incentives in sequential processes. To do so, we consider a basic and fundamental model in which an agent initiates a value-creating sequential process through costly investment with random success. If…

Theoretical Economics · Economics 2023-11-22 Jens Gudmundsson , Jens Leth Hougaard , Juan D. Moreno-Ternero , Lars Peter Østerdal

Motivated by modern applications such as computerized adaptive testing, sequential rank aggregation, and heterogeneous data source selection, we study the problem of active sequential estimation, which involves adaptively selecting…

Statistics Theory · Mathematics 2024-02-14 Xiaoou Li , Hongru Zhao

Amidst rising appreciation for privacy and data usage rights, researchers have increasingly acknowledged the principle of data minimization, which holds that the accessibility, collection, and retention of subjects' data should be kept to…

Cryptography and Security · Computer Science 2021-10-22 Winston Chou

Explore-and-exploit tradeoffs play a key role in recommendation systems (RSs), aiming at serving users better by learning from previous interactions. Despite their commercial success, the societal effects of explore-and-exploit mechanisms…

Computer Science and Game Theory · Computer Science 2025-02-19 Omer Ben-Porat , Yotam Gafni , Or Markovetzki

Algorithmic Recourse aims to provide actionable explanations, or recourse plans, to overturn potentially unfavourable decisions taken by automated machine learning models. In this paper, we propose an interaction paradigm based on a guided…

Human-Computer Interaction · Computer Science 2024-07-22 Seyedehdelaram Esfahani , Giovanni De Toni , Bruno Lepri , Andrea Passerini , Katya Tentori , Massimo Zancanaro

Machine learning (ML) models are increasingly used as decision-support tools in high-risk domains. Evaluating the causal impact of deploying such models can be done with a randomized controlled trial (RCT) that randomizes users to ML vs.…

Methodology · Statistics 2025-07-17 Jacob M. Chen , Michael Oberst

The application of incentives, such as reward and punishment, is a frequently applied way for promoting cooperation among interacting individuals in structured populations. However, how to properly use the incentives is still a challenging…

Computer Science and Game Theory · Computer Science 2024-04-24 Shengxian Wang , Xiaojie Chen , Zhilong Xiao , Attila Szolnoki , Vítor V. Vasconcelos