English
Related papers

Related papers: Optimization of Scoring Rules

200 papers

This paper develops a framework for the design of scoring rules to optimally incentivize an agent to exert a multi-dimensional effort. This framework is a generalization to strategic agents of the classical knapsack problem (cf. Briest,…

Computer Science and Game Theory · Computer Science 2023-07-03 Jason D. Hartline , Liren Shan , Yingkai Li , Yifan Wu

This paper studies the design of optimal proper scoring rules when the principal has partial knowledge of an agent's signal distribution. Recent work characterizes the proper scoring rules that maximize the increase of an agent's payoff…

Computer Science and Game Theory · Computer Science 2024-10-15 Yiling Chen , Fang-Yi Yu

I introduce a model of predictive scoring. A receiver wants to predict a sender's quality. An intermediary observes multiple features of the sender and aggregates them into a score. Based on the score, the receiver makes a decision. The…

Theoretical Economics · Economics 2024-05-17 Ian Ball

We study the design of optimal incentives in sequential processes. To do so, we consider a basic and fundamental model in which an agent initiates a value-creating sequential process through costly investment with random success. If…

Theoretical Economics · Economics 2023-11-22 Jens Gudmundsson , Jens Leth Hougaard , Juan D. Moreno-Ternero , Lars Peter Østerdal

We investigate the mechanism design problem faced by a principal who hires \emph{multiple} agents to gather and report costly information. Then, the principal exploits the information to make an informed decision. We model this problem as a…

Computer Science and Game Theory · Computer Science 2023-07-13 Federico Cacciamani , Matteo Castiglioni , Nicola Gatti

All proper scoring rules incentivize an expert to predict \emph{accurately} (report their true estimate), but not all proper scoring rules equally incentivize \emph{precision}. Rather than treating the expert's belief as exogenously given,…

Computer Science and Game Theory · Computer Science 2021-06-01 Eric Neyman , Georgy Noarov , S. Matthew Weinberg

I study the optimal design of ratings to motivate agent investment in quality when transfers are unavailable. The principal designs a rating scheme that maps the agent's quality to a (possibly stochastic) score. The agent has private…

Theoretical Economics · Economics 2025-08-11 Peiran Xiao

We study the incentivized information acquisition problem, where a principal hires an agent to gather information on her behalf. Such a problem is modeled as a Stackelberg game between the principal and the agent, where the principal…

Machine Learning · Computer Science 2023-08-08 Siyu Chen , Jibang Wu , Yifan Wu , Zhuoran Yang

Strictly proper scoring rules (SPSR) are incentive compatible for eliciting information about random variables from strategic agents when the principal can reward agents after the realization of the random variables. They also quantify the…

Computer Science and Game Theory · Computer Science 2020-06-09 Yang Liu , Juntao Wang , Yiling Chen

We study how to optimally design selection mechanisms, accounting for agents' investment incentives. A principal wishes to allocate a resource of homogeneous quality to a heterogeneous population of agents. The principal commits to a…

Theoretical Economics · Economics 2025-11-11 Victor Augias , Eduardo Perez-Richet

We study the classic principal-agent model when the signal observed by the principal is chosen by the agent. We fully characterize the optimal information structure from an agent's perspective in a general moral hazard setting with limited…

Theoretical Economics · Economics 2023-07-25 Majid Mahzoon , Ali Shourideh , Ariel Zetlin-Jones

Proper scoring rules elicit truth-telling when making predictions, or otherwise revealing information. However, when multiple predictions are made of the same event, telling the truth is in general no longer optimal, as agents are motivated…

Computer Science and Game Theory · Computer Science 2017-07-04 Amir Ban

Proper scoring rules are used to assess the out-of-sample accuracy of probabilistic forecasts, with different scoring rules rewarding distinct aspects of forecast performance. Herein, we re-investigate the practice of using proper scoring…

Scoring rules are used to evaluate the quality of predictions that take the form of probability distributions. A scoring rule is strictly proper if its expected value is uniquely minimized by the true probability distribution. One of the…

Methodology · Statistics 2021-04-05 Zoe Guan

In dynamic programming and reinforcement learning, the policy for the sequential decision making of an agent in a stochastic environment is usually determined by expressing the goal as a scalar reward function and seeking a policy that…

Artificial Intelligence · Computer Science 2025-02-26 Simon Dima , Simon Fischer , Jobst Heitzig , Joss Oliver

Scoring rules are widely used to rank athletes in sports and candidates in elections. Each position in each individual ranking is worth a certain number of points; the total sum of points determines the aggregate ranking. The question is…

Computer Science and Game Theory · Computer Science 2022-09-09 Aleksei Y. Kondratev , Egor Ianovski , Alexander S. Nesterov

We study a setting in which a principal selects an agent to execute a collection of tasks according to a specified priority sequence. Agents, however, have their own individual priority sequences according to which they wish to execute the…

Computer Science and Game Theory · Computer Science 2024-10-30 Donya G. Dobakhshari , Lav R. Varshney , Vijay Gupta

We study buyer-optimal procurement mechanisms when quality is contractible. When some costs are borne by every participant of a procurement auction regardless of winning, the classic analysis should be amended. We show that an optimal…

Theoretical Economics · Economics 2024-11-20 Pasha Andreyanov , Ilia Krasikov , Alex Suzdaltsev

We investigate cortical learning from the perspective of mechanism design. First, we show that discretizing standard models of neurons and synaptic plasticity leads to rational agents maximizing simple scoring rules. Second, our main result…

Artificial Intelligence · Computer Science 2014-01-08 David Balduzzi

Nowadays, several crowdsourcing projects exploit social choice methods for computing an aggregate ranking of alternatives given individual rankings provided by workers. Motivated by such systems, we consider a setting where each worker is…

Computer Science and Game Theory · Computer Science 2018-11-27 Ioannis Caragiannis , Xenophon Chatzigeorgiou , George A. Krimpas , Alexandros A. Voudouris
‹ Prev 1 2 3 10 Next ›