English
Related papers

Related papers: Carrot and Stick: Eliciting Comparison Data and Be…

200 papers

Bilateral bargaining under incomplete information provides a controlled testbed for evaluating large language model (LLM) agent capabilities. Bilateral trade demands individual rationality, strategic surplus maximization, and cooperation to…

Computer Science and Game Theory · Computer Science 2026-04-21 Dirk Bergemann , Soheil Ghili , Xinyang Hu , Chuanhao Li , Zhuoran Yang

We address the fundamental problem of selection under uncertainty by modeling it from the perspective of Bayesian persuasion. In our model, a decision maker with imperfect information always selects the option with the highest expected…

Computer Science and Game Theory · Computer Science 2024-10-16 Siddhartha Banerjee , Kamesh Munagala , Yiheng Shen , Kangning Wang

Pricing decisions of companies require an understanding of the causal effect of a price change on the demand. When real-life pricing experiments are infeasible, data-driven decision-making must be based on alternative data sources such as…

Applications · Statistics 2024-07-03 Lauri Valkonen , Santtu Tikka , Jouni Helske , Juha Karvanen

This paper studies the problem of finding the exact ranking from noisy comparisons. A comparison over a set of $m$ items produces a noisy outcome about the most preferred item, and reveals some information about the ranking. By repeatedly…

Machine Learning · Computer Science 2021-07-30 Wenbo Ren , Jia Liu , Ness B. Shroff

In this paper, we study belief elicitation about an uncertain future event, where the reports will affect a principal's decision. We study two problems that can arise in this setting: (1) Agents may have an interest in the outcome of the…

Computer Science and Game Theory · Computer Science 2023-03-01 Manuel Wuthrich , Mark York , David C. Parkes

Most existing work on automated fact checking is concerned with predicting the veracity of claims based on metadata, social network spread, language used in claims, and, more recently, evidence supporting or denying claims. A crucial piece…

Computation and Language · Computer Science 2020-04-14 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

Comparative reasoning is a process of comparing objects, concepts, or entities to draw conclusions, which constitutes a fundamental cognitive ability. In this paper, we propose a novel framework to pre-train language models for enhancing…

Computation and Language · Computer Science 2023-11-29 Mengxia Yu , Zhihan Zhang , Wenhao Yu , Meng Jiang

In this work, we empirically examine human-AI decision-making in the presence of explanations based on predicted outcomes. This type of explanation provides a human decision-maker with expected consequences for each decision alternative at…

Human-Computer Interaction · Computer Science 2022-08-31 Johannes Jakubik , Jakob Schöffer , Vincent Hoge , Michael Vössing , Niklas Kühl

Rankings are the primary interface through which many online platforms match users to items (e.g. news, products, music, video). In these two-sided markets, not only the users draw utility from the rankings, but the rankings also determine…

Information Retrieval · Computer Science 2020-06-01 Marco Morik , Ashudeep Singh , Jessica Hong , Thorsten Joachims

Reward models (RMs) are a crucial component in the alignment of large language models' (LLMs) outputs with human values. RMs approximate human preferences over possible LLM responses to the same prompt by predicting and comparing reward…

Machine Learning · Computer Science 2025-02-27 Junqi Jiang , Tom Bewley , Saumitra Mishra , Freddy Lecue , Manuela Veloso

Machine learning systems are increasingly being used to make impactful decisions such as loan applications and criminal justice risk assessments, and as such, ensuring fairness of these systems is critical. This is often challenging as the…

Machine Learning · Computer Science 2020-12-18 YooJung Choi , Meihua Dang , Guy Van den Broeck

The use of hypothetical instead of real decision-making incentives remains under debate after decades of economic experiments. Standard incentivized experiments involve substantial monetary costs due to participants' earnings and often…

Physics and Society · Physics 2025-03-19 Pablo Brañas-Garza , Diego Jorrat , Antonio M. Espín , Angel Sánchez

A "statistician" takes an action on behalf of an agent, based on the agent's self-reported personal data and a sample involving other people. The action that he takes is an estimated function of the agent's report. The estimation procedure…

Theoretical Economics · Economics 2018-10-09 Kfir Eliaz , Ran Spiegler

Ensuring long-term fairness is crucial when developing automated decision making systems, specifically in dynamic and sequential environments. By maximizing their reward without consideration of fairness, AI agents can introduce disparities…

Machine Learning · Computer Science 2025-01-03 Sahand Rezaei-Shoshtari , Hanna Yurchyk , Scott Fujimoto , Doina Precup , David Meger

In this work, we address the challenge of data-efficient exploration in reinforcement learning by examining existing principled, information-theoretic approaches to intrinsic motivation. Specifically, we focus on a class of exploration…

Machine Learning · Computer Science 2025-07-04 Alberto Caron , Chris Hicks , Vasilios Mavroudis

Reward Models (RMs) are crucial for online alignment of language models (LMs) with human preferences. However, RM-based preference-tuning is vulnerable to reward hacking, whereby LM policies learn undesirable behaviors from flawed RMs. By…

Computation and Language · Computer Science 2026-03-05 Daniel Fein , Max Lamparth , Violet Xiang , Mykel J. Kochenderfer , Nick Haber

We study mechanism design in environments where agents have private preferences and private information about a common payoff-relevant state. In such settings with multi-dimensional types, standard mechanisms fail to implement efficient…

Theoretical Economics · Economics 2025-12-24 Dirk Bergemann , Marek Bojko , Paul Dütting , Renato Paes Leme , Haifeng Xu , Song Zuo

Contextual bandit algorithms have become widely used for recommendation in online systems (e.g. marketplaces, music streaming, news), where they now wield substantial influence on which items get exposed to the users. This raises questions…

Machine Learning · Computer Science 2021-09-14 Lequn Wang , Yiwei Bai , Wen Sun , Thorsten Joachims

Large language models (LLMs) have demonstrated strong reasoning abilities in mathematical tasks, often enhanced through reinforcement learning (RL). However, RL-trained models frequently produce unnecessarily long reasoning traces -- even…

Computation and Language · Computer Science 2025-05-27 Jinyan Su , Claire Cardie

In many sequential decision problems, an agent performs a repeated task. He then suffers regret and obtains information that he may use in the following rounds. However, sometimes the agent may also obtain information and avoid suffering…

Machine Learning · Computer Science 2025-02-25 Itai Shufaro , Nadav Merlis , Nir Weinberger , Shie Mannor