English
Related papers

Related papers: Predicting Choice from Information Costs

200 papers

Despite the obvious advantage of simple life forms capable of fast replication, different levels of cognitive complexity have been achieved by living systems in terms of their potential to cope with environmental uncertainty. Against the…

Populations and Evolution · Quantitative Biology 2017-10-18 Luís F Seoane , Ricard Solé

An agent choosing between various actions tends to take the one with the lowest cost. But this choice is arguably too rigid (not adaptive) to be useful in complex situations, e.g., where exploration-exploitation trade-off is relevant in…

Data Analysis, Statistics and Probability · Physics 2018-12-04 Armen E. Allahverdyan , Aram Galstyan , Ali E. Abbas , Zbigniew R. Struzik

This paper introduces a framework for modeling the cost of information acquisition based on the principle of cost-minimization. We study the reduced-form \emph{indirect cost} of information generated by the sequential minimization of a…

Theoretical Economics · Economics 2025-11-10 Alexander W. Bloedel , Weijie Zhong

We consider a model of a data broker selling information to a single agent to maximize his revenue. The agent has a private valuation of the additional information, and upon receiving the signal from the data broker, the agent can conduct…

Theoretical Economics · Economics 2023-08-08 Yingkai Li

We develop a novel framework for costly information acquisition in which a decision-maker learns about an unobserved state by choosing a signal distribution, with the cost of information determined by the distribution of noise in the…

Theoretical Economics · Economics 2025-03-27 Peter Achim , Kemal Ozbek

In school choice, students make decisions based on their expectations of particular schools' suitability, and the decision to gather information about schools is influenced by the acceptance odds determined by the mechanism in place. We…

Theoretical Economics · Economics 2023-03-15 SangMok Lee

As a firm varies the price of a product, consumers exhibit reference effects, making purchase decisions based not only on the prevailing price but also the product's price history. We consider the problem of learning such behavioral…

Computer Science and Game Theory · Computer Science 2017-08-31 Abbas Kazerouni , Benjamin Van Roy

All sequential decision-making agents explore so as to acquire knowledge about a particular target. It is often the responsibility of the agent designer to construct this target which, in rich and complex environments, constitutes a onerous…

Machine Learning · Computer Science 2021-10-28 Dilip Arumugam , Benjamin Van Roy

In several applications of automatic diagnosis and active learning a central problem is the evaluation of a discrete function by adaptively querying the values of its variables until the values read uniquely determine the value of the…

Data Structures and Algorithms · Computer Science 2014-07-29 Ferdinando Cicalese , Eduardo Laber , Aline Medeiros Saettler

Conventional reinforcement learning methods for Markov decision processes rely on weakly-guided, stochastic searches to drive the learning process. It can therefore be difficult to predict what agent behaviors might emerge. In this paper,…

Machine Learning · Computer Science 2018-02-20 Isaac J. Sledge , Jose C. Principe

In some agent designs like inverse reinforcement learning an agent needs to learn its own reward function. Learning the reward function and optimising for it are typically two different processes, usually performed at different stages. We…

Artificial Intelligence · Computer Science 2020-04-29 Stuart Armstrong , Jan Leike , Laurent Orseau , Shane Legg

We study hypothesis testing over a heterogeneous population of strategic agents with private information. Any single test applied uniformly across the population yields statistical error that is sub-optimal relative to the performance of an…

Computer Science and Game Theory · Computer Science 2025-10-27 Flora C. Shi , Martin J. Wainwright , Stephen Bates

We study the indirect cost of information from sequential information cost minimization. A key sub-additivity condition, together with monotonicity equivalently characterizes the class of indirect cost functions generated from any direct…

Theoretical Economics · Economics 2020-05-01 Weijie Zhong

Recent work has shown that temporally extended actions (options) can be learned fully end-to-end as opposed to being specified in advance. While the problem of "how" to learn options is increasingly well understood, the question of "what"…

Artificial Intelligence · Computer Science 2017-09-15 Jean Harb , Pierre-Luc Bacon , Martin Klissarov , Doina Precup

Motivated by the recent popularity of machine learning training services, we introduce a contract design problem in which a provider sells a service that results in an outcome of uncertain quality for the buyer. The seller has a set of…

Computer Science and Game Theory · Computer Science 2026-05-06 Krishnamurthy Iyer , Alec Sun , Haifeng Xu , You Zu

We consider the problem of learning from revealed preferences in an online setting. In our framework, each period a consumer buys an optimal bundle of goods from a merchant according to her (linear) utility function and current prices,…

Data Structures and Algorithms · Computer Science 2014-12-02 Kareem Amin , Rachel Cummings , Lili Dworkin , Michael Kearns , Aaron Roth

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes…

Computer Science and Game Theory · Computer Science 2019-11-15 Federico Echenique , Siddharth Prasad

When does society eventually learn the truth, or take the correct action, via observational learning? In a general model of sequential learning over social networks, we identify a simple condition for learning dubbed excludability.…

Theoretical Economics · Economics 2024-04-05 Navin Kartik , SangMok Lee , Tianhao Liu , Daniel Rappoport

Power-seeking behavior is a key source of risk from advanced AI, but our theoretical understanding of this phenomenon is relatively limited. Building on existing theoretical results demonstrating power-seeking incentives for most reward…

Artificial Intelligence · Computer Science 2023-04-14 Victoria Krakovna , Janos Kramar

The behavior of users in relatively predictable, both in terms of the data they request and the wireless channels they observe. In this paper, we consider the statistics of such predictable patterns of the demand and channel jointly across…

Information Theory · Computer Science 2018-06-14 L. Srikar Muppirisetty , John Tadrous , Atilla Eryilmaz , Henk Wymeersch