English
Related papers

Related papers: Increasing Value of Information Implies Separable …

200 papers

The integrated information theory is thought to be a key clue towards the theoretical understanding of consciousness. In this study, we propose a simple numerical model comprising a set of coupled double quantum dots, where the…

Quantum Physics · Physics 2020-09-30 Katsuaki Tanabe

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of…

Artificial Intelligence · Computer Science 2013-01-30 Richard Dearden , Nir Friedman , David Andre

Combinatorial auctions where agents can bid on bundles of items are desirable because they allow the agents to express complementarity and substitutability between the items. However, expressing one's preferences can require bidding on all…

Computer Science and Game Theory · Computer Science 2007-05-23 Benoit Hudson , Tuomas Sandholm

Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we propose an information-theoretic formalization of bounded rational decision-making…

Statistics Theory · Mathematics 2015-06-04 Pedro A. Ortega , Daniel A. Braun

Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion.…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

We introduce a new cost function over experiments, f-information, based on the theory of multivariate statistical divergences, that generalizes Sims's classic model of rational inattention as well as the class of posterior-separable cost…

Theoretical Economics · Economics 2025-10-07 Alex Bloedel , Tommaso Denti , Luciano Pomatto

Data-based decisionmaking must account for the manipulation of data by agents who are aware of how decisions are being made and want to affect their allocations. We study a framework in which, due to such manipulation, data becomes less…

Theoretical Economics · Economics 2022-12-29 Alex Frankel , Navin Kartik

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

The influence of additional information on the decision making of agents, who are interacting members of a society, is analyzed within the mathematical framework based on the use of quantum probabilities. The introduction of social…

Physics and Society · Physics 2015-10-12 V. I. Yukalov , D. Sornette

This survey reviews recent developments in revealed preference theory. It discusses the testable implications of theories of choice that are germane to specific economic environments. The focus is on expected utility in risky environments;…

Theoretical Economics · Economics 2019-12-04 Federico Echenique

Large language models (LLMs) are often ensembled together to improve overall reliability and robustness, but in practice models are strongly correlated. This raises a fundamental question: which models should be selected when forming an LLM…

Machine Learning · Computer Science 2026-02-10 Yigit Turkmen , Baturalp Buyukates , Melih Bastopcu

This paper diverges from previous literature by considering the utility maximization problem in the context of investors having the freedom to actively acquire additional information to mitigate estimation risk. We derive closed-form value…

Mathematical Finance · Quantitative Finance 2024-05-16 Zongxia Liang , Qi Ye

The maximum entropy principle can be used to assign utility values when only partial information is available about the decision maker's preferences. In order to obtain such utility values it is necessary to establish an analogy between…

Statistical Finance · Quantitative Finance 2009-11-13 Andreia Dionisio , A. Heitor Reis

A decision maker is choosing between an active action (e.g., purchase a house, invest certain stock) and a passive action. The payoff of the active action depends on the buyer's private type and also an unknown state of nature. An…

Computer Science and Game Theory · Computer Science 2021-10-29 Shuze Liu , Weiran Shen , Haifeng Xu

We introduce an information-theoretic quantity with similar properties to mutual information that can be estimated from data without making explicit assumptions on the underlying distribution. This quantity is based on a recently proposed…

Machine Learning · Computer Science 2023-07-31 Oscar Skean , Jhoan Keider Hoyos Osorio , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

Information-theoretic quantities reveal dependencies among variables in the structure of joint, marginal, and conditional entropies, but leave some fundamentally different systems indistinguishable. Furthermore, there is no consensus on how…

Information Theory · Computer Science 2023-05-09 Abel Jansma

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how active inference…

Machine Learning · Statistics 2021-10-11 Noor Sajid , Lancelot Da Costa , Thomas Parr , Karl Friston

We study what changes to an agent's decision problem increase her value for information. We prove that information becomes more valuable if and only if the agent's reduced-form payoff in her belief becomes more convex. When the…

Theoretical Economics · Economics 2026-04-17 Mark Whitmeyer

Differential privacy is a notion of privacy that has become very popular in the database community. Roughly, the idea is that a randomized query mechanism provides sufficient privacy protection if the ratio between the probabilities that…

Cryptography and Security · Computer Science 2014-06-18 Mário S. Alvim , Miguel E. Andrés , Konstantinos Chatzikokolakis , Pierpaolo Degano , Catuscia Palamidessi

This paper provides a model to analyze and identify a decision maker's (DM's) hypothetical reasoning. Using this model, I show that a DM's propensity to engage in hypothetical thinking is captured exactly by her ability to recognize…

Theoretical Economics · Economics 2021-07-22 Evan Piermont