English
Related papers

Related papers: Game theory, maximum entropy, minimum discrepancy …

200 papers

Behavior in the context of game theory is described as a natural process that follows the 2nd law of thermodynamics. The rate of entropy increase as the payoff function is derived from statistical physics of open systems. The thermodynamic…

General Physics · Physics 2011-10-27 Jani Anttila , Arto Annila

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…

Biological Physics · Physics 2017-08-22 Badr F. Albanna , Christopher Hillar , Jascha Sohl-Dickstein , Michael R. DeWeese

Conventional noncooperative game theory hypothesizes that the joint strategy of a set of players in a game must satisfy an "equilibrium concept". All other joint strategies are considered impossible; the only issue is what equilibrium…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 David H. Wolpert

We study a distributionally robust optimization formulation (i.e., a min-max game) for two representative problems in Bayesian nonparametric estimation: Gaussian process regression and, more generally, linear inverse problems. Our…

Optimization and Control · Mathematics 2025-01-14 Xuhui Zhang , Jose Blanchet , Youssef Marzouk , Viet Anh Nguyen , Sven Wang

Examining the behavior of multi-agent systems is vitally important to many emerging distributed applications - game theory has emerged as a powerful tool set in which to do so. The main approach of game-theoretic techniques is to model…

Computer Science and Game Theory · Computer Science 2024-06-03 Rohit Konda , Rahul Chandan , Jason Marden

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

We present a new model of incomplete information games without private information in which the players use a distributionally robust optimization approach to cope with the payoff uncertainty. With some specific restrictions, we show that…

Computer Science and Game Theory · Computer Science 2016-10-04 Nicolas Loizou

A robust game is a distribution-free model to handle ambiguity generated by a bounded set of possible realizations of the values of players' payoff functions. The players are worst-case optimizers and a solution, called robust-optimization…

Theoretical Economics · Economics 2020-02-11 Giovanni Paolo Crespi , Davide Radi , Matteo Rocca

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

We study minimum entropy submodular optimization, a common generalization of the minimum entropy set cover problem, studied earlier by Cardinal et al., and the submodular set cover problem. We give a general bound of the approximation…

Data Structures and Algorithms · Computer Science 2014-02-19 Cosmin Bonchiş , Gabriel Istrate

Entropy maximization and free energy minimization are general physical principles for modeling the dynamics of various physical systems. Notable examples include modeling decision-making within the brain using the free-energy principle,…

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

We study the value and the optimal strategies for a two-player zero-sum optimal stopping game with incomplete and asymmetric information. In our Bayesian set-up, the drift of the underlying diffusion process is unknown to one player…

Probability · Mathematics 2020-07-15 Tiziano De Angelis , Erik Ekström , Kristoffer Glover

We propose a game-theoretic framework that incorporates both incomplete information and general ambiguity attitudes on factors external to all players. Our starting point is players' preferences on payoff-distribution vectors, essentially…

Economics · Quantitative Finance 2017-04-04 Jian Yang

In a situation where each player has control over the transition probabilities of each subsystem, we game-theoretically analyze the optimization problem of minimizing both the partial entropy production of each subsystem and a penalty for…

Statistical Mechanics · Physics 2023-11-17 Yuma Fujimoto , Sosuke Ito

We consider how an agent should update her uncertainty when it is represented by a set $\P$ of probability distributions and the agent observes that a random variable $X$ takes on value $x$, given that the agent makes decisions using the…

Artificial Intelligence · Computer Science 2007-11-27 Peter D. Grunwald , Joseph Y. Halpern

Optimizing strategic decisions (a.k.a. computing equilibrium) is key to the success of many non-cooperative multi-agent applications. However, in many real-world situations, we may face the exact opposite of this game-theoretic problem --…

Computer Science and Game Theory · Computer Science 2022-10-05 Jibang Wu , Weiran Shen , Fei Fang , Haifeng Xu

We give an interpretation of the Maximum Entropy (MaxEnt) Principle in game-theoretic terms. Based on this interpretation, we make a formal distinction between different ways of {em applying/} Maximum Entropy distributions. MaxEnt has…

Artificial Intelligence · Computer Science 2013-01-18 Peter D. Grunwald

We consider how an agent should update her uncertainty when it is represented by a set P of probability distributions and the agent observes that a random variable X takes on value x, given that the agent makes decisions using the minimax…

Artificial Intelligence · Computer Science 2014-07-29 Peter D. Grunwald , Joseph Y. Halpern

This paper derives bounds for two omnipresent information theoretic measures, the Shannon entropy and its complementary dual, the extropy. Based on a large size data set from a logconcave model, the said bounds are obtained for the entropy…

Statistics Theory · Mathematics 2025-07-21 Konstantinos Zografos