English
Related papers

Related papers: An Information-Theoretic Foundation for the Weight…

200 papers

It has been observed people tend to have opinions that are far more internally consistent than it would be reasonable to expect. Here, we study how that observation might emerge from changing how agents trust the opinions of their peers in…

Physics and Society · Physics 2020-07-15 Marcelo V. Maciel , André C. R. Martins

It is not always clear how to adjust for control data in causal inference, balancing the goals of reducing bias and variance. We show how, in a setting with repeated experiments, Bayesian hierarchical modeling yields an adaptive procedure…

Methodology · Statistics 2025-01-23 Andrew Gelman , Matthijs Vákár

We propose a novel approach framed in terms of information theory and entropy to tackle the issue of conspiracy theories propagation. We start with the report of an event (such as 9/11 terroristic attack) represented as a series of…

Physics and Society · Physics 2015-10-28 Natasa Golo , Serge Galam

Theory refinement is the task of updating a domain theory in the light of new cases, to be done automatically or with some expert assistance. The problem of theory refinement under uncertainty is reviewed here in the context of Bayesian…

Artificial Intelligence · Computer Science 2013-03-26 Wray L. Buntine

This paper uses decision-theoretic principles to obtain new insights into the assessment and updating of probabilities. First, a new foundation of Bayesianism is given. It does not require infinite atomless uncertainties as did Savage s…

Artificial Intelligence · Computer Science 2013-01-07 Peter P. Wakker

Probabilistic epistemic argumentation allows for reasoning about argumentation problems in a way that is well founded by probability theory. Epistemic states are represented by probability functions over possible worlds and can be adjusted…

Artificial Intelligence · Computer Science 2019-06-13 Nico Potyka , Sylwia Polberg , Anthony Hunter

One of the goals of probabilistic inference is to decide whether an empirically observed distribution is compatible with a candidate Bayesian network. However, Bayesian networks with hidden variables give rise to highly non-trivial…

Machine Learning · Statistics 2014-10-14 R. Chaves , L. Luft , T. O. Maciel , D. Gross , D. Janzing , B. Schölkopf

The recent article "Entropic Updating of Probability and Density Matrices" [1] derives and demonstrates the inferential origins of both the standard and quantum relative entropies in unison. Operationally, the standard and quantum relative…

Quantum Physics · Physics 2017-10-31 Kevin Vanslette

In this work, we propose two information generating functions: general weighted information and relative information generating functions, and study their properties. { It is shown that the general weighted information generating function…

Statistics Theory · Mathematics 2024-06-04 Shital Saha , Suchandan Kayal

Especially when facing reliability data with limited information (e.g., a small number of failures), there are strong motivations for using Bayesian inference methods. These include the option to use information from physics-of-failure or…

Methodology · Statistics 2022-10-27 Qinglong Tian , Colin Lewis-Beck , Jarad Niemi , William Meeker

Choice overload occurs when individuals feel overwhelmed by an excessive number of options. Experimental evidence suggests that a larger selection can complicate the decision-making process. Consequently, choice satisfaction may diminish…

Physics and Society · Physics 2024-12-18 Mojtaba Madadi Asl , Kamal Hajian , Rouzbeh Torabi , Mehdi Sadeghi

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

Safe and reliable disclosure of information from confidential data is a challenging statistical problem. A common approach considers the generation of synthetic data, to be disclosed instead of the original data. Efficient approaches ought…

Methodology · Statistics 2024-03-04 Larissa N. A. Martins , Flávio B. Gonçalves , Thais P. Galletti

A novel heuristic approach is proposed here for time series data analysis, dubbed Generalized weighted permutation entropy, which amalgamates and generalizes beyond their original scope two well established data analysis methods:…

Statistical Mechanics · Physics 2022-10-19 Darko Stosic , Dusan Stosic , Tatijana Stosic , Borko Stosic

A natural way to represent beliefs and the process of updating beliefs is presented by Bayesian probability theory, where belief of an agent a in P can be interpreted as a considering that P is more probable than not P. This paper attempts…

Logic in Computer Science · Computer Science 2017-07-28 Jan van Eijck , Kai Li

Bayesian hierarchical models are frequently used in practical data analysis contexts. One interpretation of these models is that they provide an indirect way of assigning a prior for unknown parameters, through the introduction of…

Machine Learning · Statistics 2026-05-01 Brendon J. Brewer

Aleatoric uncertainty captures the inherent randomness of the data, such as measurement noise. In Bayesian regression, we often use a Gaussian observation model, where we control the level of aleatoric uncertainty with a noise variance…

Machine Learning · Computer Science 2022-03-31 Sanyam Kapoor , Wesley J. Maddox , Pavel Izmailov , Andrew Gordon Wilson

We consider a setting where an agent's uncertainty is represented by a set of probability measures, rather than a single measure. Measure-by-measure updating of such a set of measures upon acquiring new information is well-known to suffer…

Computer Science and Game Theory · Computer Science 2016-11-04 Joseph Y. Halpern , Samantha Leung

Often the rows (cases, objects) of a dataset have weights. For instance, the weight of a case may reflect the number of times it has been observed, or its reliability. For analyzing such data many rowwise weighted techniques are available,…

Computation · Statistics 2024-07-08 Peter J. Rousseeuw