English
Related papers

Related papers: A unified characterization of generalized informat…

200 papers

Partial orderings and measures of information for continuous univariate random variables with special roles of Gaussian and uniform distributions are discussed. The information measures and measures of non-Gaussianity including third and…

Statistics Theory · Mathematics 2020-06-22 Una Radojicic , Klaus Nordhausen , Hannu Oja

We characterize the growth of the Sibson and Arimoto mutual informations and $\alpha$-maximal leakage, of any order that is at least unity, between a random variable and a growing set of noisy, conditionally independent and…

Information Theory · Computer Science 2021-11-23 Benjamin Wu , Aaron B. Wagner , Ibrahim Issa , G. Edward Suh

This work describes the principled design of a theoretical framework leading to fast and accurate algorithmic information measures on finite multisets of finite strings by means of compression. One distinctive feature of our approach is to…

Information Theory · Computer Science 2025-02-25 François Cayre

The law of likelihood underlies a general framework, known as the likelihood paradigm, for representing and interpreting statistical evidence. As stated, the law applies only to simple hypotheses, and there have been reservations about…

Statistics Theory · Mathematics 2009-01-06 Zhiwei Zhang

We introduce a new approach to modeling uncertainty based on plausibility measures. This approach is easily seen to generalize other approaches to modeling uncertainty, such as probability measures, belief functions, and possibility…

Artificial Intelligence · Computer Science 2016-08-31 Nir Friedman , Joseph Y. Halpern

A broad class of informationally complete symmetric measurements is introduced. It can be understood as a common generalization of symmetric, informationally complete POVMs and mutually unbiased bases. Additionally, it provides a natural…

Quantum Physics · Physics 2022-04-27 Katarzyna Siudzińska

We study stable like behaviour in first order theories without the independence property. We introduce generically stable measures, give characterizatiions, and show their ubiquity. We also introduce generic compact domination. We also…

Logic · Mathematics 2010-02-26 Ehud Hrushovski , Anand Pillay , Pierre Simon

A one-to-one correspondence is drawn between law invariant risk measures and divergences, which we define as functionals of pairs of probability measures on arbitrary standard Borel spaces satisfying a few natural properties. Divergences…

Risk Management · Quantitative Finance 2016-06-07 Daniel Lacker

Information entropy is applied to the state of knowledge of reaction amplitudes in pseudoscalar meson photoproduction, and a scheme is developed that quantifies the information content of a measured set of polarization observables. It is…

High Energy Physics - Phenomenology · Physics 2010-09-02 D. G. Ireland

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality recently proposed by Pawlowski et. al. (arXiv:0905.2992). We consider two…

Recent progress has shown that the generalization error of the Gibbs algorithm can be exactly characterized using the symmetrized KL information between the learned hypothesis and the entire training dataset. However, evaluating such a…

Information Theory · Computer Science 2024-10-17 Youheng Zhu , Yuheng Bu

We formulate a general statement of the problem of defining invariant measures with certain properties and suggest an ergodic method of perturbations for describing such measures.

Dynamical Systems · Mathematics 2021-02-09 A. Vershik

This work introduces a complexity measure which addresses some conflicting issues between existing ones by using a new principle - measuring the average amount of symmetry broken by an object. It attributes low (although different)…

Statistical Mechanics · Physics 2015-03-26 Roberto C. Alamino

This paper is concerned with the study of the consistency of a variational method for probability measure quantization, deterministically realized by means of a minimizing principle, balancing power repulsion and attraction potentials. The…

Functional Analysis · Mathematics 2013-10-07 Massimo Fornasier , Jan-Christian Hütter

The concepts of variability and uncertainty, both epistemic and alleatory, came from experience and coexist with different connotations. Therefore this article attempts to express their relation by analytic means firstly setting sights on…

Other Statistics · Statistics 2013-01-15 Kalman Ziha

We propose a notion of common information that allows one to quantify and separate the information that is shared between two random variables from the information that is unique to each. Our notion of common information is defined by an…

Machine Learning · Computer Science 2023-11-07 Michael Kleinman , Alessandro Achille , Stefano Soatto , Jonathan Kao

We investigate the average coherence with respect to a complete set of complementary measurements. By using a Wigner-Yanase skew information-based coherence measure introduced in [Phys. Rev. A \textbf{96}, 022130, 2017], we evaluate the…

Quantum Physics · Physics 2019-08-13 Bin Chen , Shao-Ming Fei

Complementary relationships exist regarding interference properties of particles such as pattern visibility, predictability and distinguishability. Additionally, relationships are known between information gain $G$ and measurement…

Quantum Physics · Physics 2024-09-04 Michael Steiner , Ronald Rendell

Entropy and information can be considered dual: entropy is a measure of the subspace defined by the information constraining the given ambient space. Negative entropies, arising in na\"ive extensions of the definition of entropy from…

Probability · Mathematics 2023-03-06 Daniel Lazarev

We study belief revision when information is represented by a set of probability distributions, or general information. General information extends the standard event notion while including qualitative information (A is more likely than B),…

Theoretical Economics · Economics 2025-02-04 Adam Dominiak , Matthew Kovach , Gerelt Tserenjigmid