English
Related papers

Related papers: An information upper bound for probability sensiti…

200 papers

The uncertainty principle brings out intrinsic quantum bounds on the precision of measuring non-commuting observables. Statistical outcomes in the measurement of incompatible observables reveal a trade-off on the sum of corresponding…

Quantum Physics · Physics 2013-11-11 H. S. Karthik , A. R. Usha Devi , J. Prabhu Tej , A. K. Rajagopal

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko

We derive upper bounds on the quantum Fisher information in interferometry with $N$ subsystems, e.g. two-level atoms or Gaussian modes, in the presence of arbitrarily correlated Gaussian dephasing including independent and collective…

Quantum Physics · Physics 2014-03-06 Katarzyna Macieszczak

In this work, we show that the sample complexity required in quantum learning theory within a general parametric framework, is fundamentally governed by the inverse Fisher information matrix. More specifically, we derive upper and lower…

Quantum Physics · Physics 2026-03-11 Hyukgun Kwon , Seok Hyung Lie , Liang Jiang

It is well-known that each statistic in the family of power divergence statistics, across $n$ trials and $r$ classifications with index parameter $\lambda\in\mathbb{R}$ (the Pearson, likelihood ratio and Freeman-Tukey statistics correspond…

Statistics Theory · Mathematics 2021-12-28 Robert E. Gaunt

We extend classical analytic tools for finite-state statistical models to allow zero probabilities. Using methods from algebraic statistics and information geometry, we develop a framework in which a smooth statistical model could hit the…

Statistics Theory · Mathematics 2026-02-10 Giovanni Pistone , Fabio Rapallo , Eva Riccomagno

The Kullback-Leibler (KL) divergence is a fundamental equation of information theory that quantifies the proximity of two probability distributions. Although difficult to understand by examining the equation, an intuition and understanding…

Information Theory · Computer Science 2014-04-09 Jonathon Shlens

We show that an inequality recently proved by Kosaki and Yanagi-Furuichi-Kuriyama [arXiv:quant-ph/0501152] has a natural geometric interpretation in terms of monotone metrics associated to Wigner-Yanase-Dyson information. Moreover we give a…

Mathematical Physics · Physics 2011-11-10 P. Gibilisco , T. Isola

This paper applies the recently axiomatized Optimum Information Principle (minimize the Kullback-Leibler information subject to all relevant information) to nonparametric density estimation, which provides a theoretical foundation as well…

Statistics Theory · Mathematics 2011-03-28 Alexis Akira Toda

Classical probabilistic models of (noisy) quantum systems are not only relevant for understanding the non-classical features of quantum mechanics, but they are also useful for determining the possible advantage of using quantum resources…

Quantum Physics · Physics 2020-03-16 Iman Marvian

The quantum Fisher information (QFI) is a fundamental quantity of interest in many areas from quantum metrology to quantum information theory. It can in particular be used as a witness to establish the degree of multi-particle entanglement…

Quantum Physics · Physics 2023-01-26 Aniket Rath , Cyril Branciard , Anna Minguzzi , Benoît Vermersch

In quantum metrology, the parameter estimation accuracy is bounded by quantum Fisher information. In this paper, we present coherence measures in terms of (quantum) Fisher information by directly considering the post-selective non-unitary…

Quantum Physics · Physics 2023-07-06 Deng-hui Yu , Chang-shui Yu

Spurious association arises from covariance between propensity for the treatment and individual risk for the outcome. For sensitivity analysis with stochastic counterfactuals we introduce a methodology to characterize uncertainty in causal…

Methodology · Statistics 2021-03-11 Brian Knaeble , Braxton Osting , Placede Tshiaba

We propose the generalised Fisher information or the one-parameter extended class of the Fisher information for the case of one random variable. This new form of the Fisher information is obtained from the intriguing connection between the…

Statistics Theory · Mathematics 2022-08-25 Worachet Bukaew , Sikarin Yoo-Kong

The Bayesian and Akaike information criteria aim at finding a good balance between under- and over-fitting. They are extensively used every day by practitioners. Yet we contend they suffer from at least two afflictions: their penalty…

Statistics Theory · Mathematics 2026-03-20 Sylvain Sardy , Maxime van Cutsem , Sara van de Geer

In statistical classification/multiple hypothesis testing and machine learning, a model distribution estimated from the training data is usually applied to replace the unknown true distribution in the Bayes decision rule, which introduces a…

Information Theory · Computer Science 2024-09-24 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

Generalization error bounds are essential to understanding machine learning algorithms. This paper presents novel expected generalization error upper bounds based on the average joint distribution between the output hypothesis and each…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Yuheng Bu , Gregory Wornell , Miguel Rodrigues

Nearly all statistical analyses that inform policy-making are based on imperfect data. As examples, the data may suffer from measurement errors, missing values, sample selection bias, or record linkage errors. Analysts have to decide how to…

Methodology · Statistics 2025-10-24 Adway S. Wadekar , Jerome P. Reiter

Randomness in scientific estimation is generally assumed to arise from unmeasured or uncontrolled factors. However, when combining subjective probability estimates, heterogeneity stemming from people's cognitive or information diversity is…

Methodology · Statistics 2015-09-14 Ville A. Satopää , Robin Pemantle , Lyle H. Ungar

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler…

Statistics Theory · Mathematics 2013-10-16 Adityanand Guntuboyina , Sujayam Saha , Geoffrey Schiebinger