English
Related papers

Related papers: Information Geometry and Classical Cram\'{e}r-Rao …

200 papers

We consider a system with a discrete configuration space. We show that the geometrical structures associated with such a system provide the tools necessary for a reconstruction of discrete quantum mechanics once dynamics is brought into the…

Mathematical Physics · Physics 2013-12-03 Marcel Reginatto , Michael J. W. Hall

The Bayesian Cram\'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions. It can be used to benchmark the performance of statistical estimators, and provides a…

Machine Learning · Statistics 2024-09-09 Evan Scope Crafts , Xianyang Zhang , Bo Zhao

The Cram\'er-Rao bound (CRB), a well-known lower bound on the performance of any unbiased parameter estimator, has been used to study a wide variety of problems. However, to obtain the CRB, requires an analytical expression for the…

Machine Learning · Computer Science 2022-10-11 Hai Victor Habi , Hagit Messer , Yoram Bresler

We introduce the category $\mathsf{NCP}$, whose objects are pairs of W$^\ast$-algebras and normal states and whose morphisms are state-preserving unital completely positive (CPU) maps, as a common stage for classical and quantum information…

Mathematical Physics · Physics 2025-09-15 Florio M. Ciaglia , Fabio Di Cosmo , Laura González-Bravo

We build information geometry for a partially ordered set of variables and define the orthogonal decomposition of information theoretic quantities. The natural connection between information geometry and order theory leads to efficient…

Information Theory · Computer Science 2016-11-18 Mahito Sugiyama , Hiroyuki Nakahara , Koji Tsuda

Pinsker's inequality sets a lower bound on the Umegaki divergence of two quantum states in terms of their trace distance. In this work, we formulate corresponding estimates for a variety of quantum and classical divergences including…

Quantum Physics · Physics 2026-01-16 Kläre Wienecke , Gereon Koßmann , René Schwonnek

Building on the $f$-information model of Bloedel et al. (2025), this paper introduces a one-parameter family of information acquisition models and characterizes optimal information acquisition. This family extends the mutual information…

Theoretical Economics · Economics 2026-05-29 Takashi Ui

Complex geometry represents a fundamental ingredient in the formulation of the Dirac equation by the Clifford algebra. The choice of appropriate complex geometries is strictly related to the geometric interpretation of the complex imaginary…

High Energy Physics - Theory · Physics 2016-09-06 S. De Leo , WA Rodrigues , J. Vaz

We establish a quantum version of the classical isoperimetric inequality relating the Fisher information and the entropy power of a quantum state. The key tool is a Fisher information inequality for a state which results from a certain…

Quantum Physics · Physics 2017-02-16 Stefan Huber , Robert Koenig , Anna Vershynina

The quantum Cram\'er-Rao bound is a cornerstone of modern quantum metrology, as it provides the ultimate precision in parameter estimation. In the multiparameter scenario, this bound becomes a matrix inequality, which can be cast to a…

Quantum Physics · Physics 2021-09-15 Aaron Z. Goldberg , Luis L. Sánchez-Soto , Hugo Ferretti

We introduce two new classes of measures of information for statistical experiments which generalise and subsume $\phi$-divergences, integral probability metrics, $\mathfrak{N}$-distances (MMD), and $(f,\Gamma)$ divergences between two or…

Machine Learning · Computer Science 2023-09-11 Robert C. Williamson , Zac Cranko

We review the information geometry of linear systems and its application to Bayesian inference, and the simplification available in the K\"ahler manifold case. We find conditions for the information geometry of linear systems to be…

Differential Geometry · Mathematics 2015-01-15 Jaehyung Choi , Andrew P. Mullhaupt

In this paper, we first describe the generalized notion of Cramer-Rao lower bound obtained by Naudts (2004) using two families of probability density functions, the original model and an escort model. We reinterpret the results in Naudts…

Statistics Theory · Mathematics 2018-02-14 Harsha K , Alladi Subramanyam

We present and investigate an extension of the classical random graph to a general class of inhomogeneous random graph models, where vertices come in different types, and the probability of realizing an edge depends on the types of its…

Statistical Mechanics · Physics 2009-11-07 Bo Soderberg

Knowledge graph embedding (KGE) aims at learning powerful representations to benefit various artificial intelligence applications. Meanwhile, contrastive learning has been widely leveraged in graph learning as an effective mechanism to…

Artificial Intelligence · Computer Science 2023-06-14 Ke Liang , Yue Liu , Sihang Zhou , Wenxuan Tu , Yi Wen , Xihong Yang , Xiangjun Dong , Xinwang Liu

Cheeger inequality is a classical result emerging from the isoperimetric problem in the field of geometry. In the graph theory, a discrete version of Cheeger inequality was also studied deeply and the notion was further extended for higher…

Combinatorics · Mathematics 2023-09-22 Satoshi Kamei

The Fisher Information Metric (FIM) and the associated Cram\'er-Rao Bound (CRB) are fundamental tools in statistical signal processing, which inform the efficient design of experiments and algorithms for estimating the underlying…

Signal Processing · Electrical Eng. & Systems 2025-05-20 Shiraz Khan , Gregory S. Chirikjian

This work proposes a complete algebraic model for classical information theory. As a precursor the essential probabilistic concepts have been defined and analyzed in the algebraic setting. Examples from probability and information theory…

Information Theory · Computer Science 2009-10-12 Manas K. Patra , Samuel L. Braunstein

Kullback--Leibler (KL) divergence is a fundamental measure of the dissimilarity between two probability distributions, but it can become unstable in high-dimensional settings due to its sensitivity to mismatches in distributional support.…

Information Theory · Computer Science 2025-02-03 Yifeng Peng , Dantong Li , Xinyi Li , Zhiding Liang , Yongshan Ding , Ying Wang

The information bottleneck (IB) approach to clustering takes a joint distribution $P\!\left(X,Y\right)$ and maps the data $X$ to cluster labels $T$ which retain maximal information about $Y$ (Tishby et al., 1999). This objective results in…

Machine Learning · Statistics 2020-06-02 DJ Strouse , David J Schwab
‹ Prev 1 4 5 6 7 8 10 Next ›