English
Related papers

Related papers: A Generalized Cram\'er-Rao Bound Using Information…

200 papers

Standard diffusion models for graph generation typically rely on uniform time-stepping, an approach that overlooks the non-homogeneous dynamics of distributional evolution on complex manifolds. In this paper, we present an…

Machine Learning · Statistics 2026-05-04 Yuhui Lu , Wenjing Liu , Kun Zhan

The Wasserstein probability metric has received much attention from the machine learning community. Unlike the Kullback-Leibler divergence, which strictly measures change in probability, the Wasserstein metric reflects the underlying…

Machine Learning · Computer Science 2017-06-01 Marc G. Bellemare , Ivo Danihelka , Will Dabney , Shakir Mohamed , Balaji Lakshminarayanan , Stephan Hoyer , Rémi Munos

This paper explores as didactically as possible the fundamental principles of both classical and quantum metrology, focusing on the Cram\'er-Rao Bound and how it defines the maximum precision in parameter estimation, taking into account…

Quantum Physics · Physics 2024-12-13 Leonardo A. M. Souza

We present a PAC-Bayes-style generalization bound which enables the replacement of the KL-divergence with a variety of Integral Probability Metrics (IPM). We provide instances of this bound with the IPM being the total variation metric and…

Machine Learning · Statistics 2023-01-02 Ron Amit , Baruch Epstein , Shay Moran , Ron Meir

The Fisher-Rao metric from Information Geometry is related to phase transition phenomena in classical statistical mechanics. Several studies propose to extend the use of Information Geometry to study more general phase transitions in…

Statistical Mechanics · Physics 2016-05-04 Omri Har Shemesh , Rick Quax , Alfons G. Hoekstra , Peter M. A. Sloot

This paper focuses on parameter estimation and introduces a new method for lower bounding the Bayesian risk. The method allows for the use of virtually \emph{any} information measure, including R\'enyi's $\alpha$, $\varphi$-Divergences, and…

Information Theory · Computer Science 2023-03-27 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

This is a tutorial aimed at illustrating some recent developments in quantum parameter estimation beyond the Cram\`er-Rao bound, as well as their applications in quantum metrology. Our starting point is the observation that there are…

Quantum Physics · Physics 2020-03-06 Luigi Seveso , Matteo G. A. Paris

We consider the problem of estimating the state of a large but finite number $N$ of identical quantum systems. In the limit of large $N$ the problem simplifies. In particular the only relevant measure of the quality of the estimation is the…

Quantum Physics · Physics 2008-12-18 R. D. Gill , S. Massar

We devise a systematic method to determine the Fisher information required for resolving two incoherent point sources with a diffraction-limited linear imaging device. The resulting Cram\'er-Rao bound gives the lowest variance achievable…

Quantum Physics · Physics 2016-07-21 J. Rehacek , M. Paur , B. Stoklasa , L. Motka , Z. Hradil , L. L. Sanchez-Soto

This letter aims at extending the Constrained Semiparametric Cramer-Rao Bound (CSCRB) for the joint estimation of mean vector and scatter matrix of Real Elliptically Symmetric (RES) distributions to Complex Elliptically Symmetric (CES)…

Signal Processing · Electrical Eng. & Systems 2019-02-26 Stefano Fortunati , Fulvio Gini , Maria S. Greco , Abdelhak M. Zoubir

Bayesian predictive densities when the observed data $x$ and the target variable $y$ to be predicted have different distributions are investigated by using the framework of information geometry. The performance of predictive densities is…

Statistics Theory · Mathematics 2015-03-27 Fumiyasu Komaki

A generic modular array architecture is proposed, featuring uniform/non-uniform subarray layouts that allows for flexible deployment. The bistatic near-field sensing system is considered, where the target is located in the near-field of the…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Chunwei Meng , Dingyou Ma , Xu Chen , Zhiyong Feng , Yuanwei Liu

Interactive statistical decision making (ISDM) features algorithm-dependent data generated through interaction. Existing information-theoretic lower bounds in ISDM largely target expected risk, while tail-sensitive objectives are less…

Information Theory · Computer Science 2026-01-21 Raghav Bongole , Tobias J. Oechtering , Mikael Skoglund

The quantum Fisher information constrains the achievable precision in parameter estimation via the quantum Cram\'er-Rao bound, which has attracted much attention in Hermitian systems since the 60s of the last century. However, less…

Quantum Physics · Physics 2021-03-15 Jianning Li , Haodi Liu , Zhihai Wang , Xuexi Yi

In this paper, we generalize the simple Euclidean 1-center approximation algorithm of Badoiu and Clarkson (2003) to Riemannian geometries and study accordingly the convergence rate. We then show how to instantiate this generic algorithm to…

Computational Geometry · Computer Science 2021-04-29 Marc Arnaudon , Frank Nielsen

Information geometry promotes an investigation of the geometric structure of statistical manifolds, providing a series of elucidations in various areas of scientific knowledge. In the physical sciences, especially in quantum theory, this…

Quantum Physics · Physics 2020-12-08 Gabriel F. Magno , Carlos H. Grossi , Gerardo Adesso , Diogo O. Soares-Pinto

We derive generic information-theoretic and PAC-Bayesian generalization bounds involving an arbitrary convex comparator function, which measures the discrepancy between the training and population loss. The bounds hold under the assumption…

Machine Learning · Computer Science 2024-02-22 Fredrik Hellström , Benjamin Guedj

We introduce the information geometry module of the Python package Geomstats. The module first implements Fisher-Rao Riemannian manifolds of widely used parametric families of probability distributions, such as normal, gamma, beta,…

Machine Learning · Computer Science 2022-11-22 Alice Le Brigant , Jules Deschamps , Antoine Collas , Nina Miolane

Choosing the Fisher information as the metric tensor for a Riemannian manifold provides a powerful yet fundamental way to understand statistical distribution families. Distances along this manifold become a compelling measure of statistical…

Statistics Theory · Mathematics 2023-06-05 Brodie A. J. Lawson , Kevin Burrage , Kerrie Mengersen , Rodrigo Weber dos Santos

In this lecture note, we show a general property of the Cramer-Rao bound (CRB) that quantifies the interdependencies between the parameters in a vector. The presented result is valid for more general models than the additive noise model and…

Statistics Theory · Mathematics 2015-05-07 Dave Zachariah , Petre Stoica
‹ Prev 1 3 4 5 6 7 10 Next ›