English
Related papers

Related papers: A Cram\'er-Rao Type Bound for Bayesian Risk with B…

200 papers

The author studies the Cram\'{e}r-Rao type bound by a linear programming approach. By this approach, he found a necessary and sufficient condition that the Cram\'{e}r-Rao type bound is attained by a random measurement. In a spin 1/2 system,…

Quantum Physics · Physics 2007-05-23 Masahito Hayashi

The Cramer-Rao bound, satisfied by classical Fisher information, a key quantity in information theory, has been shown in different contexts to give rise to the Heisenberg uncertainty principle of quantum mechanics. In this paper, we show…

Quantum Physics · Physics 2022-11-23 Yakov Bloch , Eliahu Cohen

Synchronization of rotations is the problem of estimating a set of rotations R_i in SO(n), i = 1, ..., N, based on noisy measurements of relative rotations R_i R_j^T. This fundamental problem has found many recent applications, most…

Information Theory · Computer Science 2016-01-07 Nicolas Boumal , Amit Singer , P. -A. Absil , Vincent D. Blondel

We study the closure properties of the class of Bivariate Regular Variation, symbolically BRV , in standard and nonstandard cases, with respect to the randomly weighted sums. However, we take into consideration a weak dependence structure…

Probability · Mathematics 2025-06-24 Dimitrios G. Konstantinides , Charalampos D. Passalidis

Bias-variance decompositions are widely used to understand the generalization performance of machine learning models. While the squared error loss permits a straightforward decomposition, other loss functions - such as zero-one loss or…

Machine Learning · Computer Science 2026-01-27 Tom Heskes

This paper introduces a set of algorithms for Monte-Carlo Bayesian reinforcement learning. Firstly, Monte-Carlo estimation of upper bounds on the Bayes-optimal value function is employed to construct an optimistic policy. Secondly,…

Machine Learning · Computer Science 2016-11-18 Christos Dimitrakakis

Bayesian coresets speed up posterior inference in the large-scale data regime by approximating the full-data log-likelihood function with a surrogate log-likelihood based on a small, weighted subset of the data. But while Bayesian coresets…

Machine Learning · Statistics 2024-10-18 Trevor Campbell

We study the generalization performance of unregularized gradient methods for separable linear classification. While previous work mostly deal with the binary case, we focus on the multiclass setting with $k$ classes and establish novel…

Machine Learning · Computer Science 2025-05-29 Matan Schliserman , Tomer Koren

Context. The best precision that can be achieved to estimate the location of a stellar-like object is a topic of permanent interest in the astrometric community. Aims. We analyse bounds for the best position estimation of a stellar-like…

Instrumentation and Methods for Astrophysics · Physics 2016-10-26 Alex Echeverria , Jorge F. Silva , Rene A. Mendez , Marcos Orchard

We establish Cram\'er-type moderate deviation theorems for sums of locally dependent random variables and combinatorial central limit theorems. Under some mild exponential moment conditions, optimal error bounds and convergence ranges are…

Probability · Mathematics 2021-12-22 Song-Hao Liu , Zhuo-Song Zhang

We give a general recipe for derandomising PAC-Bayesian bounds using margins, with the critical ingredient being that our randomised predictions concentrate around some value. The tools we develop straightforwardly lead to margin bounds for…

Machine Learning · Computer Science 2022-02-24 Felix Biggs , Benjamin Guedj

Squared error loss remains the most commonly used loss function for constructing a Bayes estimator of the parameter of interest. However, it can lead to sub-optimal solutions when a parameter is defined in a restricted space. It can also be…

Statistics Theory · Mathematics 2019-02-25 Pavel Mozgunov , Thomas Jaki , Mauro Gasparini

The widely used quantum Cramer-Rao bound (QCRB) sets a lower bound for the mean square error of unbiased estimators in quantum parameter estimation, however, in general QCRB is only tight in the asymptotical limit. With a limited number of…

Quantum Physics · Physics 2016-09-07 Jing Liu , Haidong Yuan

Variational inference (VI) is widely used for approximate inference in Bayesian machine learning. In addition to this practical success, generalization bounds for variational inference and related algorithms have been developed, mostly…

Machine Learning · Computer Science 2025-02-19 Yadi Wei , Roni Khardon

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

In this paper, we derive the Cramer-Rao bound (CRB) for joint target position and velocity estimation using an active or passive distributed radar network under more general, and practically occurring, conditions than assumed in previous…

Statistics Theory · Mathematics 2016-04-20 Qian He , Jianbin Hu , Rick S. Blum , Yonggang Wu

Let $(g_{n})_{n\geq 1}$ be a sequence of independent and identically distributed positive random $d\times d$ matrices and consider the matrix product $G_n: = g_n \ldots g_1$. Under suitable conditions, we establish the Berry-Esseen bounds…

Probability · Mathematics 2020-10-02 Hui Xiao , Ion Grama , Quansheng Liu

We derive Berry-Esseen approximation bounds for general functionals of independent random variables, based on chaos expansions methods. Our results apply to $U$-statistics satisfying the weak assumption of decomposability in the Hoeffding…

Probability · Mathematics 2020-10-12 Nicolas Privault , Grzegorz Serafin

We present new PAC-Bayesian generalisation bounds for learning problems with unbounded loss functions. This extends the relevance and applicability of the PAC-Bayes learning framework, where most of the existing literature focuses on…

Machine Learning · Statistics 2021-12-16 Maxime Haddouche , Benjamin Guedj , Omar Rivasplata , John Shawe-Taylor

Quantitative limit theorems for non-linear functionals on the Wiener space are considered. Given the possibly infinite sequence of kernels of the chaos decomposition of such a functional, an estimate for different probability distances…

Probability · Mathematics 2016-10-06 Tobias Fissler , Christoph Thaele