English
Related papers

Related papers: High-dimensional Location Estimation via Norm Conc…

200 papers

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

Let $X_1,\dots,X_n$ be i.i.d. log-concave random vectors in $\mathbb R^d$ with mean 0 and covariance matrix $\Sigma$. We study the problem of quantifying the normal approximation error for $W=n^{-1/2}\sum_{i=1}^nX_i$ with explicit…

Probability · Mathematics 2023-05-30 Xiao Fang , Yuta Koike

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

In some estimation problems, not all the parameters can be identified, which results in singularity of the Fisher Information Matrix (FIM). The Cram\'er-Rao Bound (CRB), which is the inverse of the FIM, is then not defined. To regularize…

Information Theory · Computer Science 2018-07-24 Elisabeth de Carvalho , Dirk Slock

Algorithmic stability is a classical approach to understanding and analysis of the generalization error of learning algorithms. A notable weakness of most stability-based generalization bounds is that they hold only in expectation.…

Machine Learning · Computer Science 2019-06-25 Vitaly Feldman , Jan Vondrak

The Cram\'er-Rao bound (CRB), a well-known lower bound on the performance of any unbiased parameter estimator, has been used to study a wide variety of problems. However, to obtain the CRB, requires an analytical expression for the…

Machine Learning · Computer Science 2022-10-11 Hai Victor Habi , Hagit Messer , Yoram Bresler

In this paper we use the Cramer-Rao lower uncertainty bound to estimate the maximum precision that could be achieved on the joint simultaneous (or 2D) estimation of photometry and astrometry of a point source measured by a linear CCD…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Rene A. Mendez , Jorge F. Silva , Rodrigo Orsotica , Rodrigo Lobos

Estimating some mathematical expectations from partially observed data and in particular missing outcomes is a central problem encountered in numerous fields such as transfer learning, counterfactual analysis or causal inference. Matching…

Statistics Theory · Mathematics 2025-05-01 Simon Viel , Lionel Truquet , Ikko Yamane

Robust estimation under Huber's $\epsilon$-contamination model has become an important topic in statistics and theoretical computer science. Statistically optimal procedures such as Tukey's median and other estimators based on depth…

Machine Learning · Statistics 2019-02-27 Chao Gao , Jiyi Liu , Yuan Yao , Weizhi Zhu

The quantum Cram\'er-Rao bound sets a fundamental limit on the accuracy of unbiased parameter estimation in quantum systems, relating the uncertainty in determining a parameter to the inverse of the quantum Fisher information. We…

Over recent years, deep learning based image registration has achieved impressive accuracy in many domains, including medical imaging and, specifically, human neuroimaging with magnetic resonance imaging (MRI). However, the uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaoling Hu , Karthik Gopinath , Peirong Liu , Malte Hoffmann , Koen Van Leemput , Oula Puonti , Juan Eugenio Iglesias

Low-dimensional embedding, manifold learning, clustering, classification, and anomaly detection are among the most important problems in machine learning. The existing methods usually consider the case when each instance has a fixed,…

Machine Learning · Computer Science 2012-02-20 Barnabas Poczos , Liang Xiong , Jeff Schneider

Le Cam's two-point testing method yields perhaps the simplest lower bound for estimating the mean of a distribution: roughly, if it is impossible to well-distinguish a distribution centered at $\mu$ from the same distribution centered at…

Statistics Theory · Mathematics 2026-01-06 Spencer Compton , Gregory Valiant

We consider the problem of estimating a $d$-dimensional discrete distribution from its samples observed under a $b$-bit communication constraint. In contrast to most previous results that largely focus on the global minimax error, we study…

Information Theory · Computer Science 2021-11-02 Wei-Ning Chen , Peter Kairouz , Ayfer Özgür

Let $X_1,..., X_N\in\R^n$ be independent centered random vectors with log-concave distribution and with the identity as covariance matrix. We show that with overwhelming probability at least $1 - 3 \exp(-c\sqrt{n}\r)$ one has $ \sup_{x\in…

Probability · Mathematics 2012-11-01 Radosław Adamczak , Alexander E. Litvak , Alain Pajor , Nicole Tomczak-Jaegermann

We consider the problem of estimating the direction of arrival of a signal embedded in $K$-distributed noise, when secondary data which contains noise only are assumed to be available. Based upon a recent formula of the Fisher information…

Applications · Statistics 2015-10-28 Yuri Abramovich , Olivier Besson , Ben Johnson

We derive an (almost) guaranteed upper bound on the error of deep neural networks under distribution shift using unlabeled test data. Prior methods either give bounds that are vacuous in practice or give estimates that are accurate on…

Machine Learning · Statistics 2023-06-02 Elan Rosenfeld , Saurabh Garg

Advanced super-resolution imaging techniques require specific approaches for accurate and consistent estimation of the achievable spatial resolution. Fisher information supplied to Cramer-Rao bound (CRB) has proved to be a powerful and…

Motivated by the fact that circular or spherical data are often much concentrated around a location $\pmb\theta$, we consider inference about $\pmb\theta$ under "high concentration" asymptotic scenarios for which the probability of any…

Statistics Theory · Mathematics 2019-06-11 Davy Paindaveine , Thomas Verdebout

In this paper, we analyze the impact of compressed sensing with complex random matrices on Fisher information and the Cram\'{e}r-Rao Bound (CRB) for estimating unknown parameters in the mean value function of a complex multivariate normal…

Statistics Theory · Mathematics 2023-07-19 Pooria Pakrooh , Ali Pezeshki , Louis L. Scharf , Douglas Cochran , Stephen D. Howard