English
Related papers

Related papers: Bounds for maximum likelihood regular and non-regu…

200 papers

The maximum likelihood (ML) and maximum a posteriori (MAP) estimation techniques are widely used to address the direction-of-arrival (DOA) estimation problems, an important topic in sensor array processing. Conventionally the ML estimators…

Applications · Statistics 2016-03-31 Xin Zhang , Mohammed Nabil El Korso , Marius Pesavento

Gravitational-wave astronomers often wish to characterize the expected parameter-estimation accuracy of future observations. The Fisher matrix provides a lower bound on the spread of the maximum-likelihood estimator across noise…

General Relativity and Quantum Cosmology · Physics 2011-11-08 Michele Vallisneri

Prediction via deterministic continuous-time models will always be subject to model error, for example due to unexplainable phenomena, uncertainties in any data driving the model, or discretisation/resolution issues. In this paper, we build…

Dynamical Systems · Mathematics 2025-06-30 Liam Blake , John Maclean , Sanjeeva Balasuriya

Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…

Statistics Theory · Mathematics 2015-07-28 Katarína Burclová , Andrej Pázman

We study the connection between exceptional points (EPs) and optimal parameter estimation, in a simple system consisting of two counter-propagating traveling wave modes in a microring resonator. The unknown parameter to be estimated is the…

Quantum Physics · Physics 2025-11-18 Robert L. Cook , Liwen Ko , K. Birgitta Whaley

We study the distribution of maxima (Extreme Value Statistics) for sequences of observables computed along orbits generated by random transformations. The underlying, deterministic, dynamical system can be regular or chaotic. In the former…

Dynamical Systems · Mathematics 2015-06-11 Davide Faranda , Jorge Milhazes Freitas , Valerio Lucarini , Giorgio Turchetti , Sandro Vaienti

The Fisher Information Matrix (FIM) has been the standard approximation to the accuracy of parameter estimation on gravitational-wave signals from merging compact binaries due to its ease-of-use and rapid computation time. While the…

Instrumentation and Methods for Astrophysics · Physics 2013-10-30 Carl L. Rodriguez , Benjamin Farr , Will M. Farr , Ilya Mandel

We systematically analyze the implications of statistical noise within numerical derivatives on simulation-based Fisher forecasts for large scale structure surveys. Noisy numerical derivatives resulting from a finite number of simulations,…

Cosmology and Nongalactic Astrophysics · Physics 2024-06-11 Christopher Wilson , Rachel bean

In some estimation problems, not all the parameters can be identified, which results in singularity of the Fisher Information Matrix (FIM). The Cram\'er-Rao Bound (CRB), which is the inverse of the FIM, is then not defined. To regularize…

Information Theory · Computer Science 2018-07-24 Elisabeth de Carvalho , Dirk Slock

We develop a principled framework for analyzing and designing noise schedules in diffusion models. We show that one can recast this design problem as an optimal control problem, whose state is the Fisher information of the diffusion process…

Machine Learning · Computer Science 2026-05-22 Seo Taek Kong , Weina Wang , R. Srikant

The Fisher information $F$ gives a limit to the ultimate precision achievable in a phase estimation protocol. It has been shown recently that the Fisher information for a linear two-mode interferometer cannot exceed the number of particles…

The statistical problem of parameter estimation in partially observed hypoelliptic diffusion processes is naturally occurring in many applications. However, due to the noise structure, where the noise components of the different coordinates…

Methodology · Statistics 2018-11-13 Susanne Ditlevsen , Adeline Samson

This paper aims at presenting a numerical investigation of the statistical efficiency of the MUSIC (with different covariance matrix estimates) and the IAA-APES Direction of Arrivals (DOAs) estimation algorithms under a general Complex…

Signal Processing · Electrical Eng. & Systems 2019-03-04 Stefano Fortunati , Fulvio Gini , Maria S. Greco

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

We determine a fundamental upper bound on the performance of any adaptive protocol for discrimination or estimation of a channel which has an unknown parameter encoded in the state of its environment. Since our approach relies on the…

Quantum Physics · Physics 2016-11-29 Masahiro Takeoka , Mark M. Wilde

This paper presents a comprehensive study on the 3D positioning capabilities in distributed multiple-input multiple-output (MIMO) systems. Unlike previous studies that mainly rely on idealized isotropic antenna models, we adopt a…

Signal Processing · Electrical Eng. & Systems 2025-11-24 Yingjie Xu , Xuesong Cai , Ali Al-Ameri , Sara Willhammar , Fredrik Tufvesson

We study the task of learning Multi-Index Models (MIMs) with label noise under the Gaussian distribution. A $K$-MIM is any function $f$ that only depends on a $K$-dimensional subspace. We focus on well-behaved MIMs with finite ranges that…

Machine Learning · Computer Science 2025-04-15 Ilias Diakonikolas , Giannis Iakovidis , Daniel M. Kane , Nikos Zarifis

In this paper, tight upper and lower bounds are derived on the weighted sum of minimum mean-squared errors for additive Gaussian noise channels. The bounds are obtained by constraining the input distribution to be close to a Gaussian…

Information Theory · Computer Science 2020-01-23 Michael Fauß , Abdelhak M. Zoubir , Alex Dytso , H. Vincent Poor , K. G. Nagananda

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We study the problem of {\em list-decodable mean estimation} for bounded covariance distributions. Specifically, we are given a set $T$ of points in $\mathbb{R}^d$ with the promise that an unknown $\alpha$-fraction of points in $T$, where…

Machine Learning · Computer Science 2020-06-23 Ilias Diakonikolas , Daniel M. Kane , Daniel Kongsgaard