English
Related papers

Related papers: On Parametric Misspecified Bayesian Cram\'{e}r-Rao…

200 papers

In many estimation theory and statistical analysis problems, the true data model is unknown, or partially unknown. To describe the model generating the data, parameterized models of some degree are used. A question that arises is which…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Nadav E. Rosenthal , Joseph Tabrikian

One goal in Bayesian machine learning is to encode prior knowledge into prior distributions, to model data efficiently. We consider prior knowledge from systems of linear partial differential equations together with their boundary…

Machine Learning · Computer Science 2021-02-16 Markus Lange-Hegermann

Change-plane regression identifies subpopulations through an interpretable linear threshold rule, but likelihood-based inference for the hard-threshold boundary is nonregular: objectives are non-smooth, the boundary is weakly identified…

Methodology · Statistics 2026-04-28 Yuki Ohnishi , Fan Li

In high-dimensional Bayesian statistics, various methods have been developed, including prior distributions that induce parameter sparsity to handle many parameters. Yet, these approaches often overlook the rich spectral structure of the…

Statistics Theory · Mathematics 2025-05-06 Tomoya Wakayama , Masaaki Imaizumi

We present a new proof of the quantum Cramer-Rao bound for precision parameter estimation [1-3] and extend it to a more general class of measurement procedures. We analyze a generalized framework for parameter estimation that covers most…

Quantum Physics · Physics 2010-01-28 Garry Goldstein , Mikhail D. Lukin , Paola Cappellaro

The quantum Cram\'er-Rao bound is a cornerstone of modern quantum metrology, as it provides the ultimate precision in parameter estimation. In the multiparameter scenario, this bound becomes a matrix inequality, which can be cast to a…

Quantum Physics · Physics 2021-09-15 Aaron Z. Goldberg , Luis L. Sánchez-Soto , Hugo Ferretti

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

The best possible precision is one of the key figures in metrology, but this is established by the exact response of the detection apparatus, which is often unknown. There exist techniques for detector characterisation, that have been…

Quantum Physics · Physics 2016-03-23 Matteo Altorio , Marco G. Genoni , Fabrizia Somma , Marco Barbieri

In random parameter estimation, Bayesian lower bounds (BLBs) for the mean-square error have been noticed to not be tight in a number of cases, even when the sample size, or the signal-to-noise ratio, grow to infinity. In this paper, we…

Information Theory · Computer Science 2019-07-24 Lucien Bacharach , Carsten Fritsche , Umut Orguner , Eric Chaumette

Bayesian inference is a powerful tool for combining information in complex settings, a task of increasing importance in modern applications. However, Bayesian inference with a flawed model can produce unreliable conclusions. This review…

Methodology · Statistics 2023-05-22 David J. Nott , Christopher Drovandi , David T. Frazier

This paper derives lower bounds for the mean square errors of parameter estimators in the case of Poisson distributed data subjected to multiple abrupt changes. Since both change locations (discrete parameters) and parameters of the Poisson…

Information Theory · Computer Science 2016-10-31 Lucien Bacharach , Mohammed Nabil El Korso , Alexandre Renaux , Jean-Yves Tourneret

Two non-intrusive uncertainty propagation approaches are proposed for the performance analysis of engineering systems described by expensive-to-evaluate deterministic computer models with parameters defined as interval variables. These…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Alice Cicirello , Filippo Giunta

Robust estimation is an important and timely research subject. In this paper, we investigate performance lower bounds on the mean-square-error (MSE) of any estimator for the Bayesian linear model, corrupted by a noise distributed according…

Methodology · Statistics 2017-07-12 Virginie Ollier , Rémy Boyer , Mohammed Nabil El Korso , Pascal Larzabal

ReRecent studies in machine learning are based on models in which parameters or state variables are bounded restricted. These restrictions are from prior information to ensure the validity of scientific theories or structural consistency…

Methodology · Statistics 2024-01-26 Solmaz Seifollahi , Hossein Bevrani , Kristofer Mansson

Bounding the optimal precision in parameter estimation tasks is of central importance for technological applications. In the regime of a small number of measurements, or that of low signal-to-noise ratios, the meaning of common frequentist…

Quantum Physics · Physics 2024-02-23 Valentin Gebhart , Manuel Gessner , Augusto Smerzi

We study the estimation error of constrained M-estimators, and derive explicit upper bounds on the expected estimation error determined by the Gaussian width of the constraint set. Both of the cases where the true parameter is on the…

Statistics Theory · Mathematics 2015-06-29 Yen-Huan Li , Ya-Ping Hsieh , Nissim Zerbib , Volkan Cevher

Mixed-resolution architectures, combining high-resolution (analog) data with coarsely quantized (e.g., 1-bit) data, are widely employed in emerging communication and radar systems to reduce hardware costs and power consumption. However, the…

Signal Processing · Electrical Eng. & Systems 2025-08-29 Yaniv Mazor , Tirza Routtenberg

Bayesian methods have proven themselves to be successful across a wide range of scientific problems and have many well-documented advantages over competing methods. However, these methods run into difficulties for two major and prevalent…

Methodology · Statistics 2022-07-29 John R. Lewis , Steven N. MacEachern , Yoonkyung Lee

In certain applications involving the solution of a Bayesian inverse problem, it may not be possible or desirable to evaluate the full posterior, e.g. due to the high computational cost of doing so. This problem motivates the use of…

Statistics Theory · Mathematics 2024-02-27 Han Cheng Lie , T. J. Sullivan , Aretha Teckentrup

We consider distributed parameter estimation using interactive protocols subject to local information constraints such as bandwidth limitations, local differential privacy, and restricted measurements. We provide a unified framework…

Data Structures and Algorithms · Computer Science 2022-11-17 Jayadev Acharya , Clément L. Canonne , Ziteng Sun , Himanshu Tyagi