English
Related papers

Related papers: Blind Minimax Estimation

200 papers

In this paper we construct optimal, in certain sense, estimates of values of linear functionals on solutions to two-point boundary value problems (BVPs) for systems of linear first-order ordinary differential equations from observations…

Classical Analysis and ODEs · Mathematics 2009-12-16 Olexandr Nakonechnyi , Yury Podlipenko , Yury Shestopalov

We develop a finite-sample optimal estimator for regression discontinuity design when the outcomes are bounded, including binary outcomes as the leading case. Our estimator achieves minimax mean squared error among linear shrinkage…

Econometrics · Economics 2025-12-29 Takuya Ishihara , Masayuki Sawada , Kohei Yata

We consider the problem of parameter estimation in a partially observed linear Gaussian system with small noises in the state and observation equations. We describe asymptotic properties of the MLE and Bayes estimators in the setting with…

Statistics Theory · Mathematics 2020-10-16 Yury A. Kutoyants

We address the problem of estimating a random vector X from two sets of measurements Y and Z, such that the estimator is linear in Y. We show that the partially linear minimum mean squared error (PLMMSE) estimator does not require knowing…

Information Theory · Computer Science 2015-05-27 Tomer Michaeli , Daniel Sigalov , Yonina C. Eldar

In this paper, we study the prediction of a circularly symmetric zero-mean stationary Gaussian process from a window of observations consisting of finitely many samples. This is a prevalent problem in a wide range of applications in…

Information Theory · Computer Science 2017-05-10 Mahdi Barzegar Khalilsarai , Saeid Haghighatshoar , Giuseppe Caire , Gerhard Wunder

Maximum-a-posteriori (MAP) approaches are an effective framework for inverse problems with known forward operators, particularly when combined with expressive priors and careful parameter selection. In blind settings, however, their use…

Information Theory · Computer Science 2026-02-13 Nathan Buskulic , Luca Calatroni

We address the problem of image denoising in additive white noise without placing restrictive assumptions on its statistical distribution. In the recent literature, specific noise distributions have been considered and correspondingly,…

Computer Vision and Pattern Recognition · Computer Science 2015-01-28 Sagar Venkatesh Gubbi , Chandra Sekhar Seelamantula

In this manuscript, we propose to use a variational autoencoder-based framework for parameterizing a conditional linear minimum mean squared error estimator. The variational autoencoder models the underlying unknown data distribution as…

Signal Processing · Electrical Eng. & Systems 2024-08-23 Michael Baur , Benedikt Fesl , Wolfgang Utschick

Structure-agnostic causal inference studies how well one can estimate a treatment effect given black-box machine learning estimates of nuisance functions (like the impact of confounders on treatment and outcomes). Here, we find that the…

Machine Learning · Statistics 2025-11-10 Jikai Jin , Lester Mackey , Vasilis Syrgkanis

In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the…

Statistics Theory · Mathematics 2017-09-07 Bahadır Yüzbaşı , Yasin Asar , M. Şamil Şık , Ahmet Demiralp

We consider a problem of recovering a high-dimensional vector $\mu$ observed in white noise, where the unknown vector $\mu$ is assumed to be sparse. The objective of the paper is to develop a Bayesian formalism which gives rise to a family…

Statistics Theory · Mathematics 2007-12-18 Felix Abramovich , Vadim Grinshtein , Marianna Pensky

A problem of online estimation of unknown parameters is considered for a linear regression equation, which is affected by an additive perturbation that can be caused by measurement noise (that corrupts regressor and regressand), as well as…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Anton Glushchenko , Konstantin Lastochkin

A new maximum likelihood estimation approach for blind channel equalization, using variational autoencoders (VAEs), is introduced. Significant and consistent improvements in the error rate of the reconstructed symbols, compared to constant…

Signal Processing · Electrical Eng. & Systems 2018-03-06 Avi Caciularu , David Burshtein

We study the problem of estimating an unknown deterministic signal that is observed through an unknown deterministic data matrix under additive noise. In particular, we present a minimax optimization framework to the least squares problems,…

Systems and Control · Computer Science 2014-04-28 N. Denizcan Vanli , Mehmet A. Donmez , Suleyman S. Kozat

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

The reconstruction of a deterministic data field from binary-quantized noisy observations of sensors which are randomly deployed over the field domain is studied. The study focuses on the extremes of lack of deterministic control in the…

Information Theory · Computer Science 2007-12-13 Ye Wang , Prakash Ishwar

In this paper, online linear regression in environments corrupted by non-Gaussian noise (especially heavy-tailed noise) is addressed. In such environments, the error between the system output and the label also does not follow a Gaussian…

Information Theory · Computer Science 2021-05-13 Sajjad Bahrami , Ertem Tuncel

Robust estimation is an important and timely research subject. In this paper, we investigate performance lower bounds on the mean-square-error (MSE) of any estimator for the Bayesian linear model, corrupted by a noise distributed according…

Methodology · Statistics 2017-07-12 Virginie Ollier , Rémy Boyer , Mohammed Nabil El Korso , Pascal Larzabal

Minimum mean squared error (MMSE) estimators of signals from samples corrupted by jitter (timing noise) and additive noise are nonlinear, even when the signal prior and additive noise have normal distributions. This paper develops a…

Applications · Statistics 2015-03-24 Daniel S. Weller , Vivek K Goyal

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson