English
Related papers

Related papers: Estimating Noisy Order Statistics

200 papers

Consider a process satisfying a stochastic differential equation with unknown drift parameter, and suppose that discrete observations are given. It is known that a simple least squares estimator (LSE) can be consistent, but numerically…

Statistics Theory · Mathematics 2017-03-17 Yasutaka Shimizu

Sorting is the task of ordering $n$ elements using pairwise comparisons. It is well known that $m=\Theta(n\log n)$ comparisons are both necessary and sufficient when the outcomes of the comparisons are observed with no noise. In this paper,…

Information Theory · Computer Science 2024-07-09 Ziao Wang , Nadim Ghaddar , Banghua Zhu , Lele Wang

Compressed sensing typically deals with the estimation of a system input from its noise-corrupted linear measurements, where the number of measurements is smaller than the number of input components. The performance of the estimation…

Information Theory · Computer Science 2016-11-17 Jin Tan , Danielle Carmon , Dror Baron

Compressed sensing deals with the reconstruction of sparse signals using a small number of linear measurements. One of the main challenges in compressed sensing is to find the support of a sparse signal. In the literature, several bounds on…

Information Theory · Computer Science 2009-11-26 Ali Hormati , Amin Karbasi , Soheil Mohajer , Martin Vetterli

The reconstruction of a deterministic data field from binary-quantized noisy observations of sensors which are randomly deployed over the field domain is studied. The study focuses on the extremes of lack of deterministic control in the…

Information Theory · Computer Science 2007-12-13 Ye Wang , Prakash Ishwar

In the context of Independent Component Analysis (ICA), noisy mixtures pose a dilemma regarding the desired objective. On one hand, a "maximally separating" solution, providing the minimal attainable Interference-to-Source-Ratio (ISR),…

Applications · Statistics 2019-10-02 Amir Weiss , Arie Yeredor

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective…

Machine Learning · Statistics 2024-03-08 Pierre Mergny , Justin Ko , Florent Krzakala , Lenka Zdeborová

We address the problem of estimating a random vector X from two sets of measurements Y and Z, such that the estimator is linear in Y. We show that the partially linear minimum mean squared error (PLMMSE) estimator does not require knowing…

Information Theory · Computer Science 2015-05-27 Tomer Michaeli , Daniel Sigalov , Yonina C. Eldar

In this paper, we propose a sparse signal estimation algorithm that is suitable for many wireless communication systems, especially for the future millimeter wave and underwater communication systems. This algorithm is not only…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Lei Liu , Chau Yuen

The stochastic minimum-variance pseudo-unbiased reduced-rank estimator (stochastic MV-PURE estimator) has been developed to provide linear estimation with robustness against high noise levels, imperfections in model knowledge, and…

Applications · Statistics 2024-08-05 Tomasz Piotrowski , Isao Yamada

We study a seemingly unexpected and relatively less understood overfitting aspect of a fundamental tool in sparse linear modeling - best subset selection, which minimizes the residual sum of squares subject to a constraint on the number of…

Methodology · Statistics 2022-01-11 Rahul Mazumder , Peter Radchenko , Antoine Dedieu

This paper considers estimation of a quantized constant in noise when using uniform and nonuniform quantizers. Estimators based on simple arithmetic averages, on sample statistical moments and on the maximum-likelihood procedure are…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Antonio Moschitta , Johan Schoukens , Paolo Carbone

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special…

Machine Learning · Statistics 2016-09-23 Madhu Advani , Surya Ganguli

Reduced-rank approach has been used for decades in robust linear estimation of both deterministic and random vector of parameters in linear model y=Hx+\sqrt{epsilon}n. In practical settings, estimation is frequently performed under…

Optimization and Control · Mathematics 2024-08-05 Tomasz Piotrowski , Isao Yamada

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

This paper deals with the problem of finding suboptimal values of an unknown function on the basis of measured data corrupted by bounded noise. As a prior, we assume that the unknown function is parameterized in terms of a number of basis…

Optimization and Control · Mathematics 2025-06-10 Jaap Eising , Jorge Cortes

Robust estimation is an important and timely research subject. In this paper, we investigate performance lower bounds on the mean-square-error (MSE) of any estimator for the Bayesian linear model, corrupted by a noise distributed according…

Methodology · Statistics 2017-07-12 Virginie Ollier , Rémy Boyer , Mohammed Nabil El Korso , Pascal Larzabal

Tensor completion is a fundamental tool for incomplete data analysis, where the goal is to predict missing entries from partial observations. However, existing methods often make the explicit or implicit assumption that the observed entries…

Machine Learning · Statistics 2022-03-18 Yuning Qiu , Guoxu Zhou , Qibin Zhao , Shengli Xie