English
Related papers

Related papers: How many samples are needed to reliably approximat…

200 papers

We consider the estimation of a scalar parameter, when two estimators are available. The first is always consistent. The second is inconsistent in general, but has a smaller asymptotic variance than the first, and may be consistent if an…

Statistics Theory · Mathematics 2020-06-29 Clément de Chaisemartin , Xavier D'Haultfœuille

The objective of this work is to quantify the reconstruction error in sparse inverse problems with measures and stochastic noise, motivated by optimal sensor placement. To be useful in this context, the error quantities must be explicit in…

Numerical Analysis · Mathematics 2024-04-19 Phuoc-Truong Huynh , Konstantin Pieper , Daniel Walter

In this work we propose an approximate Minimum Mean-Square Error (MMSE) filter for linear dynamic systems with Gaussian Mixture noise. The proposed estimator tracks each component of the Gaussian Mixture (GM) posterior with an individual…

Systems and Control · Computer Science 2015-06-26 Leila Pishdad , Fabrice Labeau

We study a non-linear statistical inverse learning problem, where we observe the noisy image of a quantity through a non-linear operator at some random design points. We consider the widely used Tikhonov regularization (or method of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Gilles Blanchard , Peter Mathé

This paper deals with a homoskedastic errors-in-variables linear regression model and properties of the total least squares (TLS) estimator. We partly revise the consistency results for the TLS estimator previously obtained by the author…

Probability · Mathematics 2018-10-24 Sergiy Shklyar

The main purpose of this article is to prove that, under certain assumptions in a linear prediction setting, optimal methods based upon model reduction and even an optimal predictor can be provided. The optimality is formulated in terms of…

Statistics Theory · Mathematics 2024-12-30 Inge S. Helland

We consider the two-line fitting problem. True points lie on two straight lines and are observed with Gaussian perturbations. For each observed point, it is not known on which line the corresponding true point lies. The parameters of the…

Methodology · Statistics 2016-04-12 Sergiy Shklyar

Empirical Bayes estimators are based on minimizing the average risk with the hyper-parameters in the weighting function being estimated from observed data. The performance of an empirical Bayes estimator is typically evaluated by its mean…

Statistics Theory · Mathematics 2025-03-18 Yue Ju , Bo Wahlberg , Håkan Hjalmarsson

Consider a regression model with infinitely many parameters and time series errors. We are interested in choosing weights for averaging across generalized least squares (GLS) estimators obtained from a set of approximating models. However,…

Statistics Theory · Mathematics 2016-10-05 Tzu-Chang F. Cheng , Ching-Kang Ing , Shu-Hui Yu

Given an i.i.d. sample drawn from some probability distribution on a finite set, the best (in the sense of least variance) linear unbiased estimator (BLUE) of the average of any quantity with respect to that distribution is the sample…

Statistics Theory · Mathematics 2025-07-28 Bastiaan J. Braams

Weighted least squares polynomial approximation uses random samples to determine projections of functions onto spaces of polynomials. It has been shown that, using an optimal distribution of sample locations, the number of samples required…

Numerical Analysis · Mathematics 2017-10-10 Abdul-Lateef Haji-Ali , Fabio Nobile , Raúl Tempone , Sören Wolfers

A lower bound on the minimum mean-squared error (MSE) in a Bayesian estimation problem is proposed in this paper. This bound utilizes a well-known connection to the deterministic estimation setting. Using the prior distribution, the bias…

Information Theory · Computer Science 2009-05-27 Zvika Ben-Haim , Yonina C. Eldar

We consider multi-antenna wireless systems aided by large intelligent surfaces (LIS). LIS presents a new physical layer technology for improving coverage and energy efficiency by intelligently controlling the propagation environment. In…

Signal Processing · Electrical Eng. & Systems 2020-11-17 Neel Kanth Kundu , Matthew R. McKay

In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings. Improving the calibration of classifiers is crucial for enhancing the…

Machine Learning · Computer Science 2025-02-24 Sebastian G. Gruber , Francis Bach

In this paper, we propose a new approach to justify a round-off error impact on the accuracy of the linear least squares (LS) solution using Cholesky decomposition. This decomposition is widely employed to inverse a matrix in the linear…

Information Theory · Computer Science 2024-04-09 Alexander Osinsky , Roman Bychkov , Mikhail Trefilov , Vladimir Lyashev , Andrey Ivanov

This paper is concerned with the modeling errors appeared in the numerical methods of inverse medium scattering problems (IMSP). Optimization based iterative methods are wildly employed to solve IMSP, which are computationally intensive due…

Numerical Analysis · Mathematics 2021-02-23 Junxiong Jia , Bangyu Wu , Jigen Peng , Jinghuai Gao

An interference-normalised least mean square (INLMS) algorithm for robust adaptive filtering is proposed. The INLMS algorithm extends the gradient-adaptive learning rate approach to the case where the signals are non-stationary. In…

Systems and Control · Computer Science 2016-02-29 Jean-Marc Valin , Iain B. Collings

In the standard Gaussian linear measurement model $Y=X\mu_0+\xi \in \mathbb{R}^m$ with a fixed noise level $\sigma>0$, we consider the problem of estimating the unknown signal $\mu_0$ under a convex constraint $\mu_0 \in K$, where $K$ is a…

Statistics Theory · Mathematics 2022-01-24 Qiyang Han

This work studies the computational aspects of multivariate convex regression in dimensions $d \ge 5$. Our results include the \emph{first} estimators that are minimax optimal (up to logarithmic factors) with polynomial runtime in the…

Statistics Theory · Mathematics 2025-12-30 Gil Kur , Eli Putterman

Minimum mean square error (MMSE) signal detection algorithm is near- optimal for uplink multi-user large-scale multiple input multiple output (MIMO) systems, but involves matrix inversion with high complexity. In this letter, we firstly…

Information Theory · Computer Science 2015-07-17 Xinyu Gao , Linglong Dai , Yongkui Ma , Zhaocheng Wang
‹ Prev 1 4 5 6 7 8 10 Next ›