English
Related papers

Related papers: Error Guarantees for Least Squares Approximation w…

200 papers

We propose a new numerical scheme for approximating level-sets of Lipschitz multivariate functions which is robust to stochastic noise. The algorithm's main feature is an adaptive grid-based stochastic approximation strategy which…

Numerical Analysis · Mathematics 2025-09-19 Matteo Croci , Abdul-Lateef Haji-Ali , Ian C. J. Powell

We characterize the performance of the widely-used least-squares estimator in astrometry in terms of a comparison with the Cramer-Rao lower variance bound. In this inference context the performance of the least-squares estimator does not…

Instrumentation and Methods for Astrophysics · Physics 2015-11-18 Rodrigo A. Lobos , Jorge F. Silva , Rene A. Mendez , Marcos Orchard

This paper presents a method for finding a sparse representation of Barron functions. Specifically, given an $L^2$ function $f$, the inverse scale space flow is used to find a sparse measure $\mu$ minimising the $L^2$ loss between the…

Machine Learning · Statistics 2023-12-06 Tjeerd Jan Heeringa , Tim Roith , Christoph Brune , Martin Burger

Over the last decade, approximating functions in infinite dimensions from samples has gained increasing attention in computational science and engineering, especially in computational uncertainty quantification. This is primarily due to the…

Numerical Analysis · Mathematics 2023-10-18 Ben Adcock , Nick Dexter , Sebastian Moraga

Stochastic approximation techniques play an important role in solving many problems encountered in machine learning or adaptive signal processing. In these contexts, the statistics of the data are often unknown a priori or their direct…

Optimization and Control · Mathematics 2016-09-27 Chouzenoux Emilie , Pesquet Jean-Christophe

We study the problem of estimating an unknown function from noisy data using shallow ReLU neural networks. The estimators we study minimize the sum of squared data-fitting errors plus a regularization term proportional to the squared…

Machine Learning · Statistics 2023-01-24 Rahul Parhi , Robert D. Nowak

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find…

Statistics Theory · Mathematics 2021-04-12 Arun K. Kuchibhotla , Rohit K. Patra

Supervised learning by extreme learning machines resp. neural networks with random weights is studied under a non-stationary spatial-temporal sampling design which especially addresses settings where an autonomous object moving in a…

Machine Learning · Statistics 2021-09-02 Ansgar Steland

This paper studies the subspace segmentation problem which aims to segment data drawn from a union of multiple linear subspaces. Recent works by using sparse representation, low rank representation and their extensions attract much…

Computer Vision and Pattern Recognition · Computer Science 2014-04-29 Can-Yi Lu , Hai Min , Zhong-Qiu Zhao , Lin Zhu , De-Shuang Huang , Shuicheng Yan

The task of approximating a function of d variables from its evaluations at a given number of points is ubiquitous in numerical analysis and engineering applications. When d is large, this task is challenged by the so-called curse of…

Numerical Analysis · Mathematics 2016-12-21 Albert Cohen , Giovanni Migliorati

Convergence properties of empirical risk minimizers can be conveniently expressed in terms of the associated population risk. To derive bounds for the performance of the estimator under covariate shift, however, pointwise convergence rates…

Statistics Theory · Mathematics 2024-01-01 Johannes Schmidt-Hieber , Petr Zamolodtchikov

For the Gaussian sequence model, we obtain non-asymptotic minimax rates of estimation of the linear, quadratic and the L2-norm functionals on classes of sparse vectors and construct optimal estimators that attain these rates. The main…

Statistics Theory · Mathematics 2015-02-04 Olivier Collier , Laëtitia Comminges , Alexandre B. Tsybakov

Motivated by models for multiway comparison data, we consider the problem of estimating a coordinate-wise isotonic function on the domain $[0, 1]^d$ from noisy observations collected on a uniform lattice, but where the design points have…

Statistics Theory · Mathematics 2021-06-25 Ashwin Pananjady , Richard J. Samworth

This paper proposes an adaptive near-field beam training method to enhance performance in multi-user and multipath environments. The approach identifies multiple strongest beams through beam sweeping and linearly combines their received…

Signal Processing · Electrical Eng. & Systems 2025-05-14 Zijun Wang , Rama Kiran , Jinesh Nair , Chien-Hua Chen , Tzu-Han Chou , Shawn Tsai , Rui Zhang

In this paper, we propose a novel algorithm for function approximation in a weighted Korobov space based on shifted rank-1 lattice rules. To mitigate aliasing errors inherent in lattice-based Fourier coefficient estimation, we employ…

Numerical Analysis · Mathematics 2025-11-13 Mou Cai , Josef Dick , Takashi Goda

The $c$-approximate Near Neighbor problem in high dimensional spaces has been mainly addressed by Locality Sensitive Hashing (LSH), which offers polynomial dependence on the dimension, query time sublinear in the size of the dataset, and…

Computational Geometry · Computer Science 2016-12-23 Georgia Avarikioti , Ioannis Z. Emiris , Ioannis Psarros , Georgios Samaras

We investigate the approximation of $d$-variate periodic functions in Sobolev spaces of dominating mixed (fractional) smoothness $s>0$ on the $d$-dimensional torus, where the approximation error is measured in the $L_2-$norm. In other…

Numerical Analysis · Mathematics 2013-12-24 Thomas Kuehn , Winfried Sickel , Tino Ullrich

Approximating a function $f(x)$ on $[-1,1]$ based on $N+1$ samples is a classical problem in numerical analysis. If the samples come with heteroskedastic noise depending on $x$ of variance $\sigma(x)^2$, an $O(N\log N)$ algorithm for this…

Numerical Analysis · Mathematics 2025-08-13 Yuji Nakatsukasa , Yifu Zhang

Given a Hilbert space $\mathcal H$ and a finite measure space $\Omega$, the approximation of a vector-valued function $f: \Omega \to \mathcal H$ by a $k$-dimensional subspace $\mathcal U \subset \mathcal H$ plays an important role in…

Numerical Analysis · Mathematics 2024-08-07 Daniel Kressner , Tingting Ni , André Uschmajew

Consider estimating a structured signal $\mathbf{x}_0$ from linear, underdetermined and noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\mathbf{z}$, via solving a variant of the lasso algorithm: $\hat{\mathbf{x}}=\arg\min_\mathbf{x}\{…

Optimization and Control · Mathematics 2014-01-28 Christos Thrampoulidis , Samet Oymak , Babak Hassibi
‹ Prev 1 4 5 6 7 8 10 Next ›