English
Related papers

Related papers: Worst-case recovery guarantees for least squares a…

200 papers

We propose a conforming finite element method to approximate the strong solution of the second order Hamilton-Jacobi-Bellman equation with Dirichlet boundary and coefficients satisfying Cordes condition. We show the convergence of the…

Numerical Analysis · Mathematics 2024-05-28 Omar Lakkis , Amireh Mousavi

We study the fundamental problems of Gaussian mean estimation and linear regression with Gaussian covariates in the presence of Huber contamination. Our main contribution is the design of the first sample near-optimal and almost linear-time…

Data Structures and Algorithms · Computer Science 2023-12-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

We introduce a direct method allowing to solve numerically inverse type problems for linear hyperbolic equations. We first consider the reconstruction of the full solution of the wave equation posed in $\Omega\times (0,T)$ - $\Omega$ a…

Optimization and Control · Mathematics 2015-05-12 Nicolae Cindea , Arnaud Munch

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

Statistics Theory · Mathematics 2016-07-11 Gilles Blanchard , Nicole Krämer

We present a statistical framework to benchmark the performance of reconstruction algorithms for linear inverse problems, in particular, neural-network-based methods that require large quantities of training data. We generate synthetic…

Signal Processing · Electrical Eng. & Systems 2023-07-05 Pakshal Bohra , Pol del Aguila Pla , Jean-François Giovannelli , Michael Unser

The notion of generalization in classical Statistical Learning is often attached to the postulate that data points are independent and identically distributed (IID) random variables. While relevant in many applications, this postulate may…

Machine Learning · Computer Science 2020-09-15 Simon Foucart , Chunyang Liao , Shahin Shahrampour , Yinsong Wang

Let $X_n = \{x^j\}_{j=1}^n$ be a set of $n$ points in the $d$-cube $[0,1]^d$, and $\Phi_n = \{\varphi_j\}_{j =1}^n$ a family of $n$ functions on $[0,1]^d$. We consider the approximate recovery functions $f$ on $[0,1]^d$ from the sampled…

Numerical Analysis · Mathematics 2015-11-10 Dinh Dũng

We consider the optimization of a quadratic objective function whose gradients are only accessible through a stochastic oracle that returns the gradient at any given point plus a zero-mean finite variance random error. We present the first…

Optimization and Control · Mathematics 2016-02-25 Aymeric Dieuleveut , Nicolas Flammarion , Francis Bach

Functions with discontinuities appear in many applications such as image reconstruction, signal processing, optimal control problems, interface problems, engineering applications and so on. Accurate approximation and interpolation of these…

Numerical Analysis · Mathematics 2023-02-07 Mohammad Karimnejad Esfahani , Stefano De Marchi , Francesco Marchetti

We construct Monte Carlo methods for the $L^2$-approximation in Hilbert spaces of multivariate functions sampling no more than $n$ function values of the target function. Their errors catch up with the rate of convergence and the…

Numerical Analysis · Mathematics 2018-03-16 David Krieg

This paper is concerned with function reconstruction from samples. The sampling points used in several approaches are (1) structured points connected with fast algorithms or (2) unstructured points coming from, e.g., an initial random draw…

Numerical Analysis · Mathematics 2023-06-07 Felix Bartel , Lutz Kämmerer , Daniel Potts , Tino Ullrich

We study multivariate integration and approximation for functions belonging to a weighted reproducing kernel Hilbert space based on half-period cosine functions in the worst-case setting. The weights in the norm of the function space depend…

Numerical Analysis · Mathematics 2015-11-23 Christian Irrgeher , Peter Kritzer , Friedrich Pillichshammer

We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a…

Numerical Analysis · Mathematics 2011-07-19 Massimo Fornasier , Holger Rauhut , Rachel Ward

We study the worst-case approximation of multivariate periodic functions from the weighted Korobov space $H_{d,\alpha,\gamma}$ with smoothness $\alpha>1/2$ in the Lebesgue norm $L_p([0,1]^d)$ for $1\le p\le\infty$. We analyze a \emph{median…

Numerical Analysis · Mathematics 2026-03-06 Zexin Pan , Mou Cai , Josef Dick , Takashi Goda , Peter Kritzer

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

In Optimal Recovery, the task of learning a function from observational data is tackled deterministically by adopting a worst-case perspective tied to an explicit model assumption made on the functions to be learned. Working in the…

Optimization and Control · Mathematics 2021-11-05 Simon Foucart , Chunyang Liao

Reconstructing an infinite-dimensional signal from a finite set of measurements is a fundamental problem in approximation theory and signal processing. While the generalized sampling (GS) framework provides a robust methodology for…

Functional Analysis · Mathematics 2026-05-25 Luca Finotti , Matteo Santacesaria

We introduce a method to reconstruct an element of a Hilbert space in terms of an arbitrary finite collection of linearly independent reconstruction vectors, given a finite number of its samples with respect to any Riesz basis. As we…

Numerical Analysis · Mathematics 2010-12-01 Ben Adcock , Anders C. Hansen

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu