English
Related papers

Related papers: Convergence Rates for Learning Linear Operators fr…

200 papers

Operator learning has emerged as a new paradigm for the data-driven approximation of nonlinear operators. Despite its empirical success, the theoretical underpinnings governing the conditions for efficient operator learning remain…

Machine Learning · Computer Science 2024-10-21 Nikola B. Kovachki , Samuel Lanthaler , Hrushikesh Mhaskar

We consider the dynamic linear regression problem, where the predictor vector may vary with time. This problem can be modeled as a linear dynamical system, with non-constant observation operator, where the parameters that need to be learned…

Machine Learning · Computer Science 2022-10-13 Mark Kozdoba , Edward Moroshko , Shie Mannor , Koby Crammer

We develop a new theoretical framework to analyze the generalization error of deep learning, and derive a new fast learning rate for two representative algorithms: empirical risk minimization and Bayesian deep learning. The series of…

Statistics Theory · Mathematics 2017-05-31 Taiji Suzuki

The focus of this work is the convergence of non-stationary and deep Gaussian process regression. More precisely, we follow a Bayesian approach to regression or interpolation, where the prior placed on the unknown function $f$ is a…

Statistics Theory · Mathematics 2025-03-19 Conor Osborne , Aretha L. Teckentrup

While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as…

Optimization and Control · Mathematics 2025-08-26 Alexander Davydov , Saber Jafarpour , Anton V. Proskurnikov , Francesco Bullo

We deal with the solution of a generic linear inverse problem in the Hilbert space setting. The exact right hand side is unknown and only accessible through discretised measurements corrupted by white noise with unknown arbitrary…

Numerical Analysis · Mathematics 2023-02-14 Bastian Harrach , Tim Jahn , Roland Potthast

We introduce a notion of tractability for ill-posed operator equations in Hilbert space. For such operator equations the asymptotics of the best possible rate of reconstruction in terms of the underlying noise level is known in many cases.…

Numerical Analysis · Mathematics 2024-05-07 Peter Mathé , Bernd Hofmann

We establish higher order convergence rates in periodic homogenization of fully nonlinear uniformly parabolic Cauchy problems accompanied with rapidly oscillating initial data. Such result is new even for linear problems. Here we construct…

Analysis of PDEs · Mathematics 2019-12-04 Sunghan Kim , Ki-Ahm Lee

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

Numerical Analysis · Mathematics 2025-08-22 Fatemeh Pourahmadian , Yang Xu

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

Bayesian inversion is central to the quantification of uncertainty within problems arising from numerous applications in science and engineering. To formulate the approach, four ingredients are required: a forward model mapping the unknown…

Machine Learning · Statistics 2025-05-15 O. Deniz Akyildiz , Mark Girolami , Andrew M. Stuart , Arnaud Vadeboncoeur

A lower semi-definite self-adjoint linear operator in a Hilbert space is taken whose discrete spectrum is not empty and comprises at least several eigenvalues $\lambda_{min}=\lambda_1\leqslant\ldots\leqslant\lambda_m<\sigma_{ess}$. The…

Spectral Theory · Mathematics 2019-02-19 Ruslan Sharipov

Koopman operators provide tractable means of learning linear approximations of non-linear dynamics. Many approaches have been proposed to find these operators, typically based upon approximations using an a-priori fixed class of models.…

Systems and Control · Electrical Eng. & Systems 2021-02-09 Mario Sznaier

In the context of statistical supervised learning, the noiseless linear model assumes that there exists a deterministic linear relation $Y = \langle \theta_*, X \rangle$ between the random output $Y$ and the random feature vector $\Phi(U)$,…

Machine Learning · Computer Science 2020-10-28 Raphaël Berthier , Francis Bach , Pierre Gaillard

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

In this paper, we prove optimal convergence rates results for regularisation methods for solving linear ill-posed operator equations in Hilbert spaces. The result generalises existing convergence rates results on optimality to general…

Functional Analysis · Mathematics 2015-11-11 Vinicius Albani , Peter Elbau , Maarten V. de Hoop , Otmar Scherzer

In this paper, we consider the nonlinear ill-posed inverse problem with noisy data in the statistical learning setting. The Tikhonov regularization scheme in Hilbert scales is considered to reconstruct the estimator from the random noisy…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by noise. A proper data fidelity term (log-likelihood) is introduced to reflect the statistics of the noise (e.g. Gaussian,…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

We propose a kernel-spectral embedding algorithm for learning low-dimensional nonlinear structures from high-dimensional and noisy observations, where the datasets are assumed to be sampled from an intrinsically low-dimensional manifold and…

Machine Learning · Statistics 2023-07-07 Xiucai Ding , Rong Ma

This paper studies some robust regression problems associated with the $q$-norm loss ($q\ge1$) and the $\epsilon$-insensitive $q$-norm loss in the reproducing kernel Hilbert space. We establish a variance-expectation bound under a priori…

Statistics Theory · Mathematics 2017-01-10 Ting Hu , Yuan Yao