English
Related papers

Related papers: Probability error bounds for approximation of func…

200 papers

For compact self-adjoint operators in Hilbert spaces, two algorithms are proposed to provide fully computable a posteriori error estimate for eigenfunction approximation. Both algorithms apply well to the case of tight clusters and multiple…

Numerical Analysis · Mathematics 2022-07-19 Xuefeng Liu , Tomáš Vejchodský

We consider the problem of constructing a global, probabilistic, and non-asymptotic confidence region for an unknown function observed on a random design. The unknown function is assumed to lie in a reproducing kernel Hilbert space (RKHS).…

Statistics Theory · Mathematics 2025-07-10 Fabrice Gamboa , Olivier Roustant

Let $X,X_1,\dots, X_n$ be i.i.d. Gaussian random variables in a separable Hilbert space ${\mathbb H}$ with zero mean and covariance operator $\Sigma={\mathbb E}(X\otimes X),$ and let $\hat \Sigma:=n^{-1}\sum_{j=1}^n (X_j\otimes X_j)$ be the…

Statistics Theory · Mathematics 2015-04-29 Vladimir Koltchinskii , Karim Lounici

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

Data-driven approximations of the infinite-dimensional Koopman operator rely on finite-dimensional projections, where the predictive accuracy of the resulting models hinges heavily on the invariance of the chosen subspace. Subspace pruning…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Dhruv Shah , Jorge Cortes

Performing inference in Bayesian models requires sampling algorithms to draw samples from the posterior. This becomes prohibitively expensive as the size of data sets increase. Constructing approximations to the posterior which are cheap to…

Statistics Theory · Mathematics 2023-04-19 George Wynne

This paper presents a framework for computing random operator-valued feature maps for operator-valued positive definite kernels. This is a generalization of the random Fourier features for scalar-valued kernels to the operator-valued case.…

Machine Learning · Computer Science 2016-08-22 Ha Quang Minh

We study high-dimensional nonlinear approximation of functions in H\"older-Nikol'skii spaces $H^\alpha_\infty(\mathbb{I}^d)$ on the unit cube $\mathbb{I}^d:=[0,1]^d$ having mixed smoothness, by parametric manifolds. The approximation error…

Numerical Analysis · Mathematics 2021-02-09 Dinh Dũng , Van Kien Nguyen

Approximating the optimal value function $v^*$ for infinite-horizon, nonlinear, autonomous optimal control problems is both challenging and essential for synthesizing real-time optimal feedback. We develop an abstract optimal recovery…

Optimization and Control · Mathematics 2025-12-09 Tobias Ehring , Behzad Azmi , Bernard Haasdonk

This paper presents reproducing kernel Hilbert spaces method to obtain the numerical solution for partial differential equation constrained optimization problem.

Optimization and Control · Mathematics 2016-11-09 Majid Darehmiraki

Band-limited functions are fundamental objects that are widely used in systems theory and signal processing. In this paper we refine a recent nonparametric, nonasymptotic method for constructing simultaneous confidence regions for…

Machine Learning · Statistics 2026-01-27 Balázs Csanád Csáji , Bálint Horváth

We are interested in mesh-free formulas based on the Monte-Carlo methodology for the approximation of multi-dimensional integrals, and we investigate their accuracy when the functions belong to a reproducing-kernel space. A kernel typically…

Analysis of PDEs · Mathematics 2020-08-26 Philippe G. LeFloch , Jean-Marc Mercier

In this paper we study the relationships between a reproducing kernel Hilbert space, its multiplier algebra, and the geometry of the point set on which they live. We introduce a variant of the Banach-Mazur distance suited for measuring the…

Functional Analysis · Mathematics 2025-04-15 Danny Ofek , Satish K. Pandey , Orr Shalit

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

We consider the problem of approximation of matrix functions of class $L^p$ on the unit circle by matrix functions analytic in the unit disk in the norm of $L^p$, $2\le p<\be$. For an $m\times n$ matrix function $\Phi$ in $L^p$, we consider…

Functional Analysis · Mathematics 2008-05-29 L. Baratchart , F. L. Nazarov , V. V. Peller

In this work, we consider "finite bandwidth" reproducing kernel Hilbert spaces which have orthonormal bases of the form $f_n(z)=z^n \prod_{j=1}^J \left( 1 - a_{n}w_j z \right)$, where $w_1 ,w_2, \ldots w_J $ are distinct points on the…

Functional Analysis · Mathematics 2023-10-18 Gregory T. Adams , Nathan A. Wagner

We consider the problem of learning an unknown, possibly nonlinear operator between separable Hilbert spaces from supervised data. Inputs are drawn from a prescribed probability measure on the input space, and outputs are (possibly noisy)…

Numerical Analysis · Mathematics 2025-12-15 John Turnage , Matthew Lowery , John Jakeman , Zachary Morrow , Akil Narayan , Varun Shankar

We prove lower bounds for the worst case error of quadrature formulas that use given sample points $\X_n = \{ x_1, \dots , x_n \}$. We are mainly interested in optimal point sets $\X_n$, but also prove lower bounds that hold with high…

Numerical Analysis · Mathematics 2020-12-08 Aicke Hinrichs , David Krieg , Erich Novak , Jan Vybíral

This paper develops a new Hilbert space method to characterize a family of reproducing kernel Hilbert spaces of real harmonic functions in a bounded Lipschitz domain $\Omega \subset \mathbb R^d, d\geq 2$ involving some families of positive…

Analysis of PDEs · Mathematics 2019-07-25 Soumia Touhami , Abdellatif Chaira