English
Related papers

Related papers: Error Analysis of Kernel/GP Methods for Nonlinear …

200 papers

Learning rates for least-squares regression are typically expressed in terms of $L_2$-norms. In this paper we extend these rates to norms stronger than the $L_2$-norm without requiring the regression function to be contained in the…

Machine Learning · Statistics 2020-10-27 Simon Fischer , Ingo Steinwart

We prove that kernel covariance embeddings lead to information-theoretically perfect separation of distinct continuous probability distributions. In statistical terms, we establish that testing for the \emph{equality} of two non-atomic…

Machine Learning · Statistics 2026-05-14 Leonardo V. Santoro , Kartik G. Waghmare , Victor M. Panaretos

Optimal higher-order Sobolev type embeddings are shown to follow via isoperimetric inequalities. This establishes a higher-order analogue of a well-known link between first-order Sobolev embeddings and isoperimetric inequalities. Sobolev…

Functional Analysis · Mathematics 2013-11-04 Andrea Cianchi , Luboš Pick , Lenka Slavíková

We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse problems, and uncertainty quantification. The solution is discretized in the physical domain using…

Numerical Analysis · Mathematics 2026-04-20 Erik Burman , Mats G. Larson , Karl Larsson , Jonatan Vallin

We develop a new theoretical framework to analyze the generalization error of deep learning, and derive a new fast learning rate for two representative algorithms: empirical risk minimization and Bayesian deep learning. The series of…

Statistics Theory · Mathematics 2017-05-31 Taiji Suzuki

We consider an inhomogeneous initial-boundary value problem for a Petrovskii parabolic system of second order PDEs. We prove that this problem induces isomorphisms between appropriate anisotropic generalized Sobolev spaces. The regularity…

Analysis of PDEs · Mathematics 2021-03-31 Aleksandr Dyachenko , Valerii Los

In this article, we fully characterize the measurable Gaussian processes $(U(x))_{x\in\mathcal{D}}$ whose sample paths lie in the Sobolev space of integer order $W^{m,p}(\mathcal{D}),\ m\in\mathbb{N}_0,\ 1 <p<+\infty$, where $\mathcal{D}$…

Functional Analysis · Mathematics 2022-09-08 Iain Henderson

The standard Sobolev space $W^s_2(\mathbb{R}^d)$, with arbitrary positive integers $s$ and $d$ for which $s>d/2$, has the reproducing kernel $$ K_{d,s}(x,t)=\int_{\mathbb{R}^d}\frac{\prod_{j=1}^d\cos\left(2\pi\,(x_j-t_j)u_j\right)}…

Numerical Analysis · Mathematics 2018-07-17 Erich Novak , Mario Ullrich , Henryk Woźniakowski , Shun Zhang

We consider the problem of model reduction of parametrized PDEs where the goal is to approximate any function belonging to the set of solutions at a reduced computational cost. For this, the bottom line of most strategies has so far been…

Numerical Analysis · Mathematics 2020-03-02 V. Ehrlacher , D. Lombardi , O. Mula , F. -X. Vialard

We prove a priori and a posteriori error estimates for physics-informed neural networks (PINNs) for linear PDEs. We analyze elliptic equations in primal and mixed form, elasticity, parabolic, hyperbolic and Stokes equations; and a PDE…

Numerical Analysis · Mathematics 2024-03-11 Marius Zeinhofer , Rami Masri , Kent-André Mardal

We study the possibility of a gradual improvement as time progresses of the regularity of solutions to evolution problems of parabolic type driven by L\'evy-type operators, not necessarily translation invariant. In the course of our…

Analysis of PDEs · Mathematics 2026-04-13 Arturo de Pablo , David Lee , Fernando Quirós , Jorge Ruiz-Cases

We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDEs), and are used in…

Numerical Analysis · Mathematics 2025-04-14 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

This article investigates the use of random feature neural networks for learning Kolmogorov partial (integro-)differential equations associated to Black-Scholes and more general exponential L\'evy models. Random feature neural networks are…

Machine Learning · Computer Science 2021-06-17 Lukas Gonon

We prove the well-posedness and regularity of solutions in mixed-norm weighted Sobolev spaces for a class of second-order parabolic and elliptic systems in divergence form in the half-space $\mathbb{R}^d_+ = \{x_d > 0\}$ subject to the…

Analysis of PDEs · Mathematics 2026-05-22 Bekarys Bekmaganbetov , Hongjie Dong

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

Kernel methods are one of the mainstays of machine learning, but the problem of kernel learning remains challenging, with only a few heuristics and very little theory. This is of particular importance in methods based on estimation of…

Machine Learning · Statistics 2016-06-03 Seth Flaxman , Dino Sejdinovic , John P. Cunningham , Sarah Filippi

In this paper we present the theoretical framework needed to justify the use of a kernel-based collocation method (meshfree approximation method) to estimate the solution of high-dimensional stochastic partial differential equations…

Numerical Analysis · Mathematics 2012-09-11 Igor Cialenco , Gregory E. Fasshauer , Qi Ye

For the past 30 years or so, machine learning has stimulated a great deal of research in the study of approximation capabilities (expressive power) of a multitude of processes, such as approximation by shallow or deep neural networks,…

Machine Learning · Computer Science 2025-01-07 Hrushikesh Mhaskar

We propose an algorithm to approximate solutions of global optimization problems in Sobolev spaces that follows the spirit of Consensus-based algorithms in finite dimensions. The main ingredient are Gaussian processes. In fact, we exploit…

Optimization and Control · Mathematics 2026-03-17 Mahmoud Khatab , Claudia Totzeck

This paper explores the application of kernel learning methods for parameter prediction and evaluation in the Algebraic Multigrid Method (AMG), focusing on several Partial Differential Equation (PDE) problems. AMG is an efficient iterative…

Numerical Analysis · Mathematics 2025-10-31 Junyue Luo , Xiaoqiang Yue , Fangfang Zhang , Juan Zhang