English
Related papers

Related papers: Error Analysis of Kernel/GP Methods for Nonlinear …

200 papers

Recent advances in machine learning have inspired a surge of research into reconstructing specific quantities of interest from measurements that comply with certain physical laws. These efforts focus on inverse problems that are governed by…

Machine Learning · Statistics 2025-04-23 Honam Wong , Wendao Wu , Fanghui Liu , Yiping Lu

We propose a new approach to non-parametric density estimation that is based on regularizing a Sobolev norm of the density. This method is statistically consistent, and makes the inductive bias of the model clear and interpretable. While…

Machine Learning · Statistics 2024-02-15 Mark Kozdoba , Binyamin Perets , Shie Mannor

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

We prove a higher regularity result for weak solutions to nonlinear nonlocal equations along the integrability scale of Bessel potential spaces $H^{s,p}$ under a mild continuity assumption on the kernel. By embedding, this also yields…

Analysis of PDEs · Mathematics 2020-08-13 Simon Nowak

There exists a plethora of parametric models for positive definite kernels, and their use is ubiquitous in disciplines as diverse as statistics, machine learning, numerical analysis, and approximation theory. Usually, the kernel parameters…

Machine Learning · Statistics 2025-01-06 Xavier Emery , Emilio Porcu , Moreno Bevilacqua

Solving nonlinear partial differential equations (PDEs) using kernel methods offers a compelling alternative to traditional numerical solvers. However, the performance of these methods strongly depends on the choice of kernel. In this work,…

Machine Learning · Statistics 2026-05-12 Fatima-Zahrae El-Boukkouri , Josselin Garnier , Olivier Roustant

Nonlinear Sobolev-Burgers PDEs are considered. Their solutions are investigated. A technique of noncommutative line integration is utilized for their description. A new method of PDEs solution with the help of Cayley-Dickson algebras is…

Analysis of PDEs · Mathematics 2018-12-16 S. V. Ludkowski

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

We develop an asymptotic limit theory for nonparametric estimation of the noise covariance kernel in linear parabolic stochastic partial differential equations (SPDEs) with additive colored noise, using space-time infill asymptotics. The…

Statistics Theory · Mathematics 2025-08-29 Andreas Petersson , Dennis Schroers

A burgeoning line of research leverages deep neural networks to approximate the solutions to high dimensional PDEs, opening lines of theoretical inquiry focused on explaining how it is that these models appear to evade the curse of…

Machine Learning · Computer Science 2023-03-28 Tanya Marwah , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

In this paper, we show that the approximation of high-dimensional functions, which are effectively low-dimensional, does not suffer from the curse of dimensionality. This is shown first in a general reproducing kernel Hilbert space set-up…

Numerical Analysis · Mathematics 2024-11-28 Christian Rieger , Holger Wendland

We consider a least-squares variational kernel-based method for numerical solution of second order elliptic partial differential equations on a multi-dimensional domain. In this setting it is not assumed that the differential operator is…

Numerical Analysis · Mathematics 2021-10-26 Salar Seyednazari , Mehdi Tatari , Davoud Mirzaei

We propose a new estimator for nonparametric binary choice models that does not impose a parametric structure on either the systematic function of covariates or the distribution of the error term. A key advantage of our approach is its…

Econometrics · Economics 2026-01-13 Guo Yan

We develop a geometric and analytic framework for polynomial partial differential equations posed on thin annuli in the plane. Using renormalized Sobolev inner products, we construct Sobolev orthogonal polynomial bases adapted to the thin…

Exactly Solvable and Integrable Systems · Physics 2026-02-16 Jean-Pierre Magnot

We introduce a novel spectral, finite-dimensional approximation of general Sobolev spaces in terms of Chebyshev polynomials. Based on this polynomial surrogate model (PSM), we realise a variational formulation, solving a vast class of…

Numerical Analysis · Mathematics 2023-01-13 Juan-Esteban Suarez Cardona , Phil-Alexander Hofmann , Michael Hecht

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test integrand is less…

Numerical Analysis · Mathematics 2018-10-31 Motonobu Kanagawa , Bharath K. Sriperumbudur , Kenji Fukumizu

The growing demand for accurate, efficient, and scalable solutions in computational mechanics highlights the need for advanced operator learning algorithms that can efficiently handle large datasets while providing reliable uncertainty…

Machine Learning · Statistics 2024-09-18 Sawan Kumar , Rajdip Nayek , Souvik Chakraborty

We study linear systems of ordinary differential equations of an arbitrary order on a finite interval with the most general (generic) inhomogeneous boundary conditions in Sobolev spaces. We investigate the character of solvability of…

Classical Analysis and ODEs · Mathematics 2023-11-27 Olena Atlasiuk , Vladimir Mikhailets

Gaussian Process (GP) regression is a powerful nonparametric Bayesian framework, but its performance depends critically on the choice of covariance kernel. Selecting an appropriate kernel is therefore central to model quality, yet remains…

Machine Learning · Computer Science 2026-01-14 Md Shafiqul Islam , Shakti Prasad Padhy , Douglas Allaire , Raymundo Arróyave