English
Related papers

Related papers: Error Analysis of Kernel/GP Methods for Nonlinear …

200 papers

It is well-known that sparse grid algorithm has been widely accepted as an efficient tool to overcome the "curse of dimensionality" in some degree. In this note, we first give the error estimate of hyperbolic cross (HC) approximations with…

Numerical Analysis · Mathematics 2014-02-04 Xue Luo , Stephen S. -T. Yau

A semilinear parabolic problem of second order with an unknown time-convolution kernel is considered. The missing kernel is recovered from an additional integral measurement. The existence, uniqueness and regularity of a weak solution is…

Analysis of PDEs · Mathematics 2014-06-19 R. H. De Staelen , M. Slodička

This article studies sufficient conditions on families of approximating kernels which provide $N$--term approximation errors from an associated nonlinear approximation space which match the best known orders of $N$--term wavelet expansion.…

Functional Analysis · Mathematics 2019-03-15 Keaton Hamm , Jeff Ledford

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

The purpose of this work is the study of solution techniques for problems involving fractional powers of symmetric coercive elliptic operators in a bounded domain with Dirichlet boundary conditions. These operators can be realized as the…

Numerical Analysis · Mathematics 2013-02-05 Ricardo H. Nochetto , Enrique Otarola , Abner J. Salgado

On a doubling metric measure space $(M,d,\mu)$ endowed with a "carr\'e du champ", let $\mathcal{L}$ be the associated Markov generator and $\dot L^{p}_\alpha(M,\mathcal{L},\mu)$ the corresponding homogeneous Sobolev space of order…

Classical Analysis and ODEs · Mathematics 2015-05-07 Frédéric Bernicot , Thierry Coulhon , Dorothee Frey

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Jannis Lübsen , Annika Eichler

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

Computational Physics · Physics 2025-06-09 Christopher DeGrendele , Dongwook Lee

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

Kernel models of potential energy surfaces (PES) for polyatomic molecules are often restricted by a specific choice of the kernel function. This can be avoided by optimizing the complexity of the kernel function. For regression problems…

Chemical Physics · Physics 2023-05-02 Jun Dai , Roman V. Krems

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

We prove existence and Sobolev regularity of solutions of a nonlinear system of degenerate-parabolic PDEs with self- and cross-diffusion, transport/confinement and nonlocal interaction terms. The macroscopic system of PDEs is formally…

Analysis of PDEs · Mathematics 2021-06-01 Luca Alasio , Maria Bruna , Simone Fagioli , Simon Schulz

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

We construct a family of non-parametric (infinite-dimensional) manifolds of finite measures on $R^d$. The manifolds are modelled on a variety of weighted Sobolev spaces, including Hilbert-Sobolev spaces and mixed-norm spaces. Each supports…

Probability · Mathematics 2023-05-26 Nigel J. Newton

The kernel-based method has been successfully applied in linear system identification using stable kernel designs. From a Gaussian process perspective, it automatically provides probabilistic error bounds for the identified models from the…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mingzhou Yin , Roy S. Smith

By selecting different filter functions, spectral algorithms can generate various regularization methods to solve statistical inverse problems within the learning-from-samples framework. This paper combines distributed spectral algorithms…

Machine Learning · Statistics 2025-02-18 Jiading Liu , Lei Shi

Identifying dynamical system (DS) is a vital task in science and engineering. Traditional methods require numerous calls to the DS solver, rendering likelihood-based or least-squares inference frameworks impractical. For efficient parameter…

Computation · Statistics 2024-09-19 Ying Zhou , Jinglai Li , Xiang Zhou , Hongqiao Wang

Partial differential equations (PDEs) are a fundamental tool in the modeling of many real world phenomena. In a number of such real world phenomena the PDEs under consideration contain gradient-dependent nonlinearities and are…

Numerical Analysis · Mathematics 2021-10-12 Martin Hutzenthaler , Arnulf Jentzen , Thomas Kruse

We analyze deep Neural Network emulation rates of smooth functions with point singularities in bounded, polytopal domains $\mathrm{D} \subset \mathbb{R}^d$, $d=2,3$. We prove exponential emulation rates in Sobolev spaces in terms of the…

Numerical Analysis · Mathematics 2024-09-05 Joost A. A. Opschoor , Christoph Schwab

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng