English
Related papers

Related papers: Kernel Methods in the Deep Ritz framework: Theory …

200 papers

The kernel-based multi-scale method has been proven to be a powerful approximation method for scattered data approximation problems which is computationally superior to conventional kernel-based interpolation techniques. The multi-scale…

Numerical Analysis · Mathematics 2025-03-10 Federico Lot , Christian Rieger

This note establishes a theoretical framework for finding (potentially overparameterized) approximations of a function on a compact set with a-priori bounds for the generalization error. The approximation method considered is to choose,…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Arthur C. B. de Oliveira , Ruigang Wang , Ian R. Manchester , Eduardo D. Sontag

We prove quasi-optimal a priori error estimates for finite element approximations of boundary normal fluxes in the $L^2$-norm. Our results are valid for a variety of different schemes for weakly enforcing Dirichlet boundary conditions…

Numerical Analysis · Mathematics 2014-01-28 Mats G. Larson , Andre Massing

Motivated by many applications in complex domains with boundaries exposed to large topological changes or deformations, fictitious domain methods regard the actual domain of interest as being embedded in a fixed Cartesian background. This…

Numerical Analysis · Mathematics 2020-03-17 Georgios Katsouleas , Efthymios N. Karatzas , Fotios Travlopanos

In recent years, neural networks have achieved remarkable progress in various fields and have also drawn much attention in applying them on scientific problems. A line of methods involving neural networks for solving partial differential…

Numerical Analysis · Mathematics 2025-05-20 Xianliang Xu , Ye Li , Zhongyi Huang

This article gives a new insight of kernel-based (approximation) methods to solve the high-dimensional stochastic partial differential equations. We will combine the techniques of meshfree approximation and kriging interpolation to extend…

Numerical Analysis · Mathematics 2015-02-20 Qi Ye

This paper presents an a priori error analysis of the Deep Mixed Residual method (MIM) for solving high-order elliptic equations with non-homogeneous boundary conditions, including Dirichlet, Neumann, and Robin conditions. We examine MIM…

Numerical Analysis · Mathematics 2024-11-26 Mengjia Bai , Jingrun Chen , Rui Du , Zhiwei Sun

Low-rank approximation of kernels is a fundamental mathematical problem with widespread algorithmic applications. Often the kernel is restricted to an algebraic variety, e.g., in problems involving sparse or low-rank data. We show that…

Machine Learning · Computer Science 2023-10-02 Jason M. Altschuler , Pablo A. Parrilo

We consider supervised learning problems within the positive-definite kernel framework, such as kernel ridge regression, kernel logistic regression or the support vector machine. With kernels leading to infinite-dimensional feature spaces,…

Machine Learning · Computer Science 2013-05-23 Francis Bach

Building on the successes of local kernel methods for approximating the solutions to partial differential equations (PDE) and the evaluation of definite integrals (quadrature/cubature), a local estimate of the error in such approximations…

Numerical Analysis · Mathematics 2023-08-30 Jonah A. Reeger

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

Machine Learning · Computer Science 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir

The use of kernels for nonlinear prediction is widespread in machine learning. They have been popularized in support vector machines and used in kernel ridge regression, amongst others. Kernel methods share three aspects. First, instead of…

Machine Learning · Statistics 2025-08-25 Patrick J. F. Groenen , Michael Greenacre

We revisit the classical kernel method of approximation/interpolation theory in a very specific context motivated by the desire to obtain a robust procedure to approximate discrete data sets by (super)level sets of functions that are merely…

Machine Learning · Computer Science 2022-09-14 Patrick Guidotti

In this work, we develop an efficient solver based on neural networks for second-order elliptic equations with variable coefficients and singular sources. This class of problems covers general point sources, line sources and the combination…

Numerical Analysis · Mathematics 2023-04-18 Tianhao Hu , Bangti Jin , Zhi Zhou

We consider the problem of reconstructing a function from a finite set of noise-corrupted samples. Two kernel algorithms are analyzed, namely kernel ridge regression and $\varepsilon$-support vector regression. By assuming the ground-truth…

Systems and Control · Electrical Eng. & Systems 2021-08-03 Emilio T. Maddalena , Paul Scharnhorst , Colin N. Jones

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

We show error estimates for a cut finite element approximation of a second order elliptic problem with mixed boundary conditions. The error estimates are of low regularity type where we consider the case when the exact solution $u \in H^s$…

Numerical Analysis · Mathematics 2020-07-07 Erik Burman , Peter Hansbo , Mats G. Larson

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

Kernel mean embeddings are a powerful tool to represent probability distributions over arbitrary spaces as single points in a Hilbert space. Yet, the cost of computing and storing such embeddings prohibits their direct use in large-scale…

Machine Learning · Statistics 2022-06-16 Antoine Chatalic , Nicolas Schreuder , Alessandro Rudi , Lorenzo Rosasco

In this article we develop convergence theory for a general class of adaptive approximation algorithms for abstract nonlinear operator equations on Banach spaces, and use the theory to obtain convergence results for practical adaptive…

Numerical Analysis · Mathematics 2010-01-12 Michael Holst , Gantumur Tsogtgerel , Yunrong Zhu