English
Related papers

Related papers: Scattered Data Histopolation in Averaging Kernel H…

200 papers

Recent empirical work has shown that hierarchical convolutional kernels inspired by convolutional neural networks (CNNs) significantly improve the performance of kernel methods in image classification tasks. A widely accepted explanation…

Machine Learning · Statistics 2022-06-06 Theodor Misiakiewicz , Song Mei

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2020-03-03 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

This work concerns the construction and characterization of product kernels for multivariate approximation from a finite set of discrete samples. To this end, we consider composing different component kernels, each acting on a…

Numerical Analysis · Mathematics 2024-11-27 Kristof Albrecht , Juliane Entzian , Armin Iske

For many machine learning problem settings, particularly with structured inputs such as sequences or sets of objects, a distance measure between inputs can be specified more naturally than a feature representation. However, most standard…

Machine Learning · Statistics 2018-05-28 Lingfei Wu , Ian En-Hsu Yen , Fangli Xu , Pradeep Ravikumar , Michael Witbrock

Averaging provides an alternative to bandwidth selection for density kernel estimation. We propose a procedure to combine linearly several kernel estimators of a density obtained from different, possibly data-driven, bandwidths. The method…

Statistics Theory · Mathematics 2019-11-05 O. Chernova , F. Lavancier , P. Rochet

This article gives a new insight of kernel-based (approximation) methods to solve the high-dimensional stochastic partial differential equations. We will combine the techniques of meshfree approximation and kriging interpolation to extend…

Numerical Analysis · Mathematics 2015-02-20 Qi Ye

Classical convergence analysis for kernel interpolation typically assumes that the target function $f$ lies in the reproducing kernel Hilbert space $\mathcal{H}_k\!\left(\Omega\right)$ induced by a kernel on a domain…

Numerical Analysis · Mathematics 2025-12-09 Tobias Ehring , Max-Paul Vogel , Bernard Haasdonk

In order to fully utilize "big data", it is often required to use "big models". Such models tend to grow with the complexity and size of the training data, and do not make strong parametric assumptions upfront on the nature of the…

Machine Learning · Statistics 2015-04-17 Vikas Sindhwani , Haim Avron

Estimating the dissipativity of nonlinear systems from empirical data is useful for the analysis and control of nonlinear systems, especially when an accurate model is unavailable. Based on a Koopman operator model of the nonlinear system…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

Kernel-phase is a data analysis method based on a generalization of the notion of closure-phase invented in the context of interferometry, but that applies to well corrected diffraction dominated images produced by an arbitrary aperture.…

Instrumentation and Methods for Astrophysics · Physics 2020-04-22 Frantz Martinache , Alban Ceau , Romain Laugier , Jens Kammerer , Mamadou N'Diaye , David Mary , Nick Cvetojevic , Coline Lopez

We study embeddings between reproducing kernel Hilbert spaces $H(K)$ of functions of $d \in \mathbb{N} \cup \{\infty\}$ variables. The kernels $K$ are superpositions of weighted finite tensor products of a fixed univariate kernel. The basic…

Numerical Analysis · Mathematics 2026-05-01 Michael Gnewuch , Peter Kritzer , Klaus Ritter

Statistical machine learning plays an important role in modern statistics and computer science. One main goal of statistical machine learning is to provide universally consistent algorithms, i.e., the estimator converges in probability or…

Machine Learning · Statistics 2016-04-18 Andreas Christmann , Florian Dumpert , Dao-Hong Xiang

The universality properties of kernels characterize the class of functions that can be approximated in the associated reproducing kernel Hilbert space and are of fundamental importance in the theoretical underpinning of kernel methods in…

Machine Learning · Computer Science 2025-06-25 Franziskus Steinert , Salem Said , Cyrus Mostajeran

Given a reproducing kernel Hilbert space H of real-valued functions and a suitable measure mu over the source space D (subset of R), we decompose H as the sum of a subspace of centered functions for mu and its orthogonal in H. This…

Machine Learning · Statistics 2012-12-10 Nicolas Durrande , David Ginsbourger , Olivier Roustant , Laurent Carraro

Estimation of the mean and covariance functions is a fundamental problem in functional data analysis, particularly for discretely observed functional data. In this work, we study a regularization-based framework for estimating the mean and…

Statistics Theory · Mathematics 2026-03-20 Naveen Gupta , Bharath K Sriperumbudur

We study the consistency of minimum-norm interpolation in reproducing kernel Hilbert spaces corresponding to bounded kernels. Our main result give lower bounds for the generalization error of the kernel interpolation measured in a…

Machine Learning · Statistics 2025-09-30 Yunfei Yang

An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, properties of the distribution and smoothness…

Statistics Theory · Mathematics 2025-04-17 Geoffrey Wolfer , Pierre Alquier

Kernel interpolation, especially in the context of Gaussian process emulation, is a widely used technique in surrogate modelling, where the goal is to cheaply approximate an input-output map using a limited number of function evaluations.…

Numerical Analysis · Mathematics 2025-11-13 Elliot J. Addy , Jonas Latz , Aretha L. Teckentrup

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity