中文
相关论文

相关论文: Deep Neural Tangent Kernel and Laplace Kernel Have…

200 篇论文

Kernel-based methods in Numerical Analysis have the advantage of yielding optimal recovery processes in the "native" Hilbert space $\calh$ in which they are reproducing. Continuous kernels on compact domains have an expansion into…

数值分析 · 数学 2018-10-09 Gabriele Santin , Robert Schaback

Recent studies show that a reproducing kernel Hilbert space (RKHS) is not a suitable space to model functions by neural networks as the curse of dimensionality (CoD) cannot be evaded when trying to approximate even a single ReLU neuron…

机器学习 · 统计学 2024-06-27 Fanghui Liu , Leello Dadi , Volkan Cevher

We focus on the problem of finding a non-linear classification function that lies in a Reproducing Kernel Hilbert Space (RKHS) both from the primal point of view (finding a perfect separator when one exists) and the dual point of view…

机器学习 · 计算机科学 2015-05-18 Aaditya Ramdas , Javier Peña

To help understand various reproducing kernels used in applied sciences, we investigate the inclusion relation of two reproducing kernel Hilbert spaces. Characterizations in terms of feature maps of the corresponding reproducing kernels are…

泛函分析 · 数学 2011-06-22 Haizhang Zhang , Liang Zhao

Learning in the reproducing kernel Hilbert space (RKHS) such as the support vector machine has been recognized as a promising technique. It continues to be highly effective and competitive in numerous prediction tasks, particularly in…

机器学习 · 计算机科学 2025-01-15 Gakuto Obi , Ayato Saito , Yuto Sasaki , Tsuyoshi Kato

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

系统与控制 · 电气工程与系统科学 2022-04-19 Mohammad Khosravi , Roy S. Smith

We develop sampling formulas for high-dimensional functions in reproducing kernel Hilbert spaces, where we rely on irregular samples that are taken at determining sequences of data points. We place particular emphasis on sampling formulas…

机器学习 · 计算机科学 2025-04-21 Armin Iske , Lennart Ohlsen

Wavelet bases and frames consisting of band limited functions of nearly exponential localization on Rd are a powerful tool in harmonic analysis by making various spaces of functions and distributions more accessible for study and…

泛函分析 · 数学 2012-06-05 Thierry Coulhon , Gerard Kerkyacharian , Pencho Petrushev

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

数值分析 · 数学 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

A central question in deep learning is to understand the functions learned by deep networks. What is their approximation class? Do the learned weights and representations depend on initialization? Previous empirical work has evidenced that…

机器学习 · 计算机科学 2024-10-28 Florentin Guth , Brice Ménard , Gaspar Rochette , Stéphane Mallat

We investigate for which Gaussian processes there do or do not exist reproducing kernel Hilbert spaces (RKHSs) that contain almost all of their paths. In particular, we establish a new result that makes it possible to exclude the existence…

概率论 · 数学 2026-02-12 Ingo Steinwart

In this paper, we introduce a new image representation based on a multilayer kernel machine. Unlike traditional kernel methods where data representation is decoupled from the prediction task, we learn how to shape the kernel with…

机器学习 · 统计学 2016-10-26 Julien Mairal

Neural tangent kernels (NTKs) have been proposed to study the behavior of trained neural networks from the perspective of Gaussian processes. An important result in this body of work is the theorem of equivalence between a trained neural…

机器学习 · 统计学 2025-01-22 Haoran Liu , Anthony Tai , David J. Crandall , Chunfeng Huang

In recent years finite tensor products of reproducing kernel Hilbert spaces (RKHSs) of Gaussian kernels on the one hand and of Hermite spaces on the other hand have been considered in tractability analysis of multivariate problems. In the…

泛函分析 · 数学 2022-02-23 M. Gnewuch , M. Hefter , A. Hinrichs , K. Ritter

Kernel methods in machine learning use a kernel function that takes two data points as input and returns their inner product after mapping them to a Hilbert space, implicitly and without actually computing the mapping. For many kernel…

机器学习 · 计算机科学 2024-10-17 Kamaledin Ghiasi-Shirazi , Mohammadreza Qaraei

This paper considers different facets of the interplay between reproducing kernel Hilbert spaces (RKHS) and stable analysis/synthesis processes: First, we analyze the structure of the reproducing kernel of a RKHS using frames and…

泛函分析 · 数学 2019-04-02 Michael Speckbacher , Peter Balazs

Regularized approaches have been successfully applied to linear system identification in recent years. Many of them model unknown impulse responses exploiting the so called Reproducing Kernel Hilbert spaces (RKHSs) that enjoy the notable…

机器学习 · 计算机科学 2019-09-06 Mauro Bisiacco , Gianluigi Pillonetto

We introduce a complex-valued counterpart of the representer theorem in machine learning. We study several learning and minimization problems in reproducing kernel Hilbert spaces (RKHSs), with the aim of identifying appropriate input-output…

泛函分析 · 数学 2026-04-28 Natanael Alpay , Antonino De Martino , Kamal Diki

Accurate energy demand forecasting is crucial for sustainable and resilient energy development. To meet the Net Zero Representative Concentration Pathways (RCP) $4.5$ scenario in the DACH countries, increased renewable energy production,…

机器学习 · 计算机科学 2024-09-17 Luca Pernigo , Rohan Sen , Davide Baroli