中文
相关论文

相关论文: Duality for Neural Networks through Reproducing Ke…

200 篇论文

We propose a new decentralized robust kernel-based learning algorithm within the framework of reproducing kernel Hilbert spaces (RKHSs) by utilizing a networked system that can be represented as a connected graph. The robust loss function…

机器学习 · 计算机科学 2025-08-18 Zhan Yu , Zhongjie Shi , Ding-Xuan Zhou

We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number…

机器学习 · 计算机科学 2018-03-14 Pantelis Bouboulis , Symeon Chouvardas , Sergios Theodoridis

Reinforcement learning (RL) policies represented in Reproducing Kernel Hilbert Spaces (RKHS) offer powerful representational capabilities. While second-order optimization methods like Newton's method demonstrate faster convergence than…

机器学习 · 计算机科学 2025-06-03 Yixian Zhang , Huaze Tang , Chao Wang , Wenbo Ding

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

机器学习 · 统计学 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general…

机器学习 · 计算机科学 2014-11-20 Markus Heinonen , Florence d'Alché-Buc

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

机器学习 · 统计学 2022-02-17 Junhyunng Park , Krikamol Muandet

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

Regularized approaches have been successfully applied to linear system identification in recent years. Many of them model unknown impulse responses exploiting the so called Reproducing Kernel Hilbert spaces (RKHSs) that enjoy the notable…

机器学习 · 计算机科学 2019-09-06 Mauro Bisiacco , Gianluigi Pillonetto

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimator under the…

机器学习 · 统计学 2026-04-09 Prem Talwai , Ali Shameli , David Simchi-Levi

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

数值分析 · 数学 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

We implement an all-optical setup demonstrating kernel-based quantum machine learning for two-dimensional classification problems. In this hybrid approach, kernel evaluations are outsourced to projective measurements on suitably designed…

In statistical learning theory, interpolation spaces of the form $[\mathrm{L}^2,H]_{\theta,r}$, where $H$ is a reproducing kernel Hilbert space, are in widespread use. So far, however, they are only well understood for fine index $r=2$. We…

泛函分析 · 数学 2025-12-23 Michael Bitzer , Ingo Steinwart

We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed…

机器学习 · 计算机科学 2015-10-28 Masahiro Yukawa

Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the Reproducing Kernel Hilbert Space.…

机器学习 · 计算机科学 2017-04-26 Pantelis Bouboulis , Sergios Theodoridis

Popular safe Bayesian optimization (BO) algorithms learn control policies for safety-critical systems in unknown environments. However, most algorithms make a smoothness assumption, which is encoded by a known bounded norm in a reproducing…

机器学习 · 计算机科学 2025-03-14 Abdullah Tokmak , Kiran G. Krishnan , Thomas B. Schön , Dominik Baumann

One of the key issues in the analysis of machine learning models is to identify the appropriate function space and norm for the model. This is the set of functions endowed with a quantity which can control the approximation and estimation…

机器学习 · 计算机科学 2021-03-30 Weinan E , Chao Ma , Lei Wu

A recent series of theoretical works showed that the dynamics of neural networks with a certain initialisation are well-captured by kernel methods. Concurrent empirical work demonstrated that kernel methods can come close to the performance…

机器学习 · 计算机科学 2021-06-11 Maria Refinetti , Sebastian Goldt , Florent Krzakala , Lenka Zdeborová

This paper considers the construction of Reproducing Kernel Hilbert Spaces (RKHS) on the sphere as an alternative to the conventional Hilbert space using the inner product that yields the L^2(S^2) function space of finite energy signals. In…

信息论 · 计算机科学 2013-12-10 Rodney A. Kennedy , Parastoo Sadeghi , Zubair Khalid , Jason D. McEwen

There has been growing recent interest in probabilistic interpretations of kernel-based methods as well as learning in Banach spaces. The absence of a useful Lebesgue measure on an infinite-dimensional reproducing kernel Hilbert space is a…

机器学习 · 统计学 2014-03-14 Irina Holmes , Ambar Sengupta