中文
相关论文

相关论文: Reliable sampling-based RKHS norm estimation via s…

200 篇论文

Usually, complex-valued RKHS are presented as an straightforward application of the real-valued case. In this paper we prove that this procedure yields a limited solution for regression. We show that another kernel, here denoted as pseudo…

In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein…

统计理论 · 数学 2019-10-07 Thi Thien Trang Bui , J-M Loubes , Laurent Risser , Patricia Balaresque

We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number…

机器学习 · 计算机科学 2018-03-14 Pantelis Bouboulis , Symeon Chouvardas , Sergios Theodoridis

We propose a framework for transfer learning of discount curves across different fixed-income product classes. Motivated by challenges in estimating discount curves from sparse or noisy data, we extend kernel ridge regression (KR) to a…

机器学习 · 统计学 2026-01-14 Nicolas Camenzind , Damir Filipovic

The recent developments of basis pursuit and compressed sensing seek to extract information from as few samples as possible. In such applications, since the number of samples is restricted, one should deploy the sampling points wisely. We…

信息论 · 计算机科学 2012-07-26 Rui Wang , Haizhang Zhang

In this article, we consider convergence rates in functional linear regression with functional responses, where the linear coefficient lies in a reproducing kernel Hilbert space (RKHS). Without assuming that the reproducing kernel and the…

统计方法学 · 统计学 2012-11-20 Heng Lian

The study of Neural Tangent Kernels (NTKs) has provided much needed insight into convergence and generalization properties of neural networks in the over-parametrized (wide) limit by approximating the network using a first-order Taylor…

机器学习 · 统计学 2023-02-02 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

We extend the herding algorithm to continuous spaces by using the kernel trick. The resulting "kernel herding" algorithm is an infinite memory deterministic process that learns to approximate a PDF with a collection of samples. We show that…

机器学习 · 计算机科学 2012-03-19 Yutian Chen , Max Welling , Alex Smola

In this paper, we study an online learning algorithm with a robust loss function $\mathcal{L}_{\sigma}$ for regression over a reproducing kernel Hilbert space (RKHS). The loss function $\mathcal{L}_{\sigma}$ involving a scaling parameter…

机器学习 · 统计学 2023-04-21 Zheng-Chu Guo , Andreas Christmann , Lei Shi

Kernel methods provide a principled approach to nonparametric learning. While their basic implementations scale poorly to large problems, recent advances showed that approximate solvers can efficiently handle massive datasets. A shortcoming…

机器学习 · 计算机科学 2022-01-19 Giacomo Meanti , Luigi Carratino , Ernesto De Vito , Lorenzo Rosasco

Deep learning excels at prediction but often lacks finite-sample guarantees and calibrated uncertainty; RKHS (Reproducing Kernel Hilbert Space)-based methods provide those guarantees but struggle to adapt in high dimensions. We propose…

统计方法学 · 统计学 2026-05-15 Yongkai Chen , Wenxuan Zhong , Ping Ma

We consider the problem of learning a set from random samples. We show how relevant geometric and topological properties of a set can be studied analytically using concepts from the theory of reproducing kernel Hilbert spaces. A new kind of…

机器学习 · 统计学 2014-11-26 Ernesto De Vito , Lorenzo Rosasco , Alessandro Toigo

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

统计理论 · 数学 2016-07-11 Gilles Blanchard , Nicole Krämer

An extension of reproducing kernel Hilbert space (RKHS) theory provides a new framework for modeling functional regression models with functional responses. The approach only presumes a general nonlinear regression structure as opposed to…

统计理论 · 数学 2008-12-17 Heng Lian

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

机器学习 · 统计学 2022-02-17 Junhyunng Park , Krikamol Muandet

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

统计理论 · 数学 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

机器学习 · 计算机科学 2022-02-09 John Paul Ryan , Anil Damle

In this paper, we compute finite sample bounds for data-driven approximations of the solution to stochastic reachability problems. Our approach uses a nonparametric technique known as kernel distribution embeddings, and provides…

最优化与控制 · 数学 2021-12-09 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

We propose a new method for feature learning and function estimation in supervised learning via regularised empirical risk minimisation. Our approach considers functions as expectations of Sobolev functions over all possible one-dimensional…

机器学习 · 统计学 2025-05-01 Bertille Follain , Francis Bach

We propose a vector-valued regression problem whose solution is equivalent to the reproducing kernel Hilbert space (RKHS) embedding of the Bayesian posterior distribution. This equivalence provides a new understanding of kernel Bayesian…

机器学习 · 统计学 2016-10-27 Yang Song , Jun Zhu , Yong Ren