中文
相关论文

相关论文: Analysis of Regularized Least Squares in Reproduci…

200 篇论文

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

系统与控制 · 电气工程与系统科学 2026-04-08 Jannis Lübsen , Annika Eichler

Sparsity of a learning solution is a desirable feature in machine learning. Certain reproducing kernel Banach spaces (RKBSs) are appropriate hypothesis spaces for sparse learning methods. The goal of this paper is to understand what kind of…

泛函分析 · 数学 2024-03-08 Rui Wang , Yuesheng Xu , Mingsong Yan

We consider the random-design least-squares regression problem within the reproducing kernel Hilbert space (RKHS) framework. Given a stream of independent and identically distributed input/output data, we aim to learn a regression function…

统计理论 · 数学 2016-03-30 Aymeric Dieuleveut , Francis Bach

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

统计方法学 · 统计学 2013-05-07 Robert Hable

Kernel ridge regression (KRR), also known as the least-squares support vector machine, is a fundamental method for learning functions from finite samples. While most existing analyses focus on the noisy setting with constant-level label…

机器学习 · 统计学 2025-04-14 Jihao Long , Xiaojun Peng , Lei Wu

The aim of this study is to present a good modernistic strategy for solving some well-known classes of Lane-Emden type singular differential equations. The proposed approach is based on the reproducing kernel Hilbert space (RKHS) and…

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

计算机视觉与模式识别 · 计算机科学 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

Learning convolution kernels in operators from data arises in numerous applications and represents an ill-posed inverse problem of broad interest. With scant prior information, kernel methods offer a natural nonparametric approach with…

数值分析 · 数学 2025-07-17 Haibo Li , Fei Lu

Despite their many appealing properties, kernel methods are heavily affected by the curse of dimensionality. For instance, in the case of inner product kernels in $\mathbb{R}^d$, the Reproducing Kernel Hilbert Space (RKHS) norm is often…

机器学习 · 计算机科学 2021-11-09 Michael Celentano , Theodor Misiakiewicz , Andrea Montanari

In this paper, we study the problem of early stopping for iterative learning algorithms in a reproducing kernel Hilbert space (RKHS) in the nonparametric regression framework. In particular, we work with the gradient descent and (iterative)…

机器学习 · 统计学 2024-11-26 Yaroslav Averyanov , Alain Celisse

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

统计方法学 · 统计学 2010-08-13 Gilles Blanchard , Nicole Kraemer

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

机器学习 · 计算机科学 2015-08-31 Songlin Zhao

Regularized empirical risk minimization including support vector machines plays an important role in machine learning theory. In this paper regularized pairwise learning (RPL) methods based on kernels will be investigated. One example is…

统计理论 · 数学 2015-10-13 Andreas Christmann , Ding-Xuan Zhou

A typical approach in estimating the learning rate of a regularized learning scheme is to bound the approximation error by the sum of the sampling error, the hypothesis error and the regularization error. Using a reproducing kernel space…

机器学习 · 统计学 2011-01-28 Guohui Song , Haizhang Zhang

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

机器学习 · 统计学 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

In this work, we develop and study an empirical projection operator scheme for solving nonparametric regression problems. This scheme is based on an approximate projection of the regression function over a suitable reproducing kernel…

统计理论 · 数学 2020-02-04 Bilel Bousselmi , Jean-François Dupuy , Abderrazek Karoui

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Reproducing kernel Hilbert spaces (RKHSs) are key elements of many non-parametric tools successfully used in signal processing, statistics, and machine learning. In this work, we aim to address three issues of the classical RKHS based…

信号处理 · 电气工程与系统科学 2019-05-09 Maria Peifer , Luiz. F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

机器学习 · 计算机科学 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

机器学习 · 统计学 2022-05-24 Fei Lu , Qingci An , Yue Yu