English
Related papers

Related papers: Solving Support Vector Machines in Reproducing Ker…

200 papers

In this paper we investigate and compare different gradient algorithms designed for the domain expression of the shape derivative. Our main focus is to examine the usefulness of kernel reproducing Hilbert spaces for PDE constrained shape…

Optimization and Control · Mathematics 2016-04-20 Martin Eigel , Kevin Sturm

Geodesic contraction in vector-valued differential equations is readily verified by linearized operators which are uniformly negative-definite in the Riemannian metric. In the infinite-dimensional setting, however, such analysis is…

Dynamical Systems · Mathematics 2022-08-12 Anand Srinivasan , Jean-Jacques Slotine

Well known to the machine learning community, the random feature model is a parametric approximation to kernel interpolation or regression methods. It is typically used to approximate functions mapping a finite-dimensional input space to…

Numerical Analysis · Mathematics 2022-06-23 Nicholas H. Nelsen , Andrew M. Stuart

Bregman divergences play a pivotal role in statistics, machine learning and computational information geometry. Particularly in the context of machine learning, they are central to clustering, exponential families, parameter estimation and…

Machine Learning · Computer Science 2026-04-28 Russell Tsuchida , Frank Nielsen

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

This paper provides a self-contained exposition of coorbit spaces associated to integrable group representations and quasi-Banach function spaces, and at the same time extends and simplifies previous work. The main results provide an…

Functional Analysis · Mathematics 2024-02-26 Jordy Timo van Velthoven , Felix Voigtlaender

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

Contraction rates of time-varying maps induced by dynamical systems illuminate a wide range of asymptotic properties with applications in stability analysis and control theory. In finite-dimensional smoothly varying inner-product spaces…

Dynamical Systems · Mathematics 2022-01-11 Anand Srinivasan , Jean-Jacques Slotine

Nonlinear kernel regression models are often used in statistics and machine learning because they are more accurate than linear models. Variable selection for kernel regression models is a challenge partly because, unlike the linear…

Methodology · Statistics 2017-06-13 Lorin Crawford , Kris C. Wood , Xiang Zhou , Sayan Mukherjee

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

Modeling videos and image-sets as linear subspaces has proven beneficial for many visual recognition tasks. However, it also incurs challenges arising from the fact that linear subspaces do not obey Euclidean geometry, but lie on a special…

Computer Vision and Pattern Recognition · Computer Science 2014-07-07 Mehrtash T. Harandi , Mathieu Salzmann , Sadeep Jayasumana , Richard Hartley , Hongdong Li

Motivated by applications to the study of stochastic processes, we introduce a new analysis of positive definite kernels $K$, their reproducing kernel Hilbert spaces (RKHS), and an associated family of feature spaces that may be chosen in…

Functional Analysis · Mathematics 2017-07-27 Palle Jorgensen , Feng Tian

Traditional functional linear regression usually takes a one-dimensional functional predictor as input and estimates the continuous coefficient function. Modern applications often generate two-dimensional covariates, which become matrices…

Methodology · Statistics 2024-11-26 Dan Yang , Jianlong Shao , Haipeng Shen , Hongtu Zhu

Kernel-based support vector machines (SVMs) are supervised machine learning algorithms for classification and regression problems. We introduce a method to train SVMs on a D-Wave 2000Q quantum annealer and study its performance in…

Machine Learning · Computer Science 2021-01-27 Dennis Willsch , Madita Willsch , Hans De Raedt , Kristel Michielsen

Tensor-based methods are receiving a growing interest in scientific computing for the numerical solution of problems defined in high dimensional tensor product spaces. A family of methods called Proper Generalized Decompositions methods…

Numerical Analysis · Mathematics 2011-12-02 Antonio Falco , Anthony Nouy

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity

Given a reproducing kernel Hilbert space H of real-valued functions and a suitable measure mu over the source space D (subset of R), we decompose H as the sum of a subspace of centered functions for mu and its orthogonal in H. This…

Machine Learning · Statistics 2012-12-10 Nicolas Durrande , David Ginsbourger , Olivier Roustant , Laurent Carraro

The massive amount of available data potentially used to discover patters in machine learning is a challenge for kernel based algorithms with respect to runtime and storage capacities. Local approaches might help to relieve these issues.…

Machine Learning · Statistics 2017-03-21 Florian Dumpert

We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like…

Machine Learning · Computer Science 2013-06-18 Julien Audiffren , Hachem Kadri