English
Related papers

Related papers: A Kernel-based Stochastic Approximation Framework …

200 papers

We study the problem of structured output learning from a regression perspective. We first provide a general formulation of the kernel dependency estimation (KDE) problem using operator-valued kernels. We show that some of the existing…

Machine Learning · Statistics 2015-07-16 Hachem Kadri , Mohammad Ghavamzadeh , Philippe Preux

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

Consider the problem: given the data pair $(\mathbf{x}, \mathbf{y})$ drawn from a population with $f_*(x) = \mathbf{E}[\mathbf{y} | \mathbf{x} = x]$, specify a neural network model and run gradient flow on the weights over time until…

Machine Learning · Statistics 2020-07-27 Xialiang Dou , Tengyuan Liang

While many problems in machine learning focus on learning mappings between finite-dimensional spaces, scientific applications require approximating mappings between function spaces, i.e., operators. We study the problem of learning…

Machine Learning · Computer Science 2025-10-30 Adrien Weihs , Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

Operator learning focuses on approximating mappings $\mathcal{G}^\dagger:\mathcal{U} \rightarrow\mathcal{V}$ between infinite-dimensional spaces of functions, such as $u: \Omega_u\rightarrow\mathbb{R}$ and $v:…

Machine Learning · Computer Science 2024-09-10 Carlos Mora , Amin Yousefpour , Shirin Hosseinmardi , Houman Owhadi , Ramin Bostanabad

The solution of a partial differential equation can be obtained by computing the inverse operator map between the input and the solution space. Towards this end, we introduce a \textit{multiwavelet-based neural operator learning scheme}…

Machine Learning · Computer Science 2021-10-12 Gaurav Gupta , Xiongye Xiao , Paul Bogdan

We are interested in mesh-free formulas based on the Monte-Carlo methodology for the approximation of multi-dimensional integrals, and we investigate their accuracy when the functions belong to a reproducing-kernel space. A kernel typically…

Analysis of PDEs · Mathematics 2020-08-26 Philippe G. LeFloch , Jean-Marc Mercier

In this article, we develop a kernel-based framework for constructing dynamic, pathdependent trading strategies under a mean-variance optimisation criterion. Building on the theoretical results of (Muca Cirone and Salvi, 2025), we…

Trading and Market Microstructure · Quantitative Finance 2025-07-16 Owen Futter , Nicola Muca Cirone , Blanka Horvath

Recent studies show that a reproducing kernel Hilbert space (RKHS) is not a suitable space to model functions by neural networks as the curse of dimensionality (CoD) cannot be evaded when trying to approximate even a single ReLU neuron…

Machine Learning · Statistics 2024-06-27 Fanghui Liu , Leello Dadi , Volkan Cevher

We study integral operators on the space of square-integrable functions from a compact set, $X$, to a separable Hilbert space, $H$. The kernel of such an operator takes values in the ideal of Hilbert-Schmidt operators on $H$. We establish…

Functional Analysis · Mathematics 2024-08-12 John Zweck , Yuri Latushkin , Erika Gallo

We generalize Jan Willems' behavioral approach to a class of discrete-time nonlinear systems in a vector-valued reproducing kernel Hilbert space (RKHS). Apart from linear time-invariant systems, this class covers nonlinear systems modeled…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Boya Hou , Maxim Raginsky

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the…

Methodology · Statistics 2022-07-19 Peijun Sang , Bing Li

This paper develops a nonlinear operator dynamic that progressively removes the influence of a prescribed feature subspace while retaining maximal structure elsewhere. The induced sequence of positive operators is monotone, admits an exact…

Functional Analysis · Mathematics 2025-12-05 James Tian

We present statistical convergence results for the learning of (possibly) non-linear mappings in infinite-dimensional spaces. Specifically, given a map $G_0:\mathcal X\to\mathcal Y$ between two separable Hilbert spaces, we analyze the…

Statistics Theory · Mathematics 2024-12-24 Niklas Reinhardt , Sven Wang , Jakob Zech

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

We present a novel property-preserving kernel-based operator learning method for incompressible flows governed by the incompressible Navier--Stokes equations. Traditional numerical solvers incur significant computational costs to respect…

Fluid Dynamics · Physics 2026-04-16 Ramansh Sharma , Matthew Lowery , Houman Owhadi , Varun Shankar

We propose a framework for transfer learning of discount curves across different fixed-income product classes. Motivated by challenges in estimating discount curves from sparse or noisy data, we extend kernel ridge regression (KR) to a…

Machine Learning · Statistics 2026-01-14 Nicolas Camenzind , Damir Filipovic

Deep neural networks dominate modern machine learning, while alternative function approximators remain comparatively underexplored at scale. In this work, we revisit kernel methods as drop-in components for standard deep learning pipelines.…

Machine Learning · Computer Science 2026-05-05 Jean-Marc Mercier , Gabriele Santin

$C^*$-algebra-valued kernels could pave the way for the next generation of kernel machines. To further our fundamental understanding of learning with $C^*$-algebraic kernels, we propose a new class of positive definite kernels based on the…

Machine Learning · Statistics 2025-03-11 Yuka Hashimoto , Ayoub Hafid , Masahiro Ikeda , Hachem Kadri
‹ Prev 1 8 9 10 Next ›