English
Related papers

Related papers: RKHS Representation of Algebraic Convolutional Fil…

200 papers

We propose a new data-driven approach for learning the fundamental solutions (Green's functions) of various linear partial differential equations (PDEs) given sample pairs of input-output functions. Building off the theory of functional…

Statistics Theory · Mathematics 2023-04-11 George Stepaniants

It is often said that control and estimation problems are in duality. Recently, in (Aubin-Frankowski,2021), we found new reproducing kernels in Linear-Quadratic optimal control by focusing on the Hilbert space of controlled trajectories,…

Optimization and Control · Mathematics 2022-10-14 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

Theoretical studies have proven that the Hilbert space has remarkable performance in many fields of applications. Frames in tensor product of Hilbert spaces were introduced to generalize the inner product to high-order tensors. However,…

Machine Learning · Statistics 2017-11-15 Yunfei Ye

Recent empirical work has shown that hierarchical convolutional kernels inspired by convolutional neural networks (CNNs) significantly improve the performance of kernel methods in image classification tasks. A widely accepted explanation…

Machine Learning · Statistics 2022-06-06 Theodor Misiakiewicz , Song Mei

This paper addresses nonparametric estimation of nonlinear multivariate Hawkes processes, where the interaction functions are assumed to lie in a reproducing kernel Hilbert space (RKHS). Motivated by applications in neuroscience, the model…

Machine Learning · Statistics 2025-03-26 Anna Bonnet , Maxime Sangnier

We consider learning in decentralized heterogeneous networks: agents seek to minimize a convex functional that aggregates data across the network, while only having access to their local data streams. We focus on the case where agents seek…

Optimization and Control · Mathematics 2021-06-02 Hrusikesha Pradhan , Amrit Singh Bedi , Alec Koppel , Ketan Rajawat

Neural operators have emerged as a powerful, data-driven paradigm for learning solution operators of partial differential equations (PDEs). State-of-the-art architectures, such as the Fourier Neural Operator (FNO), have achieved remarkable…

Machine Learning · Computer Science 2025-08-08 Saman Pordanesh , Pejman Shahsavari , Hossein Ghadjari

A linear operator in a Hilbert space defined through the form of Riesz representation naturally introduces a reproducing kernel Hilbert space structure over the range space. Such formulation, called H-HK formulation in this paper, possesses…

Analysis of PDEs · Mathematics 2021-10-27 Tao Qian

Reproducing kernel Hilbert spaces (RKHSs) are very important function spaces, playing an important role in machine learning, statistics, numerical analysis and pure mathematics. Since Lipschitz and H\"older continuity are important…

Functional Analysis · Mathematics 2023-10-30 Christian Fiedler

The matrix-based Renyi's \alpha-entropy functional and its multivariate extension were recently developed in terms of the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel Hilbert space (RKHS).…

Machine Learning · Computer Science 2020-01-27 Shujian Yu , Kristoffer Wickstrøm , Robert Jenssen , Jose C. Principe

We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number…

Machine Learning · Computer Science 2018-03-14 Pantelis Bouboulis , Symeon Chouvardas , Sergios Theodoridis

In this paper we construct and theoretically analyse group equivariant convolutional kernel networks (CKNs) which are useful in understanding the geometry of (equivariant) CNNs through the lens of reproducing kernel Hilbert spaces (RKHSs).…

Machine Learning · Computer Science 2024-08-09 Soutrik Roy Chowdhury

The study of Koopman and Liouville operators over reproducing kernel Hilbert spaces (RKHSs) has been gaining considerable interest over the past decade. In particular, these operators represent nonlinear dynamical systems, and through the…

Functional Analysis · Mathematics 2025-11-06 Sushant Pokhriyal , Joel A Rosenfeld

This paper presents a novel framework for visual object recognition using infinite-dimensional covariance operators of input features in the paradigm of kernel methods on infinite-dimensional Riemannian manifolds. Our formulation provides…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 Hà Quang Minh , Marco San Biagio , Loris Bazzani , Vittorio Murino

Deep learning excels at prediction but often lacks finite-sample guarantees and calibrated uncertainty; RKHS (Reproducing Kernel Hilbert Space)-based methods provide those guarantees but struggle to adapt in high dimensions. We propose…

Methodology · Statistics 2026-05-15 Yongkai Chen , Wenxuan Zhong , Ping Ma

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

For finding the numerical solution of operator equations in many applications a decomposition in subspaces is needed. Therefore, it is necessary to extend the known method of matrix representation to the utilization of fusion frames. In…

Functional Analysis · Mathematics 2020-07-14 Peter Balazs , Mitra Shamsabadi , Ali Akbar Arefijamaal , Chilles Gardon

Learning in the reproducing kernel Hilbert space (RKHS) such as the support vector machine has been recognized as a promising technique. It continues to be highly effective and competitive in numerous prediction tasks, particularly in…

Machine Learning · Computer Science 2025-01-15 Gakuto Obi , Ayato Saito , Yuto Sasaki , Tsuyoshi Kato

Building highly non-linear and non-parametric models is central to several state-of-the-art machine learning systems. Kernel methods form an important class of techniques that induce a reproducing kernel Hilbert space (RKHS) for inferring…

Machine Learning · Statistics 2017-11-16 Huan Song , Jayaraman J. Thiagarajan , Prasanna Sattigeri , Andreas Spanias

In this paper, we give some results concerning atomic decompositions for operators on reproducing kernel Hilbert spaces, using frame theory techniques. We provide also generalizations for atomic decompositions of some theorems for…

Functional Analysis · Mathematics 2014-02-03 Laura Gavruta