English
Related papers

Related papers: Spectral Eigenfunction Decomposition for Kernel Ad…

200 papers

A data driven, kernel-based method for approximating the leading Koopman eigenvalues, eigenfunctions, and modes in problems with high dimensional state spaces is presented. This approach approximates the Koopman operator using a set of…

Dynamical Systems · Mathematics 2015-07-29 Matthew O. Williams , Clarence W. Rowley , Ioannis G. Kevrekidis

Kernel methods are an incredibly popular technique for extending linear models to non-linear problems via a mapping to an implicit, high-dimensional feature space. While kernel methods are computationally cheaper than an explicit feature…

Machine Learning · Statistics 2019-02-26 Philip Milton , Emanuele Giorgi , Samir Bhatt

In this paper, a novel framework of sparse kernel learning for Support Vector Data Description (SVDD) based anomaly detection is presented. In this work, optimal sparse feature selection for anomaly detection is first modeled as a Mixed…

Machine Learning · Computer Science 2015-06-09 Zhimin Peng , Prudhvi Gurram , Heesung Kwon , Wotao Yin

The existing research on spectral algorithms, applied within a Reproducing Kernel Hilbert Space (RKHS), has primarily focused on general kernel functions, often neglecting the inherent structure of the input feature space. Our paper…

Machine Learning · Statistics 2024-03-08 Weichun Xia , Lei Shi

Neural scene representations achieve high-fidelity rendering by encoding 3D scenes as continuous functions, but their latent spaces are typically implicit and globally entangled, making localized editing and physically grounded manipulation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Mikołaj Zieliński , Krzysztof Byrski , Tomasz Szczepanik , Dominik Belter , Przemysław Spurek

We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed…

Machine Learning · Computer Science 2015-10-28 Masahiro Yukawa

Motivated by the growing interest in representation learning approaches that uncover the latent structure of high-dimensional data, this work proposes new algorithms for reconstruction-based manifold learning within Reproducing-Kernel…

Machine Learning · Computer Science 2026-05-07 Enrique Feito-Casares , Francisco M. Melgarejo-Meseguer , José-Luis Rojo-Álvarez

Modeling non-stationary processes, where statistical properties vary across the input domain, is a critical challenge in machine learning; yet most scalable methods rely on a simplifying assumption of stationarity. This forces a difficult…

Machine Learning · Computer Science 2026-02-03 Sawan Kumar , Souvik Chakraborty

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

We present a general nonlinear Bayesian filter for high-dimensional state estimation using the theory of reproducing kernel Hilbert space (RKHS). Applying kernel method and the representer theorem to perform linear quadratic estimation in a…

Signal Processing · Electrical Eng. & Systems 2019-11-26 Kan Li , Jose C. Principe

Reproducing kernel Hilbert spaces (RKHSs) are key elements of many non-parametric tools successfully used in signal processing, statistics, and machine learning. In this work, we aim to address three issues of the classical RKHS based…

Signal Processing · Electrical Eng. & Systems 2019-05-09 Maria Peifer , Luiz. F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

In this article, we propose a new filtering algorithm based in the Koopman operator, showing that a nonlinear filtering problem can be seen as an equivalent problem where the dynamics is infinite dimensional, but linear. Using Extended…

Dynamical Systems · Mathematics 2025-11-07 Diego Olguín , Axel Osses , Héctor Ramírez

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

Rahimi and Recht (2007) introduced the idea of decomposing positive definite shift-invariant kernels by randomly sampling from their spectral distribution for machine learning applications. This famous technique, known as Random Fourier…

Machine Learning · Computer Science 2026-02-24 Nicolas Langrené , Xavier Warin , Pierre Gruet

Quantum kernel methods are promising for near-term quantum ma- chine learning, yet their behavior under data corruption remains insuf- ficiently understood. We analyze how quantum feature constructions degrade under controlled additive…

Machine Learning · Computer Science 2026-02-24 Pablo Herrero Gómez , Antonio Jimeno Morenilla , David Muñoz-Hernández , Higinio Mora Mora

Convolutional networks are not aware of an object's geometric variations, which leads to inefficient utilization of model and data capacity. To overcome this issue, recent works on deformation modeling seek to spatially reconfigure the data…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Hang Gao , Xizhou Zhu , Steve Lin , Jifeng Dai

Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hilbert Space (RKHS) while making the computation tractable by…

Machine Learning · Statistics 2017-11-28 Shuai Zhang , Jianxin Li , Pengtao Xie , Yingchun Zhang , Minglai Shao , Haoyi Zhou , Mengyi Yan

Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform…

Machine Learning · Statistics 2017-07-14 Felipe Tobar

3D action recognition was shown to benefit from a covariance representation of the input data (joint 3D positions). A kernel machine feed with such feature is an effective paradigm for 3D action recognition, yielding state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

Tensors provide a structured representation for multidimensional data, yet discretization can obscure important information when such data originates from continuous processes. We address this limitation by introducing a functional Tucker…

Machine Learning · Statistics 2026-03-27 Noah Steidle , Joppe De Jonghe , Mariya Ishteva