English
Related papers

Related papers: Koopman Subspace Pruning in Reproducing Kernel Hil…

200 papers

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

Spatial temporal reconstruction of dynamical system is indeed a crucial problem with diverse applications ranging from climate modeling to numerous chaotic and physical processes. These reconstructions are based on the harmonious…

Dynamical Systems · Mathematics 2025-05-13 Nishant Panda , Himanshu Singh , J. Nathan Kutz

We consider expected risk minimization problems when the range of the estimator is required to be nonnegative, motivated by the settings of maximum likelihood estimation (MLE) and trajectory optimization. To facilitate nonlinear…

Machine Learning · Statistics 2022-05-05 Abhishek Chakraborty , Ketan Rajawat , Alec Koppel

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

The Koopman operator provides a linear framework to study nonlinear dynamical systems. Its spectra offer valuable insights into system dynamics, but the operator can exhibit both discrete and continuous spectra, complicating direct…

Dynamical Systems · Mathematics 2025-05-02 Jonghyeon Lee , Boumediene Hamzi , Boya Hou , Houman Owhadi , Gabriele Santin , Umesh Vaidya

Recent advances suggest that encoding images through Symmetric Positive Definite (SPD) matrices and then interpreting such matrices as points on Riemannian manifolds can lead to increased classification performance. Taking into account…

Computer Vision and Pattern Recognition · Computer Science 2014-08-27 Azadeh Alavi , Arnold Wiliem , Kun Zhao , Brian C. Lovell , Conrad Sanderson

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

Koopman and Perron-Frobenius operators for dynamical systems have been getting popular in a number of fields in science these days. Properties of the Koopman operator essentially depend on the choice of function spaces where it acts.…

Dynamical Systems · Mathematics 2024-01-29 Masahiro Ikeda , Isao Ishikawa , Corbinian Schlosser

We study online regression with the square loss in a reproducing kernel Hilbert space under a dynamic regret criterion. The learner is compared with a time-varying comparator sequence, and the bounds depend on its path length in the RKHS…

Machine Learning · Computer Science 2026-04-29 Dmitry B. Rokhlin , Georgiy A. Karapetyants

This paper develops a frequentist solution to the functional calibration problem, where the value of a calibration parameter in a computer model is allowed to vary with the value of control variables in the physical system. The need of…

Methodology · Statistics 2021-07-20 Rui Tuo , Shiyuan He , Arash Pourhabib , Yu Ding , Jianhua Z. Huang

The X-ray transform is one of the most fundamental integral operators in image processing and reconstruction. In this article, we revisit the formalism of the X-ray transform by considering it as an operator between Reproducing Kernel…

Functional Analysis · Mathematics 2024-06-26 Ho Yun , Victor M. Panaretos

Kernel interpolation is a fundamental technique for approximating functions from scattered data, with a well-understood convergence theory when interpolating elements of a reproducing kernel Hilbert space. Beyond this classical setting,…

Numerical Analysis · Mathematics 2025-05-19 Toni Karvonen , Gabriele Santin , Tizian Wenzel

In Magnetic Resonance Imaging (MRI) data samples are collected in the spatial frequency domain (k-space), typically by time-consuming line-by-line scanning on a Cartesian grid. Scans can be accelerated by simultaneous acquisition of data…

Medical Physics · Physics 2015-03-24 Vivek Athalye , Michael Lustig , Martin Uecker

We present a parallel data-driven strategy to identify finite-dimensional functional spaces invariant under the Koopman operator associated to an unknown dynamical system. We build on the Symmetric Subspace Decomposition (SSD) algorithm, a…

Systems and Control · Electrical Eng. & Systems 2021-03-30 Masih Haseli , Jorge Cortés

Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and…

History and Overview · Mathematics 2015-11-06 Jonathan H. Manton , Pierre-Olivier Amblard

This paper generalizes recent advances on quadratic manifold (QM) dimensionality reduction by developing kernel methods-based nonlinear-augmentation dimensionality reduction. QMs, and more generally feature map-based nonlinear corrections,…

Computational Engineering, Finance, and Science · Computer Science 2025-09-03 Alejandro N. Diaz , Jacob T. Needels , Irina K. Tezaur , Patrick J. Blonigan

This paper establishes error bounds for the convergence of a piecewise linear approximation of the constrained optimal smoothing problem posed in a reproducing kernel Hilbert space (RKHS). This problem can be reformulated as a Bayesian…

Statistics Theory · Mathematics 2025-06-24 Laurence Grammont , François Bachoc , Andrés F. López-Lopera

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

We propose a novel approach for pixel classification in hyperspectral images, leveraging on both the spatial and spectral information in the data. The introduced method relies on a recently proposed framework for learning on distributions…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Gianni Franchi , Jesus Angulo , Dino Sejdinovic

Reduced modeling in high-dimensional reproducing kernel Hilbert spaces offers the opportunity to approximate efficiently non-linear dynamics. In this work, we devise an algorithm based on low rank constraint optimization and kernel-based…

Machine Learning · Computer Science 2020-02-23 Patrick Heas , Cedric Herzet , Benoit Combes