English
Related papers

Related papers: A Kernel-based Stochastic Approximation Framework …

200 papers

Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular architecture that…

Machine Learning · Computer Science 2024-06-11 Miguel Liu-Schiaffini , Julius Berner , Boris Bonev , Thorsten Kurth , Kamyar Azizzadenesheli , Anima Anandkumar

Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing,…

Machine Learning · Computer Science 2024-08-14 Nicholas H. Nelsen , Andrew M. Stuart

This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As…

Machine Learning · Computer Science 2017-07-13 Niloofar Yousefi , Cong Li , Mansooreh Mollaghasemi , Georgios Anagnostopoulos , Michael Georgiopoulos

The theory of Koopman operators allows to deploy non-parametric machine learning algorithms to predict and analyze complex dynamical systems. Estimators such as principal component regression (PCR) or reduced rank regression (RRR) in kernel…

This paper introduces a computational framework to identify nonlinear input-output operators that fit a set of system trajectories while satisfying incremental integral quadratic constraints. The data fitting algorithm is thus regularized…

Optimization and Control · Mathematics 2021-10-25 Henk J. van Waarde , Rodolphe Sepulchre

In this paper, by mapping datasets to a set of non-linear coherent states, the process of encoding inputs in quantum states as a non-linear feature map is re-interpreted. As a result of this fact that the Radial Basis Function is recovered…

Quantum Physics · Physics 2020-07-17 Prayag Tiwari , Shahram Dehdashti , Abdul Karim Obeid , Massimo Melucci , Peter Bruza

Studying nonlinear dynamical systems through their state space behavior can be challenging, and one possible alternative is to analyze them via their associated Koopman operator. This turns the nonlinear problem into a linear,…

Dynamical Systems · Mathematics 2026-04-29 Erik Lien Bolager , Boumediene Hamzi , Houman Owhadi , Ioannis G. Kevrekidis , Felix Dietrich

We propose a new random sketching approach for embedding high-dimensional Hilbert-Schmidt operators, using random input-output pairs. Such operator can then be approximated in a low-dimensional subspace of operators by solving a small…

Numerical Analysis · Mathematics 2026-04-15 Oleg Balabanov , Anthony Nouy , Alexandre Pasco

We consider frames F in a given Hilbert space, and we show that every F may be obtained in a constructive way from a reproducing kernel and an orthonormal basis in an ambient Hilbert space. The construction is operator-theoretic, building…

Classical Analysis and ODEs · Mathematics 2007-05-23 Palle E. T. Jorgensen

Signal processing tasks as fundamental as sampling, reconstruction, minimum mean-square error interpolation and prediction can be viewed under the prism of reproducing kernel Hilbert spaces. Endowing this vantage point with contemporary…

Machine Learning · Computer Science 2013-02-25 Juan Andres Bazerque , Georgios B. Giannakis

Machine learning models can represent climate processes that are nonlocal in horizontal space, height, and time, often by combining information across these dimensions in highly nonlinear ways. While this can improve predictive skill, it…

Machine Learning · Computer Science 2026-05-14 Savannah L. Ferretti , Jerry Lin , Sara Shamekh , Jane W. Baldwin , Michael S. Pritchard , Tom Beucler

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li

Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Mingyuan Jiu , Hichem Sahbi

This article presents a quantum computing approach to designing of similarity measures and kernels for classification of stochastic symbolic time series. In the area of machine learning, kernels are important components of various…

Quantum Physics · Physics 2025-06-10 Vanio Markov , Vladimir Rastunkov , Daniel Fry

Many dimensionality and model reduction techniques rely on estimating dominant eigenfunctions of associated dynamical operators from data. Important examples include the Koopman operator and its generator, but also the Schr\"odinger…

Dynamical Systems · Mathematics 2021-04-06 Stefan Klus , Feliks Nüske , Boumediene Hamzi

Several non-linear operators in stochastic analysis, such as solution maps to stochastic differential equations, depend on a temporal structure which is not leveraged by contemporary neural operators designed to approximate general maps…

Dynamical Systems · Mathematics 2025-04-11 Luca Galimberti , Anastasis Kratsios , Giulia Livieri

This paper considers the design of nonlinear data-enabled predictive control (DeePC) using kernel functions. Compared with existing methods that use kernels to parameterize multi-step predictors for nonlinear DeePC, we adopt a novel,…

Optimization and Control · Mathematics 2025-01-30 Thomas de Jong , Siep Weiland , Mircea Lazar

In this work, we study the Kuelbs-Steadman-2 space (KS-2 space), a Hilbert space constructed via the Henstock-Kurzweil integral, which allows handling non-absolutely integrable functions. We present the construction of the KS-2 space over…

Functional Analysis · Mathematics 2025-08-27 F. Andrade da Silva , K. Gonzalez , T. Jordão

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

Machine Learning · Statistics 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2020-03-03 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara