English
Related papers

Related papers: Extrapolation and generative algorithms for three …

200 papers

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

We develop a rigorous framework for extending neural operators to handle out-of-distribution input functions. We leverage kernel approximation techniques and provide theory for characterizing the input-output function spaces in terms of…

Machine Learning · Computer Science 2026-03-05 Blaine Quackenbush , Paul J. Atzberger

We develop a new framework for estimating joint probability distributions using tensor product reproducing kernel Hilbert spaces (RKHS). Our framework accommodates a low-dimensional, normalized and positive model of a Radon--Nikodym…

Machine Learning · Statistics 2024-09-25 Damir Filipovic , Michael Multerer , Paul Schneider

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2021-12-22 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

In an era where scientific experiments can be very costly, multi-fidelity emulators provide a useful tool for cost-efficient predictive scientific computing. For scientific applications, the experimenter is often limited by a tight…

Methodology · Statistics 2023-10-30 Chih-Li Sung , Yi Ji , Simon Mak , Wenjia Wang , Tao Tang

We merge computational mechanics' definition of causal states (predictively-equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely-applicable method that infers causal structure…

Machine Learning · Computer Science 2024-06-19 Nicolas Brodu , James P. Crutchfield

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general…

Machine Learning · Computer Science 2014-11-20 Markus Heinonen , Florence d'Alché-Buc

We present a quantum algorithm to solve systems of linear equations of the form $A\mathbf{x}=\mathbf{b}$, where $A$ is a tridiagonal Toeplitz matrix and $\mathbf{b}$ results from discretizing an analytic function, with a circuit complexity…

Quantum Physics · Physics 2022-01-17 Almudena Carrera Vazquez , Ralf Hiptmair , Stefan Woerner

We propose kernel distributionally robust optimization (Kernel DRO) using insights from the robust optimization theory and functional analysis. Our method uses reproducing kernel Hilbert spaces (RKHS) to construct a wide range of convex…

Optimization and Control · Mathematics 2021-06-28 Jia-Jie Zhu , Wittawat Jitkrittum , Moritz Diehl , Bernhard Schölkopf

In this paper we introduce a reproducing kernel Hilbert space defined on $\mathbb{R}^{d+1}$ as the tensor product of a reproducing kernel defined on the unit sphere $\mathbb{S}^{d}$ in $\mathbb{R}^{d+1}$ and a reproducing kernel defined on…

Numerical Analysis · Mathematics 2015-12-24 Johann S. Brauchart , Josef Dick , Lou Fang

We present a machine-learning method for predicting sharp transitions in a Hamiltonian phase diagram by extrapolating the properties of quantum systems. The method is based on Gaussian Process regression with a combination of kernels chosen…

Other Condensed Matter · Physics 2019-04-26 Rodrigo A. Vargas-Hernández , John Sous , Mona Berciu , Roman V. Krems

In this paper, we consider the Gaussian process (GP) bandit optimization problem in a non-stationary environment. To capture external changes, the black-box function is allowed to be time-varying within a reproducing kernel Hilbert space…

Machine Learning · Computer Science 2022-03-29 Yuntian Deng , Xingyu Zhou , Baekjin Kim , Ambuj Tewari , Abhishek Gupta , Ness Shroff

In this paper, the evolution equation that defines the online critic for the approximation of the optimal value function is cast in a general class of reproducing kernel Hilbert spaces (RKHSs). Exploiting some core tools of RKHS theory,…

Recent cosmological observations have achieved high-precision measurements of the Universe's expansion history, prompting the use of nonparametric methods such as Gaussian processes (GP) regression. We apply GP regression for reconstructing…

Cosmology and Nongalactic Astrophysics · Physics 2025-11-21 Jia-yan Jiang , Kang Jiao , Tong-Jie Zhang

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

Operator-Valued Kernels (OVKs) and associated vector-valued Reproducing Kernel Hilbert Spaces provide an elegant way to extend scalar kernel methods when the output space is a Hilbert space. Although primarily used in finite dimension for…

Machine Learning · Statistics 2020-08-24 Pierre Laforgue , Alex Lambert , Luc Brogat-Motte , Florence d'Alché-Buc

We consider the maximum causal entropy inverse reinforcement learning (IRL) problem for infinite-horizon stationary mean-field games (MFG), in which we model the unknown reward function within a reproducing kernel Hilbert space (RKHS). This…

Machine Learning · Computer Science 2026-03-06 Berkay Anahtarci , Can Deha Kariksiz , Naci Saldi

We consider the problem of approximating the regression function $f_\mu:\, \Omega \to Y$ from noisy $\mu$-distributed vector-valued data $(\omega_m,y_m)\in\Omega\times Y$ by an online learning algorithm using a reproducing kernel Hilbert…

Machine Learning · Statistics 2025-10-03 Michael Griebel , Peter Oswald