English
Related papers

Related papers: Learning Hamiltonian Dynamics with Reproducing Ker…

200 papers

The Hamiltonian of an isolated quantum mechanical system determines its dynamics and physical behaviour. This study investigates the possibility of learning and utilising a system's Hamiltonian and its variational thermal state estimation…

Quantum Physics · Physics 2023-12-22 Jack Y. Araz , Michael Spannowsky

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

Mean-field control problems have received continuous interest over the last decade. Despite being more intricate than in classical optimal control, the linear-quadratic setting can still be tackled through Riccati equations. Remarkably, we…

Optimization and Control · Mathematics 2023-08-23 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

We study reproducing kernels, and associated reproducing kernel Hilbert spaces (RKHSs) $\mathscr{H}$ over infinite, discrete and countable sets $V$. In this setting we analyze in detail the distributions of the corresponding Dirac…

Functional Analysis · Mathematics 2015-01-13 Palle Jorgensen , Feng Tian

Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding the additive…

Machine Learning · Computer Science 2024-08-16 Zi-Yu Khoo , Dawen Wu , Jonathan Sze Choong Low , Stéphane Bressan

Non-linear systems of differential equations have attracted the interest in fields like system biology, ecology or biochemistry, due to their flexibility and their ability to describe dynamical systems. Despite the importance of such models…

Methodology · Statistics 2014-05-09 Javier González , Ivan Vujačić , Ernst Wit

The Hamiltonian Monte Carlo method generates samples by introducing a mechanical system that explores the target density. For distributions on manifolds it is not always simple to perform the mechanics as a result of the lack of global…

Computation · Statistics 2019-04-22 Alessandro Barp , Anthony Kennedy , Mark Girolami

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

We introduce a nonparametric algorithm to learn interaction kernels of mean-field equations for 1st-order systems of interacting particles. The data consist of discrete space-time observations of the solution. By least squares with…

Machine Learning · Statistics 2020-10-30 Quanjun Lang , Fei Lu

Many applications, such as optimization, uncertainty quantification and inverse problems, require repeatedly performing simulations of large-dimensional physical systems for different choices of parameters. This can be prohibitively…

Machine Learning · Computer Science 2023-12-18 Benedikt Brantner , Michael Kraus

Regressing the vector field of a dynamical system from a finite number of observed states is a natural way to learn surrogate models for such systems. A simple and interpretable way to learn a dynamical system from data is to interpolate…

Machine Learning · Statistics 2023-02-28 Lu Yang , Xiuwen Sun , Boumediene Hamzi , Houman Owhadi , Naiming Xie

We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number…

Machine Learning · Computer Science 2018-03-14 Pantelis Bouboulis , Symeon Chouvardas , Sergios Theodoridis

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

The solution of problems in physics is often facilitated by a change of variables. In this work we present neural transformations to learn symmetries of Hamiltonian mechanical systems. Maintaining the Hamiltonian structure requires novel…

Computational Physics · Physics 2019-06-12 Roberto Bondesan , Austen Lamacraft

Supervised learning in reproducing kernel Hilbert space (RKHS) and vector-valued RKHS (vvRKHS) has been investigated for more than 30 years. In this paper, we provide a new twist to this rich literature by generalizing supervised learning…

Machine Learning · Statistics 2024-06-27 Yuka Hashimoto , Masahiro Ikeda , Hachem Kadri

Data-driven modeling is playing an increasing role in robotics and control, yet standard learning methods typically ignore the geometric structure of nonholonomic systems. As a consequence, the learned dynamics may violate the nonholonomic…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Thomas Beckers , Anthony Bloch , Leonardo Colombo

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Machine Learning · Statistics 2014-06-16 Dino Sejdinovic , Heiko Strathmann , Maria Lomeli Garcia , Christophe Andrieu , Arthur Gretton

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

Adversarial training has emerged as a key technique to enhance model robustness against adversarial input perturbations. Many of the existing methods rely on computationally expensive min-max problems that limit their application in…

Machine Learning · Statistics 2025-10-27 Antônio H. Ribeiro , David Vävinggren , Dave Zachariah , Thomas B. Schön , Francis Bach