English
Related papers

Related papers: Learning nonparametric ordinary differential equat…

200 papers

In this work, we consider the problem of learning nonlinear operators that correspond to discrete-time nonlinear dynamical systems with inputs. Given an initial state and a finite input trajectory, such operators yield a finite output…

Optimization and Control · Mathematics 2024-12-25 Mircea Lazar

We present a novel framework for variable selection in Fr\'echet regression with responses in general metric spaces, a setting increasingly relevant for analyzing non-Euclidean data such as probability distributions and covariance matrices.…

Statistics Theory · Mathematics 2025-09-18 Haoyi Yang , Satarupa Bhattacharjee , Lingzhou Xue , Bing Li

Learning from examples is one of the key problems in science and engineering. It deals with function reconstruction from a finite set of direct and noisy samples. Regularization in reproducing kernel Hilbert spaces (RKHSs) is widely used to…

Systems and Control · Computer Science 2016-12-30 Gianluigi Pillonetto

Recent advancements in machine learning have transformed the discovery of physical laws, moving from manual derivation to data-driven methods that simultaneously learn both the structure and parameters of governing equations. This shift…

Machine Learning · Computer Science 2024-10-15 Hillary Hauger , Philipp Scholl , Gitta Kutyniok

We study nonparametric estimation in dynamical systems described by ordinary differential equations (ODEs). Specifically, we focus on estimating the unknown function $f \colon \mathbb{R}^d \to \mathbb{R}^d$ that governs the system dynamics…

Statistics Theory · Mathematics 2025-01-06 Christof Schötz

In this work, a novel quantum Fourier ordinary differential equation (ODE) solver is proposed to solve both linear and nonlinear partial differential equations (PDEs). Traditional quantum ODE solvers transform a PDE into an ODE system via…

Quantum Physics · Physics 2025-04-15 Yang Xiao , Liming Yang , Chang Shu , Yinjie Du , Yuxin Song

We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number…

Machine Learning · Computer Science 2018-03-14 Pantelis Bouboulis , Symeon Chouvardas , Sergios Theodoridis

We present DARTR: a Data Adaptive RKHS Tikhonov Regularization method for the linear inverse problem of nonparametric learning of function parameters in operators. A key ingredient is a system intrinsic data-adaptive (SIDA) RKHS, whose norm…

Machine Learning · Statistics 2022-03-09 Fei Lu , Quanjun Lang , Qingci An

Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on…

Methodology · Statistics 2023-10-25 Mingwei Xu , Samuel W. K. Wong , Peijun Sang

In this paper, we consider unregularized online learning algorithms in a Reproducing Kernel Hilbert Spaces (RKHS). Firstly, we derive explicit convergence rates of the unregularized online learning algorithms for classification associated…

Machine Learning · Computer Science 2015-04-28 Yiming Ying , Ding-Xuan Zhou

When learning dynamical systems from data, embedding physical structure can constrain the solution space and improve generalization, but many physics-informed models assume access to the full system state. This limits their use in partially…

Machine Learning · Computer Science 2026-05-25 Sunniva Meltzer , Sølve Eidnes , Alexander Johannes Stasik

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. Data-driven techniques to learn the Koopman operator typically assume that the chosen function space is closed under…

Machine Learning · Statistics 2025-02-06 Boya Hou , Sina Sanjari , Nathan Dahlin , Alec Koppel , Subhonmesh Bose

Robust physics (e.g., governing equations and laws) discovery is of great interest for many engineering fields and explainable machine learning. A critical challenge compared with general training is that the term and format of governing…

Numerical Analysis · Mathematics 2021-02-15 Zhiming Zhang , Yongming Liu

We propose a reduced-order modeling approach for nonlinear, parameter-dependent ordinary differential equations (ODE). Dimensionality reduction is achieved using nonlinear maps represented by autoencoders. The resulting low-dimensional ODE…

Numerical Analysis · Mathematics 2026-04-16 Enrico Ballini , Marco Gambarini , Alessio Fumagalli , Luca Formaggia , Anna Scotti , Paolo Zunino

A framework for estimation and hypothesis testing of functional restrictions against general alternatives is proposed. The parameter space is a reproducing kernel Hilbert space (RKHS). The null hypothesis does not necessarily define a…

Methodology · Statistics 2018-08-21 Alessio Sancetta

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

Machine Learning · Statistics 2022-02-17 Junhyunng Park , Krikamol Muandet

While there is currently a lot of enthusiasm about "big data", useful data is usually "small" and expensive to acquire. In this paper, we present a new paradigm of learning partial differential equations from {\em small} data. In…

Artificial Intelligence · Computer Science 2018-01-17 Maziar Raissi , George Em Karniadakis

Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise…

Machine Learning · Computer Science 2024-04-30 Mengge Du , Yuntian Chen , Longfeng Nie , Siyu Lou , Dongxiao Zhang

Ordinary differential equations (ODEs) are commonly used to model dynamic behavior of a system. Because many parameters are unknown and have to be estimated from the observed data, there is growing interest in statistics to develop…

Statistics Theory · Mathematics 2010-01-13 Xin Qi , Hongyu Zhao