English
Related papers

Related papers: The Stochastic Occupation Kernel Method for System…

200 papers

We present a novel kernel-based method for learning multivariate stochastic differential equations (SDEs). The method follows a two-step procedure: we first estimate the drift term function, then the (matrix-valued) diffusion function given…

Machine Learning · Statistics 2025-12-22 Michael L. Wells , Kamel Lahouel , Bruno Jedynak

We propose a novel non-parametric learning paradigm for the identification of drift and diffusion coefficients of multi-dimensional non-linear stochastic differential equations, which relies upon discrete-time observations of the state. The…

Machine Learning · Computer Science 2025-03-11 Riccardo Bonalli , Alessandro Rudi

This manuscript presents a novel approach to nonlinear system identification leveraging densely defined Liouville operators and a new "kernel" function that represents an integration functional over a reproducing kernel Hilbert space (RKHS)…

Optimization and Control · Mathematics 2021-07-07 Joel A. Rosenfeld , Benjamin Russo , Rushikesh Kamalapurkar , Taylor T. Johnson

We introduce a nonparametric algorithm to learn interaction kernels of mean-field equations for 1st-order systems of interacting particles. The data consist of discrete space-time observations of the solution. By least squares with…

Machine Learning · Statistics 2020-10-30 Quanjun Lang , Fei Lu

Learning a nonparametric system of ordinary differential equations from trajectories in a $d$-dimensional state space requires learning $d$ functions of $d$ variables. Explicit formulations often scale quadratically in $d$ unless additional…

Machine Learning · Statistics 2025-07-29 Victor Rielly , Kamel Lahouel , Ethan Lew , Nicholas Fisher , Vicky Haney , Michael Wells , Bruno Jedynak

Learning a stationary diffusion amounts to estimating the parameters of a stochastic differential equation whose stationary distribution matches a target distribution. We build on the recently introduced kernel deviation from stationarity…

Machine Learning · Statistics 2026-01-30 Fabian Bleile , Sarah Lumpp , Mathias Drton

Model inference for dynamical systems aims to estimate the future behaviour of a system from observations. Purely model-free statistical methods, such as Artificial Neural Networks, tend to perform poorly for such tasks. They are therefore…

Machine Learning · Computer Science 2019-08-07 David K. E. Green , Filip Rindler

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

In this work, we propose a simple kernel ridge regression (KRR) framework with a dynamic-aware validation strategy for long-term prediction of complex dynamical systems. By employing a data-driven kernel derived from diffusion maps, the…

Machine Learning · Computer Science 2025-12-30 Jiwoo Song , Daning Huang , John Harlim

We propose a data-driven framework to learn interaction kernels in stochastic multi-agent systems. Our approach aims at identifying the functional form of nonlocal interaction and diffusion terms directly from trajectory data, without any a…

Machine Learning · Computer Science 2026-03-18 Giacomo Albi , Alessandro Alla , Elisa Calzola

One central theme in machine learning is function estimation from sparse and noisy data. An example is supervised learning where the elements of the training set are couples, each containing an input location and an output response. In the…

Machine Learning · Computer Science 2023-10-05 Alberto Giaretta , Mauro Bisiacco , Gianluigi Pillonetto

A scheme is developed for estimating state-dependent drift and diffusion coefficients in a stochastic differential equation from time-series data. The scheme does not require to specify parametric forms for the drift and diffusion…

Biological Physics · Physics 2012-09-28 Jun Ohkubo

Ordinary differential equation (ODE) is widely used in modeling biological and physical processes in science. In this article, we propose a new reproducing kernel-based approach for estimation and inference of ODE given noisy observations.…

Methodology · Statistics 2021-10-26 Xiaowu Dai , Lexin Li

Data-driven discovery of "hidden physics" -- i.e., machine learning of differential equation models underlying observed data -- has recently been approached by embedding the discovery problem into a Gaussian Process regression of spatial…

Machine Learning · Computer Science 2019-08-05 Mamikon Gulian , Maziar Raissi , Paris Perdikaris , George Karniadakis

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

This work presents a distributed algorithm for nonlinear adaptive learning. In particular, a set of nodes obtain measurements, sequentially one per time step, which are related via a nonlinear function; their goal is to collectively…

Information Theory · Computer Science 2016-02-09 Symeon Chouvardas , Moez Draief

Mathematical models for complex systems are often accompanied with uncertainties. The goal of this paper is to extract a stochastic differential equation governing model with observation on stationary probability distributions. We develop a…

Dynamical Systems · Mathematics 2023-04-05 Xiaoli Chen , Hui Wang , Jinqiao Duan

We propose nonparametric estimators of the occupation measure and the occupation density of the diffusion coefficient (stochastic volatility) of a discretely observed It\^{o} semimartingale on a fixed interval when the mesh of the…

Statistics Theory · Mathematics 2014-01-30 Jia Li , Viktor Todorov , George Tauchen

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing
‹ Prev 1 2 3 10 Next ›