English
Related papers

Related papers: Learning interpretable continuous-time models of l…

200 papers

Many consequential real-world systems, like wind fields and ocean currents, are dynamic and hard to model. Learning their governing dynamics remains a central challenge in scientific machine learning. Dynamic Mode Decomposition (DMD)…

Machine Learning · Computer Science 2025-11-26 Yujin Kim , Sarah Dean

$\textbf{This is the conference version of our paper: Spatiotemporal Implicit Neural Representation as a Generalized Traffic Data Learner}$. Spatiotemporal Traffic Data (STTD) measures the complex dynamical behaviors of the multiscale…

Machine Learning · Computer Science 2024-06-14 Tong Nie , Guoyang Qin , Wei Ma , Jian Sun

We study the learning dynamics of a multi-pass, mini-batch Stochastic Gradient Descent (SGD) procedure for empirical risk minimization in high-dimensional multi-index models with isotropic random data. In an asymptotic regime where the…

Machine Learning · Statistics 2026-02-19 Zhou Fan , Leda Wang

We present results on parameter estimation and non-parameter estimation of the linear partially observed Gaussian system of stochastic differential equations. We propose new one-step estimators which have the same asymptotic properties as…

Statistics Theory · Mathematics 2019-04-23 Yury A. Kutoyants , Li Zhou

Neural network modules conditioned by known priors can be effectively trained and combined to represent systems with nonlinear dynamics. This work explores a novel formulation for data-efficient learning of deep control-oriented nonlinear…

Dynamical Systems · Mathematics 2021-01-07 Elliott Skomski , Soumya Vasisht , Colby Wight , Aaron Tuor , Jan Drgona , Draguna Vrabie

Stochastic dynamical systems are ubiquitous in physics, biology, and engineering, where both deterministic drifts and random fluctuations govern system behavior. Learning these dynamics from data is particularly challenging in…

Numerical Analysis · Mathematics 2026-03-10 Ziheng Guo , Igor Cialenco , Ming Zhong

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

We study non-parametric estimation of choice models, which were introduced to alleviate unreasonable assumptions in traditional parametric models, and are prevalent in several application areas. Existing literature focuses only on the…

Optimization and Control · Mathematics 2020-08-07 Nam Ho-Nguyen , Fatma Kilinc-Karzan

This paper introduces a continuous-time stochastic dynamical framework for understanding how large language models (LLMs) may self-amplify latent biases or toxicity through their own chain-of-thought reasoning. The model posits an…

Computation and Language · Computer Science 2025-01-29 Jack David Carson

We introduce and analyze a method of learning-informed parameter identification for partial differential equations (PDEs) in an all-at-once framework. The underlying PDE model is formulated in a rather general setting with three unknowns:…

Optimization and Control · Mathematics 2023-08-25 Christian Aarset , Martin Holler , Tram Thi Ngoc Nguyen

This letter presents a non-parametric modeling approach for forecasting stochastic dynamical systems on low-dimensional manifolds. The key idea is to represent the discrete shift maps on a smooth basis which can be obtained by the diffusion…

Dynamical Systems · Mathematics 2015-03-25 Tyrus Berry , Dimitrios Giannakis , John Harlim

Stochastic discriminative EM (sdEM) is an online-EM-type algorithm for discriminative training of probabilistic generative models belonging to the exponential family. In this work, we introduce and justify this algorithm as a stochastic…

Machine Learning · Computer Science 2017-04-05 Andres R. Masegosa

Data-driven discovery of model equations is a powerful approach for understanding the behavior of dynamical systems in many scientific fields. In particular, the ability to learn mathematical models from data would benefit systems biology,…

Machine Learning · Computer Science 2025-11-04 G. Pillonetto , A. Giaretta , A. Aravkin , M. Bisiacco , T. Elston

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

Interpretation of common-yet-challenging interaction scenarios can benefit well-founded decisions for autonomous vehicles. Previous research achieved this using their prior knowledge of specific scenarios with predefined models, limiting…

Robotics · Computer Science 2022-05-31 Chengyuan Zhang , Jiacheng Zhu , Wenshuo Wang , Junqiang Xi

Stochastic differential equations (SDEs) are popular tools to analyse time series data in many areas, such as mathematical finance, physics, and biology. They provide a mechanistic description of the phenomeon of interest, and their…

Methodology · Statistics 2021-02-01 Théo Michelot , Richard Glennie , Catriona Harris , Len Thomas

Nonlinear stochastic motion presents significant challenges for Bayesian particle tracking. To address this challenge, this paper proposes a framework to construct an invertible transformation that maps the nonlinear state-space model (SSM)…

Methodology · Statistics 2026-04-13 Yonatan L. Ashenafi

We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time-dependent nonlinear partial differential equation (PDE), an…

Numerical Analysis · Mathematics 2022-02-28 Elizabeth Qian , Ionut-Gabriel Farcas , Karen Willcox

Scientific measurements are often bottlenecked by suboptimal conditions, whether that be noise, incomplete spatial coverage, or limited resolution, rendering accurate field reconstruction a difficult task. We introduce LatentPDE, a latent…

Machine Learning · Computer Science 2026-04-28 Valerie Tsao , Nathaniel Chaney , Manolis Veveakis

Increasingly larger data sets of processes in space and time ask for statistical models and methods that can cope with such data. We show that the solution of a stochastic advection-diffusion partial differential equation provides a…

Methodology · Statistics 2016-02-18 Fabio Sigrist , Hans R. Künsch , Werner A. Stahel