English
Related papers

Related papers: Neural Structure Learning with Stochastic Differen…

200 papers

In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames. Traditional numerical simulation systems depend largely on…

Machine Learning · Computer Science 2024-02-12 Kun Wang , Hao Wu , Guibin Zhang , Junfeng Fang , Yuxuan Liang , Yuankai Wu , Roger Zimmermann , Yang Wang

SINDy is a method for learning system of differential equations from data by solving a sparse linear regression optimization problem [Brunton et al., 2016]. In this article, we propose an extension of the SINDy method that learns systems of…

We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning stochastic dynamics from data. This new architecture was theoretically inspired by a universal approximation theorem for stochastic…

Machine Learning · Computer Science 2022-12-28 Yuanran Zhu , Yu-Hang Tang , Changho Kim

We present a hierarchical, control theory inspired method for variational inference (VI) for neural stochastic differential equations (SDEs). While VI for neural SDEs is a promising avenue for uncertainty-aware reasoning in time-series, it…

Machine Learning · Computer Science 2025-05-26 Rembert Daems , Manfred Opper , Guillaume Crevecoeur , Tolga Birdal

Designing video prediction models that account for the inherent uncertainty of the future is challenging. Most works in the literature are based on stochastic image-autoregressive recurrent networks, which raises several performance and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Jean-Yves Franceschi , Edouard Delasalles , Mickaël Chen , Sylvain Lamprier , Patrick Gallinari

In the co-sparse analysis model a set of filters is applied to a signal out of the signal class of interest yielding sparse filter responses. As such, it may serve as a prior in inverse problems, or for structural analysis of signals that…

Machine Learning · Computer Science 2015-10-07 Matthias Seibert , Julian Wörmann , Rémi Gribonval , Martin Kleinsteuber

Traffic flow forecasting is a fundamental research issue for transportation planning and management, which serves as a canonical and typical example of spatial-temporal predictions. In recent years, Graph Neural Networks (GNNs) and…

Machine Learning · Computer Science 2024-02-27 Qingqing Long , Zheng Fang , Chen Fang , Chong Chen , Pengfei Wang , Yuanchun Zhou

Neural ordinary differential equations (NODEs) are an effective approach for data-driven modeling of dynamical systems arising from simulations and experiments. One of the major shortcomings of NODEs, especially when coupled with explicit…

Numerical Analysis · Mathematics 2025-12-30 Allen Alvarez Loya , Daniel A. Serino , J. W. Burby , Qi Tang

Recent studies in multivariate time series (MTS) forecasting reveal that explicitly modeling the hidden dependencies among different time series can yield promising forecasting performance and reliable explanations. However, modeling…

Machine Learning · Computer Science 2024-02-21 Zijie Pan , Yushan Jiang , Dongjin Song , Sahil Garg , Kashif Rasul , Anderson Schneider , Yuriy Nevmyvaka

We propose a new class of parameterizations for spatio-temporal point processes which leverage Neural ODEs as a computational method and enable flexible, high-fidelity models of discrete events that are localized in continuous time and…

Machine Learning · Computer Science 2021-03-19 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

Stochastic Partial Differential Equations (SPDEs) driven by random noise play a central role in modeling physical processes with rough spatio-temporal dynamics, such as turbulence flows, superconductors, and quantum dynamics. Although…

Machine Learning · Computer Science 2026-05-18 Yuantu Zhu , Zheyan Li , Dai Shi , Luke Thompson , Oliver Nash , Jose Miguel Lara Rangel , Siran Li , Bingguang Chen , Rongchan Zhu , Qi Meng , Hao Ni

Representations of sequential data are commonly based on the assumption that observed sequences are realizations of an unknown underlying stochastic process, where the learning problem includes determination of the model parameters. In this…

Machine Learning · Statistics 2019-09-17 Ronny Hug , Wolfgang Hübner , Michael Arens

We propose an approach for learning the causal structure in stochastic dynamical systems with a $1$-step functional dependency in the presence of latent variables. We propose an information-theoretic approach that allows us to recover the…

Information Theory · Computer Science 2017-01-25 Saber Salehkaleybar , Jalal Etesami , Negar Kiyavash

We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeling real-world…

Machine Learning · Computer Science 2023-10-20 Rembert Daems , Manfred Opper , Guillaume Crevecoeur , Tolga Birdal

Modeling dynamical systems and unraveling their underlying causal relationships is central to many domains in the natural sciences. Various physical systems, such as those arising in cell biology, are inherently high-dimensional and…

We propose a new approach to learning the subgrid-scale model when simulating partial differential equations (PDEs) solved by the method of lines and their representation in chaotic ordinary differential equations, based on neural ordinary…

Numerical Analysis · Mathematics 2023-04-14 Shinhoo Kang , Emil M. Constantinescu

In self-driving, predicting future in terms of location and motion of all the agents around the vehicle is a crucial requirement for planning. Recently, a new joint formulation of perception and prediction has emerged by fusing rich sensory…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Adil Kaan Akan , Fatma Güney

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

Machine Learning · Statistics 2023-05-29 Yixiu Zhao , Scott W. Linderman

Personalized medicine based on medical images, including predicting future individualized clinical disease progression and treatment response, would have an enormous impact on healthcare and drug development, particularly for diseases (e.g.…

Artificial Intelligence · Computer Science 2024-06-19 Joshua Durso-Finley , Berardino Barile , Jean-Pierre Falet , Douglas L. Arnold , Nick Pawlowski , Tal Arbel

The data-driven recovery of the unknown governing equations of dynamical systems has recently received an increasing interest. However, the identification of governing equations remains challenging when dealing with noisy and partial…

Machine Learning · Computer Science 2021-02-17 Duong Nguyen , Said Ouala , Lucas Drumetz , Ronan Fablet