English
Related papers

Related papers: Continuous PDE Dynamics Forecasting with Implicit …

200 papers

Deep learning inspired by differential equations is a recent research trend and has marked the state of the art performance for many machine learning tasks. Among them, time-series modeling with neural controlled differential equations…

Machine Learning · Computer Science 2022-09-22 Sheo Yon Jhin , Jaehoon Lee , Minju Jo , Seungji Kook , Jinsung Jeon , Jihyeon Hyeong , Jayoung Kim , Noseong Park

Long-horizon spatiotemporal prediction remains a challenging problem due to cumulative errors, noise amplification, and the lack of physical consistency in existing models. While diffusion models provide a probabilistic framework for…

Machine Learning · Computer Science 2026-04-13 Min Young Baeg , Yoon-Yeong Kim

Data-driven modeling techniques have been explored in the spatial-temporal modeling of complex dynamical systems for many engineering applications. However, a systematic approach is still lacking to leverage the information from different…

Machine Learning · Computer Science 2024-10-15 Chuanqi Chen , Jin-Long Wu

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

While diffusion models can successfully generate data and make predictions, they are predominantly designed for static images. We propose an approach for efficiently training diffusion models for probabilistic spatiotemporal forecasting,…

Machine Learning · Computer Science 2023-10-12 Salva Rühling Cachay , Bo Zhao , Hailey Joren , Rose Yu

We present a numerical framework for deep neural network (DNN) modeling of unknown time-dependent partial differential equations (PDE) using their trajectory data. Unlike the recent work of [Wu and Xiu, J. Comput. Phys. 2020], where the…

Machine Learning · Computer Science 2021-11-24 Zhen Chen , Victor Churchill , Kailiang Wu , Dongbin Xiu

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

We present a framework that leverages the Discrete Empirical Interpolation Method (DEIM) for interpretable deep learning and dynamical system analysis. Although DEIM efficiently approximates nonlinear terms in projection-based reduced-order…

Machine Learning · Computer Science 2026-04-03 Hojin Kim , Romit Maulik

Solving time-dependent Partial Differential Equations (PDEs) using a densely discretized spatial domain is a fundamental problem in various scientific and engineering disciplines, including modeling climate phenomena and fluid dynamics.…

Machine Learning · Computer Science 2025-10-24 Jan Hagnberger , Daniel Musekamp , Mathias Niepert

Implicit Neural Representations (INRs) provide a powerful continuous framework for modeling complex visual and geometric signals, but spectral bias remains a fundamental challenge, limiting their ability to capture high-frequency details.…

Machine Learning · Computer Science 2025-12-01 Yesom Park , Kelvin Kan , Thomas Flynn , Yi Huang , Shinjae Yoo , Stanley Osher , Xihaier Luo

We propose derivative-informed neural operators (DINOs), a general family of neural networks to approximate operators as infinite-dimensional mappings from input function spaces to output function spaces or quantities of interest. After…

Numerical Analysis · Mathematics 2023-10-18 Thomas O'Leary-Roseberry , Peng Chen , Umberto Villa , Omar Ghattas

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms.…

Machine Learning · Computer Science 2026-05-12 Mingtao Xia , Xiangting Li , Qijing Shen , Tom Chou

Modelling complex multiphysics systems governed by nonlinear and strongly coupled partial differential equations (PDEs) is a cornerstone in computational science and engineering. However, it remains a formidable challenge for traditional…

Machine Learning · Computer Science 2025-02-28 Biao Yuan , He Wang , Yanjie Song , Ana Heitor , Xiaohui Chen

Spatial-temporal forecasting has attracted tremendous attention in a wide range of applications, and traffic flow prediction is a canonical and typical example. The complex and long-range spatial-temporal correlations of traffic flow bring…

Machine Learning · Computer Science 2021-06-25 Zheng Fang , Qingqing Long , Guojie Song , Kunqing Xie

Physics-informed neural networks (PINNs) have shown promising potential for solving partial differential equations (PDEs) using deep learning. However, PINNs face training difficulties for evolutionary PDEs, particularly for dynamical…

Neural and Evolutionary Computing · Computer Science 2023-12-25 Siqi Chen , Bin Shan , Ye Li

Manifold-learning techniques are routinely used in mining complex spatiotemporal data to extract useful, parsimonious data representations/parametrizations; these are, in turn, useful in nonlinear model identification tasks. We focus here…

Diffusion models have emerged as powerful generative priors for solving PDE-constrained inverse problems. Compared to end-to-end approaches relying on massive paired datasets, explicitly decoupling the prior distribution of physical…

Numerical Analysis · Mathematics 2026-04-23 Haibo Liu , Guang Lin