English
Related papers

Related papers: Stable Long-Horizon PDE Forecasting via Latent Str…

200 papers

Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications.…

Machine Learning · Computer Science 2026-04-21 Eva van Tegelen , Taniya Kapoor , George A. K. van Voorn , Peter van Heijster , Ioannis N. Athanasiadis

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

Long-term fluid dynamics forecasting is a critically important problem in science and engineering. While neural operators have emerged as a promising paradigm for modeling systems governed by partial differential equations (PDEs), they…

Machine Learning · Computer Science 2026-03-31 Huanshuo Dong , Hao Wu , Hong Wang , Qin-Yi Zhang , Zhezheng Hao

Stochastic partial differential equations (SPDEs) describe the evolution of random processes over space and time, but their solutions are often analytically intractable and computationally expensive to estimate. In this paper, we propose…

Machine Learning · Computer Science 2025-08-12 Ísak Pétursson , María Óskarsdóttir

It is critical yet challenging for deep learning models to properly characterize uncertainty that is pervasive in real-world environments. Although a lot of efforts have been made, such as heteroscedastic neural networks (HNNs), little work…

Machine Learning · Computer Science 2021-03-30 Peng Cui , Zhijie Deng , Wenbo Hu , Jun Zhu

The prevailing of artificial intelligence-of-things calls for higher energy-efficient edge computing paradigms, such as neuromorphic agents leveraging brain-inspired spiking neural network (SNN) models based on spatiotemporally sparse…

Neural and Evolutionary Computing · Computer Science 2024-11-28 Haoran Gao , Xichuan Zhou , Yingcheng Lin , Min Tian , Liyuan Liu , Cong Shi

How to improve generative modeling by better exploiting spatial regularities and coherence in images? We introduce a novel neural network for building image generators (decoders) and apply it to variational autoencoders (VAEs). In our…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Đorđe Miladinović , Aleksandar Stanić , Stefan Bauer , Jürgen Schmidhuber , Joachim M. Buhmann

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a model-based reinforcement learning (RL) framework. Through a…

Machine Learning · Computer Science 2026-03-25 Chao Han , Stefanos Ioannou , Luca Manneschi , T. J. Hayward , Michael Mangan , Aditya Gilra , Eleni Vasilaki

Neural PDE solvers offer a powerful tool for modeling complex dynamical systems, but often struggle with error accumulation over long time horizons and maintaining stability and physical consistency. We introduce a multiscale implicit…

Machine Learning · Computer Science 2025-06-06 Ruoxi Jiang , Xiao Zhang , Karan Jakhar , Peter Y. Lu , Pedram Hassanzadeh , Michael Maire , Rebecca Willett

Accurate forecasting of spatiotemporal data remains challenging due to complex spatial dependencies and temporal dynamics. The inherent uncertainty and variability in such data often render deterministic models insufficient, prompting a…

Machine Learning · Computer Science 2024-11-05 Mingze Gong , Lei Chen , Jia Li

Predictive learning uses a known state to generate a future state over a period of time. It is a challenging task to predict spatiotemporal sequence because the spatiotemporal sequence varies both in time and space. The mainstream method is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Haoyu Pan , Hao Wu , Tan Yang

We introduce Flexi-VAE, a data-driven framework for efficient single-shot forecasting of nonlinear parametric partial differential equations (PDEs), eliminating the need for iterative time-stepping while maintaining high accuracy and…

Machine Learning · Computer Science 2025-05-15 Khalid Rafiq , Wenjing Liao , Aditya G. Nair

We propose the *State Space Neural Operator* (SS-NO), a compact architecture for learning solution operators of time-dependent partial differential equations (PDEs). Our formulation extends structured state space models (SSMs) to joint…

Machine Learning · Computer Science 2026-03-09 Nodens Koren , Samuel Lanthaler

Spiking Neural Networks (SNNs) provide a promising framework for energy-efficient and biologically grounded computation; however, scalable learning in deep recurrent architectures with sparse connectivity remains a major challenge. In this…

Neural and Evolutionary Computing · Computer Science 2026-05-04 Bo Tang , Weiwei Xie

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Short-term load forecasting (STLF) is challenging due to complex time series (TS) which express three seasonal patterns and a nonlinear trend. This paper proposes a novel hybrid hierarchical deep learning model that deals with multiple…

Machine Learning · Computer Science 2021-12-07 Slawek Smyl , Grzegorz Dudek , Paweł Pełka

Despite their impressive performance, contemporary neural networks often lack structural safeguards that promote stable learning and interpretable behavior. In this work, we introduce a reformulation of layer-level transformations that…

Machine Learning · Computer Science 2025-08-04 Saleh Nikooroo , Thomas Engel

We propose Lite-STGNN, a lightweight spatial-temporal graph neural network for long-term multivariate forecasting that integrates decomposition-based temporal modeling with learnable sparse graph structure. The temporal module applies…

Machine Learning · Computer Science 2025-12-22 Henok Tenaw Moges , Deshendran Moodley

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin