English
Related papers

Related papers: A Neural PDE Solver with Temporal Stencil Modeling

200 papers

Partial Differential Equations (PDEs) are the bedrock for modern computational sciences and engineering, and inherently computationally expensive. While PDE foundation models have shown much promise for simulating such complex…

Accurate simulation of turbulent flows remains a challenge due to the high computational cost of direct numerical simulations (DNS) and the limitations of traditional turbulence models. This paper explores a novel approach to augmenting…

Fluid Dynamics · Physics 2025-02-17 Jonas Luther , Patrick Jenny

Neural PDE solvers offer a powerful tool for modeling complex dynamical systems, but often struggle with error accumulation over long time horizons and maintaining stability and physical consistency. We introduce a multiscale implicit…

Machine Learning · Computer Science 2025-06-06 Ruoxi Jiang , Xiao Zhang , Karan Jakhar , Peter Y. Lu , Pedram Hassanzadeh , Michael Maire , Rebecca Willett

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

Spatial-temporal forecasting and imputation are important for real-world intelligent systems. Most existing methods are tailored for individual forecasting or imputation tasks but are not designed for both. Additionally, they are less…

Machine Learning · Computer Science 2025-05-21 YiHeng Huang , Xiaowei Mao , Shengnan Guo , Yubin Chen , Junfeng Shen , Tiankuo Li , Youfang Lin , Huaiyu Wan

Reservoir computing (RC), is a class of computational methods such as Echo State Networks (ESN) and Liquid State Machines (LSM) describe a generic method to perform pattern recognition and temporal analysis with any non-linear system. This…

Machine Learning · Computer Science 2024-11-19 Anmol Biswas , Sharvari Ashok Medhe , Raghav Singhal , Udayan Ganguly

The modeling, computational cost, and accuracy of traditional Spatio-temporal networks are the three most concentrated research topics in video action recognition. The traditional 2D convolution has a low computational cost, but it cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhaoqilin Yang , Gaoyun An

We introduce a novel spectral, finite-dimensional approximation of general Sobolev spaces in terms of Chebyshev polynomials. Based on this polynomial surrogate model (PSM), we realise a variational formulation, solving a vast class of…

Numerical Analysis · Mathematics 2023-01-13 Juan-Esteban Suarez Cardona , Phil-Alexander Hofmann , Michael Hecht

Simulating turbulence is critical for many societally important applications in aerospace engineering, environmental science, the energy industry, and biomedicine. Large eddy simulation (LES) has been widely used as an alternative to direct…

Fluid Dynamics · Physics 2023-12-13 Shengyu Chen , Tianshu Bao , Peyman Givi , Can Zheng , Xiaowei Jia

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by…

Machine Learning · Computer Science 2024-01-17 Xin-Yang Liu , Min Zhu , Lu Lu , Hao Sun , Jian-Xun Wang

The rapid advancement of Intelligent Transportation Systems (ITS) presents challenges, particularly with missing data in multi-modal transportation and the complexity of handling diverse sequential tasks within a centralized framework. To…

Machine Learning · Computer Science 2024-09-11 Zhiqi Shao , Haoning Xi , Haohui Lu , Ze Wang , Michael G. H. Bell , Junbin Gao

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

Recursive reasoning models such as Hierarchical Reasoning Model (HRM) and Tiny Recursive Model (TRM) show that small, weight-shared networks can solve compute-heavy and NP puzzles by iteratively refining latent states, but their training…

Artificial Intelligence · Computer Science 2026-03-18 Navid Hakimi

Learning the fine-scale details of a coastal ocean simulation from a coarse representation is a challenging task. For real-world applications, high-resolution simulations are necessary to advance understanding of many coastal processes,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-09 Zhi-Song Liu , Markus Büttner , Matthew Scarborough , Eirik Valseth , Vadym Aizinger , Bernhard Kainz , Andreas Rupp

Time series forecasting (TSF) is critical across domains such as finance, meteorology, and energy. While extending the lookback window theoretically provides richer historical context, in practice, it often introduces irrelevant noise and…

Machine Learning · Computer Science 2026-04-03 Xiang Ao , Yinyu Tan , Mengru Chen

Sensing is a universal task in science and engineering. Downstream tasks from sensing include inferring full state estimates of a system (system identification), control decisions, and forecasting. These tasks are exceptionally challenging…

Dynamical Systems · Mathematics 2024-06-06 Jan P. Williams , Olivia Zahn , J. Nathan Kutz

We develop time-series machine learning (ML) methods for closure modeling of the Unsteady Reynolds Averaged Navier Stokes (URANS) equations applied to stably stratified turbulence (SST). SST is strongly affected by fine balances between…

Deep learning has become a one-size-fits-all solution for technical and business domains thanks to its flexibility and adaptability. It is implemented using opaque models, which unfortunately undermines the outcome trustworthiness. In order…

Machine Learning · Computer Science 2022-08-04 Anh-Duy Pham , Anastassia Kuestenmacher , Paul G. Ploeger

Dynamic Mode Decomposition (DMD) is an equation-free method that aims at reconstructing the best linear fit from temporal datasets. In this paper, we show that DMD does not provide accurate approximation for datasets describing oscillatory…

Numerical Analysis · Mathematics 2023-03-14 Alessandro Alla , Angela Monti , Ivonne Sgura

Finite-difference methods are widely used in solving partial differential equations. In a large problem set, approximations can take days or weeks to evaluate, yet the bulk of computation may occur within a single loop nest. The modelling…

Performance · Computer Science 2018-06-22 Nicholas Sim