English
Related papers

Related papers: MENO: Hybrid Matrix Exponential-based Neural Opera…

200 papers

Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input…

Machine Learning · Computer Science 2023-06-16 Zhongkai Hao , Zhengyi Wang , Hang Su , Chengyang Ying , Yinpeng Dong , Songming Liu , Ze Cheng , Jian Song , Jun Zhu

Neural operators aim to approximate the solution operator of a system of differential equations purely from data. They have shown immense success in modeling complex dynamical systems across various domains. However, the occurrence of…

Machine Learning · Computer Science 2025-04-01 Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Neural operators excel as deterministic surrogates, but inevitably collapse to the conditional mean when applied to stochastic PDEs, discarding the variance and tail structure upon which uncertainty quantification depends. Recovering this…

Machine Learning · Computer Science 2026-05-18 Kai Hidajat

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

Machine Learning · Computer Science 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Simulating and controlling physical systems described by partial differential equations (PDEs) are crucial tasks across science and engineering. Recently, diffusion generative models have emerged as a competitive class of methods for these…

Machine Learning · Computer Science 2025-06-27 Peiyan Hu , Rui Wang , Xiang Zheng , Tao Zhang , Haodong Feng , Ruiqi Feng , Long Wei , Yue Wang , Zhi-Ming Ma , Tailin Wu

Predictive simulations of complex systems are essential for applications ranging from weather forecasting to drug design. The veracity of these predictions hinges on their capacity to capture the effective system dynamics. Massively…

Computational Physics · Physics 2021-10-20 Pantelis R. Vlachas , Georgios Arampatzis , Caroline Uhler , Petros Koumoutsakos

A neural network-based machine learning potential energy surface (PES) expressed in a matrix product operator (NN-MPO) is proposed. The MPO form enables efficient evaluation of high-dimensional integrals that arise in solving the…

Machine Learning · Computer Science 2025-05-07 Kentaro Hino , Yuki Kurashige

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

We propose the *State Space Neural Operator* (SS-NO), a compact architecture for learning solution operators of time-dependent partial differential equations (PDEs). Our formulation extends structured state space models (SSMs) to joint…

Machine Learning · Computer Science 2026-03-09 Nodens Koren , Samuel Lanthaler

We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time-dependent nonlinear partial differential equation (PDE), an…

Numerical Analysis · Mathematics 2022-02-28 Elizabeth Qian , Ionut-Gabriel Farcas , Karen Willcox

Chaos is a fundamental feature of many complex dynamical systems, including weather systems and fluid turbulence. These systems are inherently difficult to predict due to their extreme sensitivity to initial conditions. Many chaotic systems…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Andrea Goertzen , Sunbochen Tang , Navid Azizan

The solution of partial differential equations (PDEs) plays a central role in numerous applications in science and engineering, particularly those involving multiphase flow in porous media. Complex, nonlinear systems govern these problems…

We introduce the Laplace neural operator (LNO), which leverages the Laplace transform to decompose the input space. Unlike the Fourier Neural Operator (FNO), LNO can handle non-periodic signals, account for transient responses, and exhibit…

Machine Learning · Computer Science 2023-05-31 Qianying Cao , Somdatta Goswami , George Em Karniadakis

This paper introduces novel deep dynamical models designed to represent continuous-time sequences. Our approach employs a neural emission model to generate each data point in the time series through a non-linear transformation of a latent…

Machine Learning · Computer Science 2025-02-06 Sheng Cheng , Deqian Kong , Jianwen Xie , Kookjin Lee , Ying Nian Wu , Yezhou Yang

Recently, operator learning, or learning mappings between infinite-dimensional function spaces, has garnered significant attention, notably in relation to learning partial differential equations from data. Conceptually clear when outlined…

Many real-world systems are modelled using complex ordinary differential equations (ODEs). However, the dimensionality of these systems can make them challenging to analyze. Dimensionality reduction techniques like Proper Orthogonal…

Computational Engineering, Finance, and Science · Computer Science 2025-02-26 Abhishek Ajayakumar , Soumyendu Raha

Computing properties of molecular systems rely on estimating expectations of the (unnormalized) Boltzmann distribution. Molecular dynamics (MD) is a broadly adopted technique to approximate such quantities. However, stable simulations rely…

Chemical Physics · Physics 2023-10-31 Mathias Schreiner , Ole Winther , Simon Olsson

The weighted essentially non-oscillatory (WENO) schemes are a popular class of high order accurate numerical methods for solving hyperbolic partial differential equations (PDEs). The computational cost of such schemes increases…

Numerical Analysis · Mathematics 2018-04-04 Dong Lu , Shanqin Chen , Yong-Tao Zhang

We introduce MIO, a transformer-based model for inferring symbolic ordinary differential equations (ODEs) from multiple observed trajectories of a dynamical system. By combining multiple instance learning with transformer-based symbolic…

Machine Learning · Computer Science 2025-10-28 Yakup Emre Şahin , Niki Kilbertus , Sören Becker