English
Related papers

Related papers: Autoregression-Free Neural Operators for Time-Depe…

200 papers

We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDEs), and are used in…

Numerical Analysis · Mathematics 2025-04-14 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Neural ordinary differential equations (neural ODEs) have emerged as a novel network architecture that bridges dynamical systems and deep learning. However, the gradient obtained with the continuous adjoint method in the vanilla neural ODE…

Machine Learning · Computer Science 2023-06-12 Hong Zhang , Wenjun Zhao

This paper explores the efficacy of diffusion-based generative models as neural operators for partial differential equations (PDEs). Neural operators are neural networks that learn a mapping from the parameter space to the solution space of…

Machine Learning · Computer Science 2024-12-17 Katsiaryna Haitsiukevich , Onur Poyraz , Pekka Marttinen , Alexander Ilin

Neural operators are capable of capturing nonlinear mappings between infinite-dimensional functional spaces, offering a data-driven approach to modeling complex functional relationships in classical density functional theory (cDFT). In this…

Recurrent neural networks are a powerful means to cope with time series. We show how autoregressive linear, i.e., linearly activated recurrent neural networks (LRNNs) can approximate any time-dependent function f(t). The approximation can…

Machine Learning · Computer Science 2025-10-01 Frieder Stolzenburg , Sandra Litz , Olivia Michael , Oliver Obst

There has recently been increasing attention towards developing foundational neural Partial Differential Equation (PDE) solvers and neural operators through large-scale pretraining. However, unlike vision and language models that make use…

Machine Learning · Computer Science 2024-11-21 AmirPouya Hemmasian , Amir Barati Farimani

This work formulates a new approach to reduced modeling of parameterized, time-dependent partial differential equations (PDEs). The method employs Operator Inference, a scientific machine learning framework combining data-driven learning…

Computational Engineering, Finance, and Science · Computer Science 2025-06-16 Shane A McQuarrie , Parisa Khodabakhshi , Karen E Willcox

A data-driven, model-free approach to modeling the temporal evolution of physical systems mitigates the need for explicit knowledge of the governing equations. Even when physical priors such as partial differential equations are available,…

Machine Learning · Computer Science 2026-03-12 Siyuan Chen , Zhecheng Wang , Yixin Chen , Yue Chang , Peter Yichen Chen , Eitan Grinspun , Jonathan Panuelos

Neural operators have emerged as promising frameworks for learning mappings governed by partial differential equations (PDEs), serving as data-driven alternatives to traditional numerical methods. While methods such as the Fourier neural…

Machine Learning · Computer Science 2025-04-21 Minsu Koh , Beom-Chul Park , Heejo Kong , Seong-Whan Lee

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

Machine Learning · Computer Science 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

Traditionally, neural networks have been employed to learn the mapping between finite-dimensional Euclidean spaces. However, recent research has opened up new horizons, focusing on the utilization of deep neural networks to learn operators…

Machine Learning · Computer Science 2025-02-18 Somdatta Goswami , Dimitris G. Giovanis , Bowei Li , Seymour M. J. Spence , Michael D. Shields

Neural solvers for partial differential equations (PDEs) have great potential to generate fast and accurate physics solutions, yet their practicality is currently limited by their generalizability. PDEs evolve over broad scales and exhibit…

Machine Learning · Computer Science 2024-12-06 Anthony Zhou , Amir Barati Farimani

Neural operators have emerged as powerful tools for learning mappings between function spaces, enabling efficient solutions to partial differential equations across varying inputs and domains. Despite the success, existing methods often…

Machine Learning · Computer Science 2025-12-19 Hao Tang , Jiongyu Zhu , Zimeng Feng , Hao Li , Chao Li

Conditional neural processes (CNPs; Garnelo et al., 2018a) are attractive meta-learning models which produce well-calibrated predictions and are trainable via a simple maximum likelihood procedure. Although CNPs have many advantages, they…

Solving Singularly Perturbed Differential Equations (SPDEs) poses computational challenges arising from the rapid transitions in their solutions within thin regions. The effectiveness of deep learning in addressing differential equations…

Machine Learning · Computer Science 2024-09-10 Ye Li , Ting Du , Yiwen Pang , Zhongyi Huang

Forecasting neural activity in response to naturalistic stimuli remains a key challenge for understanding brain dynamics and enabling downstream neurotechnological applications. Here, we introduce a generative forecasting framework for…

Neurons and Cognition · Quantitative Biology 2026-04-14 Nicole Rogalla , Yuzhen Qin , Mario Senden , Ahmed El-Gazzar , Marcel van Gerven

We propose an extended Fourier neural operator (FNO) architecture for learning state and linear quadratic additive optimal control of systems governed by partial differential equations. Using the Ehrenpreis-Palamodov fundamental principle,…

Machine Learning · Computer Science 2026-04-08 Zhexian Li , Ketan Savla

Learning the mapping between two function spaces has garnered considerable research attention. However, learning the solution operator of partial differential equations (PDEs) remains a challenge in scientific computing. Fourier neural…

Machine Learning · Computer Science 2024-03-05 Jin Young Shin , Jae Yong Lee , Hyung Ju Hwang

The machine learning methods for data-driven identification of partial differential equations (PDEs) are typically defined for a given number of spatial dimensions and a choice of coordinates the data have been collected in. This dependence…

Machine Learning · Computer Science 2025-10-07 Trung V. Phan , George A. Kevrekidis , Soledad Villar , Yannis G. Kevrekidis , Juan M. Bello-Rivas

Solving partial differential equations (PDEs) with machine learning typically requires training a new neural network for every new equation. This optimization is slow. We introduce MetaColloc. It is an optimization-free and data-free…

Machine Learning · Computer Science 2026-05-13 Zichuan Yang