English
Related papers

Related papers: CFO: Learning Continuous-Time PDE Dynamics via Flo…

200 papers

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

We propose the Inverse Neural Operator (INO), a two-stage framework for recovering hidden ODE parameters from sparse, partial observations. In Stage 1, a Conditional Fourier Neural Operator (C-FNO) with cross-attention learns a…

Machine Learning · Computer Science 2026-03-13 Zhi-Song Liu , Wenqing Peng , Helmi Toropainen , Ammar Kheder , Andreas Rupp , Holger Froning , Xiaojie Lin , Michael Boy

We present a data-driven control framework for partial differential equations (PDEs). Our approach integrates Time-Integrated Deep Operator Networks (TI-DeepONets) as differentiable PDE surrogate models within the Differentiable Predictive…

Computational Engineering, Finance, and Science · Computer Science 2026-04-16 Dibakar Roy Sarkar , Ján Drgoňa , Somdatta Goswami

Recent developments in applying machine learning to address Alternating Current Optimal Power Flow (AC OPF) problems have demonstrated significant potential in providing close to optimal solutions for generator dispatch in near real-time.…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Vincenzo Di Vito , Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

We propose a novel second-order optimization framework for training the emerging deep continuous-time models, specifically the Neural Ordinary Differential Equations (Neural ODEs). Since their training already involves expensive gradient…

Machine Learning · Computer Science 2021-11-09 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

Partial differential equations (PDEs) govern diverse physical phenomena, yet high-fidelity numerical solutions are computationally expensive and Machine Learning approaches lack generalization. While Scientific Foundation Models (SFMs) aim…

Machine Learning · Computer Science 2026-05-13 Hamda Hmida , Hsiu-Wen Chang , Youssef Mesri

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-convergent representation…

Machine Learning · Computer Science 2024-03-06 Robert Joseph George , Jiawei Zhao , Jean Kossaifi , Zongyi Li , Anima Anandkumar

Partial differential equations (PDEs) govern complex systems, yet neural operators often struggle to efficiently capture the long-range, nonlocal interactions inherent in their solution maps. We introduce Spectral Filtering Operator (SFO),…

Machine Learning · Computer Science 2026-01-27 Noam Koren , Rafael Moschopoulos , Kira Radinsky , Elad Hazan

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

Diffusion-based models have significant achievements in time series generation but suffer from inefficient computation: solving high-dimensional ODEs/SDEs via iterative numerical solvers demands hundreds to thousands of drift function…

Machine Learning · Computer Science 2025-02-11 Yang Hu , Xiao Wang , Zezhen Ding , Lirong Wu , Huatian Zhang , Stan Z. Li , Sheng Wang , Jiheng Zhang , Ziyun Li , Tianlong Chen

This work presents, to the best of the authors' knowledge, the first generalizable and fully data-driven adaptive framework designed to stabilize deep learning (DL) autoregressive forecasting models over long time horizons, with the goal of…

Fluid Dynamics · Physics 2025-05-06 Rodrigo Abadía-Heredia , Manuel Lopez-Martin , Soledad Le Clainche

Neural operator models for solving partial differential equations (PDEs) often rely on global mixing mechanisms-such as spectral convolutions or attention-which tend to oversmooth sharp local dynamics and introduce high computational cost.…

Machine Learning · Computer Science 2025-10-01 Chun-Wun Cheng , Bin Dong , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

We propose Flow-GRPO, the first method to integrate online policy gradient reinforcement learning (RL) into flow matching models. Our approach uses two key strategies: (1) an ODE-to-SDE conversion that transforms a deterministic Ordinary…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jie Liu , Gongye Liu , Jiajun Liang , Yangguang Li , Jiaheng Liu , Xintao Wang , Pengfei Wan , Di Zhang , Wanli Ouyang

We compare the discretize-optimize (Disc-Opt) and optimize-discretize (Opt-Disc) approaches for time-series regression and continuous normalizing flows (CNFs) using neural ODEs. Neural ODEs are ordinary differential equations (ODEs) with…

Machine Learning · Computer Science 2020-08-03 Derek Onken , Lars Ruthotto

Flow-based generative models, including diffusion models, excel at modeling continuous distributions in high-dimensional spaces. In this work, we introduce Flow Policy Optimization (FPO), a simple on-policy reinforcement learning algorithm…

Machine Learning · Computer Science 2025-08-04 David McAllister , Songwei Ge , Brent Yi , Chung Min Kim , Ethan Weber , Hongsuk Choi , Haiwen Feng , Angjoo Kanazawa

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

This study investigates the application of machine learning, specifically Fourier Neural Operator (FNO) and Convolutional Neural Network (CNN), to learn time-advancement operators for parametric partial differential equations (PDEs). Our…

Machine Learning · Computer Science 2024-02-19 Rixin Yu , Erdzan Hodzic

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep…

We apply Fourier neural operators (FNOs), a state-of-the-art operator learning technique, to forecast the temporal evolution of experimentally measured velocity fields. FNOs are a recently developed machine learning method capable of…

Fluid Dynamics · Physics 2023-01-23 Peter I Renn , Cong Wang , Sahin Lale , Zongyi Li , Anima Anandkumar , Morteza Gharib