English
Related papers

Related papers: CFO: Learning Continuous-Time PDE Dynamics via Flo…

200 papers

Neural operators have emerged as powerful data-driven solvers for PDEs, offering substantial acceleration over classical numerical methods. However, existing transformer-based operators still face critical challenges when modeling PDEs on…

Artificial Intelligence · Computer Science 2026-05-12 Chun-Wun Cheng , Sifan Wang , Carola-Bibiane Schönlieb , Angelica I. Aviles-Rivero

This work introduces Neural Chronos Ordinary Differential Equations (Neural CODE), a deep neural network architecture that fits a continuous-time ODE dynamics for predicting the chronology of a system both forward and backward in time. To…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Neural ordinary differential equations (ODEs) are widely recognized as the standard for modeling physical mechanisms, which help to perform approximate inference in unknown physical or biological environments. In partially observable (PO)…

Machine Learning · Computer Science 2023-10-31 Xuanle Zhao , Duzhen Zhang , Liyuan Han , Tielin Zhang , Bo Xu

Controlled generation with pre-trained Diffusion and Flow Matching models has vast applications. One strategy for guiding ODE-based generative models is through optimizing a target loss $R(x_1)$ while staying close to the prior…

Machine Learning · Computer Science 2025-03-11 Luran Wang , Chaoran Cheng , Yizhen Liao , Yanru Qu , Ge Liu

Neural operators provide fast surrogate models for time-dependent partial differential equations, but their standard autoregressive use usually assumes that the instantaneous field $u(t,\cdot)$ is a complete state. This assumption fails for…

Machine Learning · Computer Science 2026-05-13 Lennon J. Shikhman

Recent years have witnessed the promise of coupling machine learning methods and physical domain-specific insights for solving scientific problems based on partial differential equations (PDEs). However, being data-intensive, these methods…

Machine Learning · Computer Science 2025-06-03 Wuyang Chen , Jialin Song , Pu Ren , Shashank Subramanian , Dmitriy Morozov , Michael W. Mahoney

We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time-dependent nonlinear partial differential equation (PDE), an…

Numerical Analysis · Mathematics 2022-02-28 Elizabeth Qian , Ionut-Gabriel Farcas , Karen Willcox

The operator learning has received significant attention in recent years, with the aim of learning a mapping between function spaces. Prior works have proposed deep neural networks (DNNs) for learning such a mapping, enabling the learning…

Machine Learning · Statistics 2024-02-15 Yusuke Tanaka , Takaharu Yaguchi , Tomoharu Iwata , Naonori Ueda

Modeling sequential patterns from data is at the core of various time series forecasting tasks. Deep learning models have greatly outperformed many traditional models, but these black-box models generally lack explainability in prediction…

Machine Learning · Computer Science 2023-05-23 Yingtao Luo , Chang Xu , Yang Liu , Weiqing Liu , Shun Zheng , Jiang Bian

Coflow provides a key application-layer abstraction for capturing communication patterns, enabling the efficient coordination of parallel data flows to reduce job completion times in distributed systems. Modern data center networks (DCNs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-10 Xin Wang , Hong Shen , Hui Tian , Dong Wang

Deep neural networks are an attractive alternative for simulating complex dynamical systems, as in comparison to traditional scientific computing methods, they offer reduced computational costs during inference and can be trained directly…

Machine Learning · Computer Science 2024-05-01 Katarzyna Michałowska , Somdatta Goswami , George Em Karniadakis , Signe Riemer-Sørensen

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

Machine Learning · Computer Science 2025-11-25 Srishti Gupta , Yashasvee Taiwade

The evolution of dynamical systems is generically governed by nonlinear partial differential equations (PDEs), whose solution, in a simulation framework, requires vast amounts of computational resources. In this work, we present a novel…

Machine Learning · Computer Science 2023-09-01 Michael Rotman , Amit Dekel , Ran Ilan Ber , Lior Wolf , Yaron Oz

Accurately, efficiently, and stably computing complex fluid flows and their evolution near solid boundaries over long horizons remains challenging. Conventional numerical solvers require fine grids and small time steps to resolve near-wall…

Machine Learning · Computer Science 2026-03-18 Chenglin Li , Hang Xu , Jianting Chen , Yanfei Zhang

Irregularly measured time series are common in many of the applied settings in which time series modelling is a key statistical tool, including medicine. This provides challenges in model choice, often necessitating imputation or similar…

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a…

Machine Learning · Computer Science 2021-06-15 Sam Greydanus , Stefan Lee , Alan Fern

We propose a novel framework, Continuous_Time Attention, which infuses partial differential equations (PDEs) into the Transformer's attention mechanism to address the challenges of extremely long input sequences. Instead of relying solely…

Machine Learning · Computer Science 2025-12-30 Yukun Zhang , Xueqing Zhou

Carrier frequency offset estimation (CFOE) is a critical stage in modern coherent optical communication systems. Although conventional all-digital techniques perform reliably in typical fiber-optic communication links, CFOE often becomes a…

Signal Processing · Electrical Eng. & Systems 2026-03-31 I. P. Vieira , G. V. Serra , R. A. Colares , D. A. A. Mello

Shape optimization under uncertainty (OUU) is computationally intensive for classical PDE-based methods due to the high cost of repeated sampling-based risk evaluation across many uncertainty realizations and varying geometries, while…

Optimization and Control · Mathematics 2026-03-04 Xindi Gong , Dingcheng Luo , Thomas O'Leary-Roseberry , Ruanui Nicholson , Omar Ghattas