English
Related papers

Related papers: Modular Neural Ordinary Differential Equations

200 papers

Continuous deep learning models, referred to as Neural Ordinary Differential Equations (Neural ODEs), have received considerable attention over the last several years. Despite their burgeoning impact, there is a lack of formal analysis…

Machine Learning · Computer Science 2022-07-15 Diego Manzanas Lopez , Patrick Musau , Nathaniel Hamilton , Taylor T. Johnson

Neural operators, which emerge as implicit solution operators of hidden governing equations, have recently become popular tools for learning responses of complex real-world physical systems. Nevertheless, the majority of neural operator…

Machine Learning · Computer Science 2023-01-31 Ning Liu , Yue Yu , Huaiqian You , Neeraj Tatikola

By learning the mappings between infinite function spaces using carefully designed neural networks, the operator learning methodology has exhibited significantly more efficiency than traditional methods in solving complex problems such as…

Numerical Analysis · Mathematics 2023-03-06 Ziyuan Liu , Haifeng Wang , Hong Zhang , Kaijuna Bao , Xu Qian , Songhe Song

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Neural operators are becoming the default tools to learn solutions to governing partial differential equations (PDEs) in weather and ocean forecasting applications. Despite early promising achievements, significant challenges remain,…

Machine Learning · Computer Science 2025-10-14 Vahidreza Jahanmard , Ali Ramezani-Kebrya , Robinson Hordoir

Differential algebraic equations (DAEs) describe the temporal evolution of systems that obey both differential and algebraic constraints. Of particular interest are systems that contain implicit relationships between their components, such…

Machine Learning · Computer Science 2025-07-23 James Koch , Madelyn Shapiro , Himanshu Sharma , Draguna Vrabie , Jan Drgona

Predicting outcomes and planning interactions with the physical world are long-standing goals for machine learning. A variety of such tasks involves continuous physical systems, which can be described by partial differential equations…

Machine Learning · Computer Science 2020-01-22 Philipp Holl , Vladlen Koltun , Nils Thuerey

Identifying dynamical systems from experimental data is a notably difficult task. Prior knowledge generally helps, but the extent of this knowledge varies with the application, and customized models are often needed. Neural ordinary…

Systems and Control · Electrical Eng. & Systems 2023-01-13 Mona Buisson-Fenet , Valery Morgenthaler , Sebastian Trimpe , Florent Di Meglio

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

The approximation of solutions of partial differential equations (PDEs) with numerical algorithms is a central topic in applied mathematics. For many decades, various types of methods for this purpose have been developed and extensively…

Numerical Analysis · Mathematics 2024-08-26 Lukas Gonon , Arnulf Jentzen , Benno Kuckuck , Siyu Liang , Adrian Riekert , Philippe von Wurstemberger

Incorporating neural networks for the solution of Ordinary Differential Equations (ODEs) represents a pivotal research direction within computational mathematics. Within neural network architectures, the integration of the intrinsic…

Dynamical Systems · Mathematics 2024-01-10 Shanshan Xiao , Jiawei Zhang , Yifa Tang

Neural operators (NOs) have emerged as effective tools for modeling complex physical systems in scientific machine learning. In NOs, a central characteristic is to learn the governing physical laws directly from data. In contrast to other…

Machine Learning · Computer Science 2024-06-06 Ning Liu , Yiming Fan , Xianyi Zeng , Milan Klöwer , Lu Zhang , Yue Yu

Time series modeling and analysis have become critical in various domains. Conventional methods such as RNNs and Transformers, while effective for discrete-time and regularly sampled data, face significant challenges in capturing the…

Machine Learning · Computer Science 2025-09-30 YongKyung Oh , Seungsu Kam , Jonghun Lee , Dong-Young Lim , Sungil Kim , Alex Bui

Modal synthesis methods are a long-standing approach for modelling distributed musical systems. In some cases extensions are possible in order to handle geometric nonlinearities. One such case is the high-amplitude vibration of a string,…

Sound · Computer Science 2025-05-16 Victor Zheleznov , Stefan Bilbao , Alec Wright , Simon King

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. In a previous work [arXiv:2104.13962], we explored the use of Neural Ordinary Differential Equations (NODE) as…

Machine Learning · Computer Science 2021-07-07 Sourav Dutta , Peter Rivera-Casillas , Orie M. Cecil , Matthew W. Farthing , Emma Perracchione , Mario Putti

Partial differential equations (PDEs) govern a wide range of physical phenomena, but their numerical solution remains computationally demanding, especially when repeated simulations are required across many parameter settings. Recent…

Machine Learning · Computer Science 2026-05-13 Hamda Hmida , Hsiu-Wen Chang Joly , Youssef Mesri

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms.…

Machine Learning · Computer Science 2026-05-12 Mingtao Xia , Xiangting Li , Qijing Shen , Tom Chou

Complex systems are often decomposed into modular subsystems for engineering tractability. Although various equation based white-box modeling techniques make use of such structure, learning based methods have yet to incorporate these ideas…

Machine Learning · Computer Science 2022-10-31 Jayesh K. Gupta , Sai Vemprala , Ashish Kapoor

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep…