English
Related papers

Related papers: Parameter-Efficient Neural CDEs via Implicit Funct…

200 papers

Many scientific and industrial applications require solving Partial Differential Equations (PDEs) to describe the physical phenomena of interest. Some examples can be found in the fields of aerodynamics, astrodynamics, combustion and many…

Computational Physics · Physics 2019-12-11 Juan B. Pedro , Juan Maroñas , Roberto Paredes

Simulations of complex physical systems are typically realized by discretizing partial differential equations (PDEs) on unstructured meshes. While neural networks have recently been explored for surrogate and reduced order modeling of PDE…

Machine Learning · Computer Science 2021-10-27 Jiayang Xu , Aniruddhe Pradhan , Karthik Duraisamy

Learning time-dependent partial differential equations (PDEs) that govern evolutionary observations is one of the core challenges for data-driven inference in many fields. In this work, we propose to capture the essential dynamics of…

Numerical Analysis · Mathematics 2021-09-07 Ricardo A. Delgadillo , Jingwei Hu , Haizhao Yang

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze

Neural CDEs provide a natural way to process the temporal evolution of irregular time series. The number of function evaluations (NFE) is these systems' natural analog of depth (the number of layers in traditional neural networks). It is…

Machine Learning · Computer Science 2026-01-27 Ilya Kuleshov , Evgenia Romanenkova , Vladislav Zhuzhel , Galina Boeva , Evgeni Vorsin , Alexey Zaytsev

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Conditional Neural Processes (CNPs) are a class of metalearning models popular for combining the runtime efficiency of amortized inference with reliable uncertainty quantification. Many relevant machine learning tasks, such as in…

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

In recent years, neural networks (NNs) have driven significant advances in machine learning. However, as tasks grow more complex, NNs often require large numbers of trainable parameters, which increases computational and energy demands.…

Recurrent neural networks (RNNs) have brought a lot of advancements in sequence labeling tasks and sequence data. However, their effectiveness is limited when the observations in the sequence are irregularly sampled, where the observations…

Machine Learning · Computer Science 2022-12-29 Srinivas Anumasa , Geetakrishnasai Gunapati , P. K. Srijith

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Data-driven surrogate modeling has emerged as a promising approach for reducing computational expenses of multiscale simulations. Recurrent Neural Network (RNN) is a common choice for modeling of path-dependent behavior. However, previous…

Computational Engineering, Finance, and Science · Computer Science 2023-12-29 Yangzi He , Shabnam J. Semnani

Neural networks are a popular tool for modeling sequential data but they generally do not treat time as a continuous variable. Neural ODEs represent an important exception: they parameterize the time derivative of a hidden state with a…

Machine Learning · Computer Science 2021-06-15 Sam Greydanus , Stefan Lee , Alan Fern

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

Machine Learning · Computer Science 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

Neural networks have recently been used to analyze diverse physical systems and to identify the underlying dynamics. While existing methods achieve impressive results, they are limited by their strong demand for training data and their weak…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Florian Hofherr , Lukas Koestler , Florian Bernard , Daniel Cremers

Data-enabled predictive control (DeePC) for linear systems utilizes data matrices of recorded trajectories to directly predict new system trajectories, which is very appealing for real-life applications. In this paper we leverage the…

Optimization and Control · Mathematics 2024-12-20 Mircea Lazar