English
Related papers

Related papers: Closed-Form Diffeomorphic Transformations for Time…

200 papers

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

We propose a novel second-order optimization framework for training the emerging deep continuous-time models, specifically the Neural Ordinary Differential Equations (Neural ODEs). Since their training already involves expensive gradient…

Machine Learning · Computer Science 2021-11-09 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

In this paper, we model, classify and investigate the solutions of (normalized) second order ode's with \emph{nonconstant continuous coefficients}. We introduce a generalized \emph{frequency function} as the solution of a \emph{nonlinear…

Analysis of PDEs · Mathematics 2019-07-05 Richard Kowar

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

This paper introduces PDEformer, a neural solver for partial differential equations (PDEs) capable of simultaneously addressing various types of PDEs. We propose to represent the PDE in the form of a computational graph, facilitating the…

Numerical Analysis · Mathematics 2025-01-28 Zhanhong Ye , Xiang Huang , Leheng Chen , Hongsheng Liu , Zidong Wang , Bin Dong

Neural CDEs provide a natural way to process the temporal evolution of irregular time series. The number of function evaluations (NFE) is these systems' natural analog of depth (the number of layers in traditional neural networks). It is…

Machine Learning · Computer Science 2026-01-27 Ilya Kuleshov , Evgenia Romanenkova , Vladislav Zhuzhel , Galina Boeva , Evgeni Vorsin , Alexey Zaytsev

The computation of correspondences between shapes is a principal task in shape analysis. To this end, methods based on partial differential equations (PDEs) have been established, encompassing e.g. the classic heat kernel signature as well…

Numerical Analysis · Mathematics 2023-12-22 Alexander Köhler , Michael Breuß

We propose a reduced-order modeling approach for nonlinear, parameter-dependent ordinary differential equations (ODE). Dimensionality reduction is achieved using nonlinear maps represented by autoencoders. The resulting low-dimensional ODE…

Numerical Analysis · Mathematics 2026-04-16 Enrico Ballini , Marco Gambarini , Alessio Fumagalli , Luca Formaggia , Anna Scotti , Paolo Zunino

In recent years, deep learning has been connected with optimal control as a way to define a notion of a continuous underlying learning problem. In this view, neural networks can be interpreted as a discretization of a parametric Ordinary…

Optimization and Control · Mathematics 2020-07-07 Joubine Aghili , Olga Mula

Stiff systems of ordinary differential equations (ODEs) and sparse training data are common in scientific problems. This paper describes efficient, implicit, vectorized methods for integrating stiff systems of ordinary differential…

Numerical Analysis · Mathematics 2023-10-16 Mark C. Messner , Tianchen Hu , Tianju Chen

The recently-introduced class of ordinary differential equation networks (ODE-Nets) establishes a fruitful connection between deep learning and dynamical systems. In this work, we reconsider formulations of the weights as…

Machine Learning · Computer Science 2021-11-09 Alejandro Queiruga , N. Benjamin Erichson , Liam Hodgkinson , Michael W. Mahoney

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few…

Machine Learning · Computer Science 2021-08-18 Alexander Norcliffe , Cristian Bodnar , Ben Day , Jacob Moss , Pietro Liò

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

We present a unified framework for solving partial differential equations (PDEs) using video-inpainting diffusion transformer models. Unlike existing methods that devise specialized strategies for either forward or inverse problems under…

Machine Learning · Computer Science 2025-06-18 Edward Li , Zichen Wang , Jiahe Huang , Jeong Joon Park

Numerical solvers for PDEs often struggle to balance computational cost with accuracy, especially in multiscale and time-dependent systems. Neural operators offer a promising way to accelerate simulations, but their practical deployment is…

Machine Learning · Computer Science 2025-08-12 Wei Wang , Maryam Hakimzadeh , Haihui Ruan , Somdatta Goswami

Accurate forecasting of energy demand and supply is critical for optimizing sustainable energy systems, yet it is challenged by the variability of renewable sources and dynamic consumption patterns. This paper introduces a neural framework…

Machine Learning · Computer Science 2025-07-15 Usman Gani Joy

We propose a method to reproduce dynamic appearance textures with space-stationary but time-varying visual statistics. While most previous work decomposes dynamic textures into static appearance and motion, we focus on dynamic appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Chen Liu , Tobias Ritschel

It has been observed that residual networks can be viewed as the explicit Euler discretization of an Ordinary Differential Equation (ODE). This observation motivated the introduction of so-called Neural ODEs, which allow more general…

Machine Learning · Computer Science 2021-04-21 Tianjun Zhang , Zhewei Yao , Amir Gholami , Kurt Keutzer , Joseph Gonzalez , George Biros , Michael Mahoney

We present a new tool, GPA, that can generate key performance measures for very large systems. Based on solving systems of ordinary differential equations (ODEs), this method of performance analysis is far more scalable than stochastic…

Performance · Computer Science 2010-06-29 Anton Stefanek , Richard Hayden , Jeremy Bradley