English
Related papers

Related papers: Neural Manifold Ordinary Differential Equations

200 papers

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

The conjoining of dynamical systems and deep learning has become a topic of great interest. In particular, neural differential equations (NDEs) demonstrate that neural networks and differential equation are two sides of the same coin.…

Machine Learning · Computer Science 2022-02-08 Patrick Kidger

We introduce in this paper new and very effective numerical methods based on neural networks for the approximation of the mean curvature flow of either oriented or non-orientable surfaces. To learn the correct interface evolution law, our…

Numerical Analysis · Mathematics 2022-09-20 Elie Bretin , Roland Denis , Simon Masnou , Garry Terii

Quantifying uncertainty in medical image segmentation applications is essential, as it is often connected to vital decision-making. Compelling attempts have been made in quantifying the uncertainty in image segmentation architectures, e.g.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 M. M. A. Valiuddin , C. G. A. Viviers , R. J. G. van Sloun , P. H. N. de With , F. van der Sommen

Modeling complex systems using standard neural ordinary differential equations (NODEs) often faces some essential challenges, including high computational costs and susceptibility to local optima. To address these challenges, we propose a…

Machine Learning · Computer Science 2024-05-24 Xin Li , Jingdong Zhang , Qunxi Zhu , Chengli Zhao , Xue Zhang , Xiaojun Duan , Wei Lin

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

Machine Learning · Computer Science 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete…

Machine Learning · Statistics 2019-06-06 Zachary M. Ziegler , Alexander M. Rush

Diffusion and flow models have become the dominant paradigm for generative modeling on Riemannian manifolds, with successful applications in protein backbone generation and DNA sequence design. However, these methods require tens to…

Machine Learning · Computer Science 2026-05-04 Dongyeop Woo , Marta Skreta , Seonghyun Park , Kirill Neklyudov , Sungsoo Ahn

Generative AI (GenAI) has revolutionized data-driven modeling by enabling the synthesis of high-dimensional data across various applications, including image generation, language modeling, biomedical signal processing, and anomaly…

Machine Learning · Computer Science 2025-09-09 Yao Xie , Xiuyuan Cheng

Neural ordinary differential equations (neural ODEs) are a popular type of deep learning model that operate with continuous-depth architectures. To assess how well such models perform on unseen data, it is crucial to understand their…

Machine Learning · Computer Science 2025-08-27 Madhusudan Verma , Manoj Kumar

In this work, we demonstrate how to reliably estimate epistemic uncertainty while maintaining the flexibility needed to capture complicated aleatoric distributions. To this end, we propose an ensemble of Normalizing Flows (NF), which are…

Machine Learning · Computer Science 2023-10-05 Lucas Berry , David Meger

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

We introduce the framework of continuous-depth graph neural networks (GNNs). Neural graph differential equations (Neural GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of GNN…

Machine Learning · Computer Science 2021-06-23 Michael Poli , Stefano Massaroli , Clayton M. Rabideau , Junyoung Park , Atsushi Yamashita , Hajime Asama , Jinkyoo Park

Normalizing flows are a class of deep generative models that provide a promising route to sample lattice field theories more efficiently than conventional Monte Carlo simulations. In this work we show that the theoretical framework of…

High Energy Physics - Lattice · Physics 2022-07-07 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Geometric data and purpose-built generative models on them have become ubiquitous in high-impact deep learning application domains, ranging from protein backbone generation and computational chemistry to geospatial data. Current geometric…

Machine Learning · Computer Science 2026-02-10 Oscar Davis , Michael S. Albergo , Nicholas M. Boffi , Michael M. Bronstein , Avishek Joey Bose

Neural Ordinary Differential Equations (Neural ODEs) represent a significant breakthrough in deep learning, promising to bridge the gap between machine learning and the rich theoretical frameworks developed in various mathematical fields…

Machine Learning · Computer Science 2024-09-24 Jaouad Dabounou

Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge the connection…

Machine Learning · Computer Science 2022-01-05 Qunxi Zhu , Yifei Shen , Dongsheng Li , Wei Lin

We introduce Random Projection Flows (RPFs), a principled framework for injective normalizing flows that leverages tools from random matrix theory and the geometry of random projections. RPFs employ random semi-orthogonal matrices, drawn…

Machine Learning · Computer Science 2025-11-26 Ahmad Ayaz Amin , Baha Uddin Kazi