English
Related papers

Related papers: Non-Negative Universal Differential Equations With…

200 papers

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Differential equations (DE) constrained optimization plays a critical role in numerous scientific and engineering fields, including energy systems, aerospace engineering, ecology, and finance, where optimal configurations or control…

Machine Learning · Computer Science 2024-10-03 Vincenzo Di Vito , Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

Machine Learning · Computer Science 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

Equational unification of two terms consists of finding a substitution that, when applied to both terms, makes them equal modulo some equational properties. Equational unification is of special relevance to automated deduction, theorem…

Logic in Computer Science · Computer Science 2019-09-19 Santiago Escobar , Julia Sapiña

Neural ordinary differential equations (neural ODEs) are a popular type of deep learning model that operate with continuous-depth architectures. To assess how well such models perform on unseen data, it is crucial to understand their…

Machine Learning · Computer Science 2025-08-27 Madhusudan Verma , Manoj Kumar

A system of SU(N)-matrix difference equations is solved by means of a nested version of a generalized Bethe Ansatz, also called "off shell" Bethe Ansatz. The highest weight property of the solutions is proved. (Part I of a series of…

High Energy Physics - Theory · Physics 2007-05-23 H. Babujian , M. Karowski , A. Zapletal

It is well known that exact notions of model abstraction and reduction for dynamical systems may not be robust enough in practice because they are highly sensitive to the specific choice of parameters. In this paper we consider this problem…

Systems and Control · Computer Science 2018-07-19 Luca Cardelli , Mirco Tribastone , Max Tschaikowski , Andrea Vandin

Unlearnable examples (UEs) aim to compromise model training by injecting imperceptible perturbations to clean samples. However, existing UE schemes exhibit limited robustness against advanced defenses due to their heuristic design or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Xianlong Wang , Hangtao Zhang , Wenbo Pan , Ziqi Zhou , Changsong Jiang , Li Zeng , Xiaohua Jia

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

Machine Learning · Computer Science 2019-11-05 Xinshi Chen

Forecasting system behaviour near and across bifurcations is crucial for identifying potential shifts in dynamical systems. While machine learning has recently been used to learn critical transitions and bifurcation structures from data,…

Machine Learning · Computer Science 2025-11-14 Eva van Tegelen , George van Voorn , Ioannis Athanasiadis , Peter van Heijster

Conservation of energy is at the core of many physical phenomena and dynamical systems. There have been a significant number of works in the past few years aimed at predicting the trajectory of motion of dynamical systems using neural…

Machine Learning · Computer Science 2022-08-05 Yi Heng Lim , Muhammad Firmansyah Kasim

This paper is concerned with a class of uncertain backward stochastic differential equations (UBSDEs) driven by both an $m$-dimensional Brownian motion and a $d$-dimensional canonical process with uniform Lipschitzian coefficients. Such…

Probability · Mathematics 2014-01-30 Weiyin Fei

We identify various classes of neural networks that are able to approximate continuous functions locally uniformly subject to fixed global linear growth constraints. For such neural networks the associated neural stochastic differential…

Probability · Mathematics 2025-03-24 Anna P. Kwossek , David J. Prömel , Josef Teichmann

There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). In this paper, we introduce a deep recurrent framework for solving time-dependent PDEs without generating large scale data…

Numerical Analysis · Mathematics 2021-04-21 Cheng Chang , Liu Liu , Tieyong Zeng

Neural ordinary differential equations (neural ODEs) are a popular family of continuous-depth deep learning models. In this work, we consider a large family of parameterized ODEs with continuous-in-time parameters, which include…

Machine Learning · Statistics 2023-10-13 Pierre Marion

It is demonstrated that very general nonlinear dynamical systems covering all cases arising in practice can be brought down to rate equations of chemical kinetics

solv-int · Physics 2007-05-23 Krzysztof Kowalski

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

A neural ordinary differential equation (neural ODE) is a machine learning model that is commonly described as a continuous-depth generalization of a residual network (ResNet) with a single residual block, or conversely, the ResNet can be…

Machine Learning · Computer Science 2025-10-14 Abdelrahman Sayed Sayed , Pierre-Jean Meyer , Mohamed Ghazel