English
Related papers

Related papers: Non-Negative Universal Differential Equations With…

200 papers

The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive…

Machine Learning · Computer Science 2024-01-02 Deepak Akhare , Tengfei Luo , Jian-Xun Wang

We explore how neural differential equations (NDEs) may be trained on highly resolved fluid-dynamical models of unresolved scales providing an ideal framework for data-driven parameterizations in climate models. NDEs overcome some of the…

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

Scientific machine learning is an emerging field that broadly describes the combination of scientific computing and machine learning to address challenges in science and engineering. Within the context of differential equations, this has…

Machine Learning · Computer Science 2026-04-03 Laurens R. Lueg , Victor Alves , Daniel Schicksnus , John R. Kitchin , Carl D. Laird , Lorenz T. Biegler

Numerical solvers of Partial Differential Equations (PDEs) are of fundamental significance to science and engineering. To date, the historical reliance on legacy techniques has circumscribed possible integration of big data knowledge and…

Numerical Analysis · Mathematics 2024-08-12 Xi Han , Fei Hou , Hong Qin

Uncertainty quantification (UQ) helps to make trustworthy predictions based on collected observations and uncertain domain knowledge. With increased usage of deep learning in various applications, the need for efficient UQ methods that can…

Machine Learning · Computer Science 2021-11-09 Olga Graf , Pablo Flores , Pavlos Protopapas , Karim Pichara

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

Unsupervised Anomaly Detection (UAD) is a key data mining problem owing to its wide real-world applications. Due to the complete absence of supervision signals, UAD methods rely on implicit assumptions about anomalous patterns (e.g.,…

Machine Learning · Computer Science 2023-12-27 Hangting Ye , Zhining Liu , Xinyi Shen , Wei Cao , Shun Zheng , Xiaofan Gui , Huishuai Zhang , Yi Chang , Jiang Bian

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

Partial differential equations (PDEs) are among the most universal and parsimonious descriptions of natural physical laws, capturing a rich variety of phenomenology and multi-scale physics in a compact and symbolic representation. This…

Machine Learning · Computer Science 2023-03-31 Steven L. Brunton , J. Nathan Kutz

The present article presents a summarizing view at differential-algebraic equations (DAEs) and analyzes how new application fields and corresponding mathematical models lead to innovations both in theory and in numerical analysis for this…

Numerical Analysis · Mathematics 2018-11-20 Jan Kleinert , Bernd Simeon

Neural differential equations are a promising new member in the neural network family. They show the potential of differential equations for time series data analysis. In this paper, the strength of the ordinary differential equation (ODE)…

Machine Learning · Computer Science 2020-05-21 Mansura Habiba , Barak A. Pearlmutter

In chemical reaction network theory, ordinary differential equations are used to model the temporal change of chemical species concentration. As the functional form of these ordinary differential equations systems is derived from an…

Molecular Networks · Quantitative Biology 2025-02-27 Anna C. M. Thöni , William E. Robinson , Yoram Bachrach , Wilhelm T. S. Huck , Tal Kachman

Differential equations (DEs) are commonly used to describe dynamic systems evolving in one (ordinary differential equations or ODEs) or in more than one dimensions (partial differential equations or PDEs). In real data applications the…

Methodology · Statistics 2013-11-25 Gianluca Frasso , Jonathan Jaeger , Philippe Lambert

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

Dynamical Systems · Mathematics 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

We discuss the numerous advantages of using dimensionless equations in non-relativistic quantum mechanics. Dimensionless equations are considerably simpler and reveal the number of relevant parameters in the models. They are less prone to…

Quantum Physics · Physics 2020-10-08 Francisco M. Fernández

Deep learning has become a pivotal technology in fields such as computer vision, scientific computing, and dynamical systems, significantly advancing these disciplines. However, neural Networks persistently face challenges related to…

Machine Learning · Computer Science 2025-10-14 Yongshuai Liu , Lianfang Wang , Kuilin Qin , Qinghua Zhang , Faqiang Wang , Li Cui , Jun Liu , Yuping Duan , Tieyong Zeng

Partial differential equations have a wide range of applications in modeling multiple physical, biological, or social phenomena. Therefore, we need to approximate the solutions of these equations in computationally feasible terms. Nowadays,…

Numerical Analysis · Mathematics 2024-11-14 Carlos Uriarte

This paper introduces Uncertainty Propagation Network (UPN), a novel family of neural differential equations that naturally incorporate uncertainty quantification into continuous-time modeling. Unlike existing neural ODEs that predict only…

Machine Learning · Computer Science 2026-02-25 Hadi Jahanshahi , Zheng H. Zhu