English
Related papers

Related papers: A Simultaneous Approach for Training Neural Differ…

200 papers

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

Machine learning methods have been lately used to solve partial differential equations (PDEs) and dynamical systems. These approaches have been developed into a novel research field known as scientific machine learning in which techniques…

Machine Learning · Computer Science 2022-12-12 Junho Choi , Namjung Kim , Youngjoon Hong

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

The numerical solution of partial differential equations (PDEs) is challenging because of the need to resolve spatiotemporal features over wide length and timescales. Often, it is computationally intractable to resolve the finest features…

Disordered Systems and Neural Networks · Physics 2019-08-22 Yohai Bar-Sinai , Stephan Hoyer , Jason Hickey , Michael P. Brenner

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

Machine Learning · Computer Science 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we…

Machine Learning · Computer Science 2023-08-25 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

Machine Learning · Computer Science 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

Reachability analysis is a fundamental problem for safety verification and falsification of Cyber-Physical Systems (CPS) whose dynamics follow physical laws usually represented as differential equations. In the last two decades, numerous…

Symbolic Computation · Computer Science 2018-04-11 Hoang-Dung Tran , Weiming Xiang , Nathaniel Hamilton , Taylor T. Johnson

Artificial intelligence and deep learning are currently reshaping numerical simulation frameworks by introducing new modeling capabilities. These frameworks are extensively investigated in the context of model correction and…

Machine Learning · Computer Science 2023-11-20 Said Ouala , Bertrand Chapron , Fabrice Collard , Lucile Gaultier , Ronan Fablet

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Neural ordinary differential equations (ODEs) are an emerging class of deep learning models for dynamical systems. They are particularly useful for learning an ODE vector field from observed trajectories (i.e., inverse problems). We here…

Machine Learning · Computer Science 2023-05-23 Katharina Ott , Michael Tiemann , Philipp Hennig

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas
‹ Prev 1 3 4 5 6 7 10 Next ›