中文
相关论文

相关论文: A Simultaneous Approach for Training Neural Differ…

200 篇论文

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Machine learning methods have been lately used to solve partial differential equations (PDEs) and dynamical systems. These approaches have been developed into a novel research field known as scientific machine learning in which techniques…

机器学习 · 计算机科学 2022-12-12 Junho Choi , Namjung Kim , Youngjoon Hong

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with representative datasets. Recently, an augmented framework has been…

机器学习 · 计算机科学 2023-04-12 Qunxi Zhu , Yao Guo , Wei Lin

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

概率论 · 数学 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

数值分析 · 数学 2021-03-17 Quanhui Zhu , Jiang Yang

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

The numerical solution of partial differential equations (PDEs) is challenging because of the need to resolve spatiotemporal features over wide length and timescales. Often, it is computationally intractable to resolve the finest features…

无序系统与神经网络 · 物理学 2019-08-22 Yohai Bar-Sinai , Stephan Hoyer , Jason Hickey , Michael P. Brenner

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

机器学习 · 计算机科学 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

最优化与控制 · 数学 2024-09-06 Michael Hintermüller , Denis Korolev

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

机器学习 · 计算机科学 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

机器学习 · 计算机科学 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we…

机器学习 · 计算机科学 2023-08-25 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

机器学习 · 计算机科学 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

Reachability analysis is a fundamental problem for safety verification and falsification of Cyber-Physical Systems (CPS) whose dynamics follow physical laws usually represented as differential equations. In the last two decades, numerous…

符号计算 · 计算机科学 2018-04-11 Hoang-Dung Tran , Weiming Xiang , Nathaniel Hamilton , Taylor T. Johnson

Artificial intelligence and deep learning are currently reshaping numerical simulation frameworks by introducing new modeling capabilities. These frameworks are extensively investigated in the context of model correction and…

机器学习 · 计算机科学 2023-11-20 Said Ouala , Bertrand Chapron , Fabrice Collard , Lucile Gaultier , Ronan Fablet

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

机器学习 · 计算机科学 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Neural ordinary differential equations (ODEs) are an emerging class of deep learning models for dynamical systems. They are particularly useful for learning an ODE vector field from observed trajectories (i.e., inverse problems). We here…

机器学习 · 计算机科学 2023-05-23 Katharina Ott , Michael Tiemann , Philipp Hennig

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

数值分析 · 数学 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas