English
Related papers

Related papers: A Stable and Scalable Method for Solving Initial V…

200 papers

Solving general high-dimensional partial differential equations (PDE) is a long-standing challenge in numerical mathematics. In this paper, we propose a novel approach to solve high-dimensional linear and nonlinear PDEs defined on arbitrary…

Numerical Analysis · Mathematics 2020-04-22 Yaohua Zang , Gang Bao , Xiaojing Ye , Haomin Zhou

Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation…

Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their…

Machine Learning · Computer Science 2022-03-04 Hanshu Yan , Jiawei Du , Vincent Y. F. Tan , Jiashi Feng

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

Machine Learning · Computer Science 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

Partial differential equations (PDEs) are often computationally challenging to solve, and in many settings many related PDEs must be be solved either at every timestep or for a variety of candidate boundary conditions, parameters, or…

Machine Learning · Computer Science 2022-11-04 Tian Qin , Alex Beatson , Deniz Oktay , Nick McGreivy , Ryan P. Adams

Recent work has introduced a simple numerical method for solving partial differential equations (PDEs) with deep neural networks (DNNs). This paper reviews and extends the method while applying it to analyze one of the most fundamental…

Machine Learning · Computer Science 2019-05-14 Craig Michoski , Milos Milosavljevic , Todd Oliver , David Hatch

We propose an algebraic method that finds a sequence of functions that exponentially approach the solution of any second-order ordinary differential equation (ODE) with any boundary conditions. We define an extended ODE (eODE) composed of a…

Numerical Analysis · Mathematics 2022-06-07 Pedro L. Garrido

The article discusses the development of various methods and techniques for initializing and training neural networks with a single hidden layer, as well as training a separable physics-informed neural network consisting of neural networks…

Numerical Analysis · Mathematics 2025-07-08 Vasiliy A. Es'kin , Alexey O. Malkhanov , Mikhail E. Smorkalov

Inverse problem or parameter estimation of ordinary differential equations (ODEs), the iterative process of minimizing the mismatch between model-predicted and experimental states by tuning the parameter values within an optimization…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Siddharth Prabhu , Srinivas Rangarajan , Mayuresh Kothare

Iterative steady-state solvers are widely used in computational fluid dynamics. Unfortunately, it is difficult to obtain steady-state solution for unstable problem caused by physical instability and numerical instability. Optimization is a…

Computational Engineering, Finance, and Science · Computer Science 2023-11-21 Wenbo Cao , Yilang Liu , Xianglin Shan , Chuanqiang Gao , Weiwei Zhang

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Inverse problems in partial differential equations (PDEs) involve estimating the physical parameters of a system from observed spatiotemporal solution fields. Neural networks are well-suited for PDE parameter estimation due to their…

Machine Learning · Computer Science 2026-05-27 Divyam Goel , Nithin Chalapathi , Sanjeev Raja , Aditi S. Krishnapriyan

We propose a new neural network based method for solving inverse problems for partial differential equations (PDEs) by formulating the PDE inverse problem as a bilevel optimization problem. At the upper level, we minimize the data loss with…

Machine Learning · Computer Science 2026-01-08 Ray Zirui Zhang , Christopher E. Miles , Xiaohui Xie , John S. Lowengrub

Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting…

Computational Physics · Physics 2021-01-06 Kiwon Um , Robert Brand , Yun , Fei , Philipp Holl , Nils Thuerey

Probabilistic solvers for ordinary differential equations (ODEs) have emerged as an efficient framework for uncertainty quantification and inference on dynamical systems. In this work, we explain the mathematical assumptions and detailed…

Machine Learning · Statistics 2021-10-25 Nicholas Krämer , Nathanael Bosch , Jonathan Schmidt , Philipp Hennig

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Neuroscientists fit morphologically and biophysically detailed neuron simulations to physiological data, often using evolutionary algorithms. However, such gradient-free approaches are computationally expensive, making convergence slow when…

Neurons and Cognition · Quantitative Biology 2024-07-23 Ilenna Simone Jones , Konrad Paul Kording

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas
‹ Prev 1 4 5 6 7 8 10 Next ›