English
Related papers

Related papers: DOSnet as a Non-Black-Box PDE Solver: When Deep Le…

200 papers

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

Machine Learning · Computer Science 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

ADCME is a novel computational framework to solve inverse problems involving physical simulations and deep neural networks (DNNs). This paper benchmarks its capability to learn spatially-varying physical fields using DNNs. We demonstrate…

Numerical Analysis · Mathematics 2020-11-25 Kailai Xu , Eric Darve

We propose doubly nested network(DNNet) where all neurons represent their own sub-models that solve the same task. Every sub-model is nested both layer-wise and channel-wise. While nesting sub-models layer-wise is straight-forward with…

Machine Learning · Computer Science 2018-06-21 Jaehong Kim , Sungeun Hong , Yongseok Choi , Jiwon Kim

Deep neural networks (DNNs) have emerged as key enablers of machine learning. Applying larger DNNs to more diverse applications is an important challenge. The computations performed during DNN training and inference are dominated by…

Machine Learning · Computer Science 2018-12-17 Jeremy Kepner , Vijay Gadepally , Hayden Jananthan , Lauren Milechin , Sid Samsi

Learning solution operators for differential equations with neural networks has shown great potential in scientific computing, but ensuring their stability under input perturbations remains a critical challenge. This paper presents a robust…

Machine Learning · Computer Science 2026-01-13 Chutian Huang , Chang Ma , Kaibo Wang , Yang Xiang

Deep learning has achieved remarkable success in diverse applications; however, its use in solving partial differential equations (PDEs) has emerged only recently. Here, we present an overview of physics-informed neural networks (PINNs),…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Xuhui Meng , Zhiping Mao , George E. Karniadakis

Physics-informed neural networks and Physics-informed DeepONet excel in solving partial differential equations; however, they often fail to converge for singularly perturbed problems. To address this, we propose two novel frameworks,…

Machine Learning · Computer Science 2026-04-06 Tiantian Sun , Jian Zu

Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yufei Hu , Nacim Belkhir , Jesus Angulo , Angela Yao , Gianni Franchi

Atomistic modeling of energetic disorder in organic semiconductors (OSCs) and its effects on the optoelectronic properties of OSCs requires a large number of excited-state electronic-structure calculations, a computationally daunting task…

Chemical Physics · Physics 2021-05-10 Chengqiang Lu , Qi Liu , Qiming Sun , Chang-Yu Hsieh , Shengyu Zhang , Liang Shi , Chee-Kong Lee

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Deep neural networks (DNNs) have been widely applied to solve real-world regression problems. However, selecting optimal network structures remains a significant challenge. This study addresses this issue by linking neuron selection in DNNs…

Computation · Statistics 2025-09-30 Noah Yi-Ting Hung , Li-Hsiang Lin , Vince D. Calhoun

Differential algebraic equations (DAEs) describe the temporal evolution of systems that obey both differential and algebraic constraints. Of particular interest are systems that contain implicit relationships between their components, such…

Machine Learning · Computer Science 2025-07-23 James Koch , Madelyn Shapiro , Himanshu Sharma , Draguna Vrabie , Jan Drgona

Recent work has introduced a simple numerical method for solving partial differential equations (PDEs) with deep neural networks (DNNs). This paper reviews and extends the method while applying it to analyze one of the most fundamental…

Machine Learning · Computer Science 2019-05-14 Craig Michoski , Milos Milosavljevic , Todd Oliver , David Hatch

Neural operator learning models have emerged as very effective surrogates in data-driven methods for partial differential equations (PDEs) across different applications from computational science and engineering. Such operator learning…

Machine Learning · Computer Science 2024-05-30 Benjamin Shih , Ahmad Peyvan , Zhongqiang Zhang , George Em Karniadakis

Nonlinear differential equations are challenging to solve numerically and are important to understanding the dynamics of many physical systems. Deep neural networks have been applied to help alleviate the computational cost that is…

Numerical Analysis · Mathematics 2020-10-27 Bryce Chudomelka , Youngjoon Hong , Hyunwoo Kim , Jinyoung Park

We introduce OS-net (Orbitally Stable neural NETworks), a new family of neural network architectures specifically designed for periodic dynamical data. OS-net is a special case of Neural Ordinary Differential Equations (NODEs) and takes…

Dynamical Systems · Mathematics 2023-09-27 Marieme Ngom , Carlo Graziani

Partial Differential Equations (PDEs) are used to model a variety of dynamical systems in science and engineering. Recent advances in deep learning have enabled us to solve them in a higher dimension by addressing the curse of…

Maxwell's equations, a system of linear partial differential equations (PDEs), describe the behavior of electric and magnetic fields in time and space and are essential for many important electromagnetic applications. Although numerical…

Computational Physics · Physics 2026-01-19 Qile Jiang , Marc Salvadori , Dale Ota , Vijaya Shankar , Khemraj Shukla

Wave propagation problems are typically formulated as partial differential equations (PDEs) on unbounded domains to be solved. The classical approach to solving such problems involves truncating them to problems on bounded domains by…

Numerical Analysis · Mathematics 2024-04-11 Jihong Wang , Xin Wang , Jing Li , Bin Liu

Neural operators, as a powerful approximation to the non-linear operators between infinite-dimensional function spaces, have proved to be promising in accelerating the solution of partial differential equations (PDE). However, it requires a…

Machine Learning · Computer Science 2024-05-08 Xinquan Huang , Wenlei Shi , Xiaotian Gao , Xinran Wei , Jia Zhang , Jiang Bian , Mao Yang , Tie-Yan Liu