English
Related papers

Related papers: DeepSets and their derivative networks for solving…

200 papers

Solving nonlinear optimal control problems is a challenging task, particularly for high-dimensional problems. We propose algorithms for model-based policy iterations to solve nonlinear optimal control problems with convergence guarantees.…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Yiming Meng , Ruikun Zhou , Amartya Mukherjee , Maxwell Fitzsimmons , Christopher Song , Jun Liu

Evolutional deep neural networks (EDNN) solve partial differential equations (PDEs) by marching the network representation of the solution fields, using the governing equations. Use of a single network to solve coupled PDEs on large domains…

Numerical Analysis · Mathematics 2024-07-18 Hadden Kim , Tamer A. Zaki

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

Enhancing neural networks with knowledge of physical equations has become an efficient way of solving various physics problems, from fluid flow to electromagnetism. Graph neural networks show promise in accurately representing irregularly…

Machine Learning · Computer Science 2022-04-01 Mike Y. Michelis , Robert K. Katzschmann

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

Physics-informed neural networks have emerged as a prominent new method for solving differential equations. While conceptually straightforward, they often suffer training difficulties that lead to relatively large discretization errors or…

Mathematical Physics · Physics 2024-03-13 Shivam Arora , Alex Bihlo , Francis Valiquette

Neural operators have achieved strong performance in learning solution operators of partial differential equations (PDEs), but their inherently continuous representations struggle to capture discontinuities and sharp transitions. Existing…

Machine Learning · Computer Science 2026-05-20 Ha Dang , Sebastian Schmidt , Juergen Hesser

Maxwell's equations, a system of linear partial differential equations (PDEs), describe the behavior of electric and magnetic fields in time and space and are essential for many important electromagnetic applications. Although numerical…

Computational Physics · Physics 2026-01-19 Qile Jiang , Marc Salvadori , Dale Ota , Vijaya Shankar , Khemraj Shukla

Symbolic regression with polynomial neural networks and polynomial neural ordinary differential equations (ODEs) are two recent and powerful approaches for equation recovery of many science and engineering problems. However, these methods…

Machine Learning · Computer Science 2023-08-28 Colby Fronk , Jaewoong Yun , Prashant Singh , Linda Petzold

Partial differential equations play a fundamental role in the mathematical modelling of many processes and systems in physical, biological and other sciences. To simulate such processes and systems, the solutions of PDEs often need to be…

Numerical Analysis · Mathematics 2023-02-09 Tamara G. Grossmann , Urszula Julia Komorowska , Jonas Latz , Carola-Bibiane Schönlieb

We propose several algorithms to solve McKean-Vlasov Forward Backward Stochastic Differential Equations. Our schemes rely on the approximating power of neural networks to estimate the solution or its gradient through minimization problems.…

Optimization and Control · Mathematics 2022-03-08 Maximilien Germain , Joseph Mikael , Xavier Warin

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir

The numerical solution of differential equations can be formulated as an inference problem to which formal statistical approaches can be applied. However, nonlinear partial differential equations (PDEs) pose substantial challenges from an…

Numerical Analysis · Mathematics 2021-08-26 Junyang Wang , Jon Cockayne , Oksana Chkrebtii , T. J. Sullivan , Chris. J. Oates

Learning operators for parametric partial differential equations (PDEs) using neural networks has gained significant attention in recent years. However, standard approaches like Deep Operator Networks (DeepONets) require extensive labeled…

Numerical Analysis · Mathematics 2024-09-17 Ting Du , Xianliang Xu , Wang Kong , Ye Li , Zhongyi Huang

Partial Differential Equations (PDEs) are fundamental for modeling physical systems, yet solving them in a generic and efficient manner using machine learning-based approaches remains challenging due to limited multi-input and multi-scale…

Machine Learning · Computer Science 2025-08-12 Yichen Luo , Jia Wang , Dapeng Lan , Yu Liu , Zhibo Pang

This work considers stochastic Galerkin approximations of linear elliptic partial differential equations (PDEs) with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and…

Numerical Analysis · Mathematics 2026-01-12 Fabio Musco , Andrea Barth

The convergence behavior of classical iterative solvers for parametric partial differential equations (PDEs) is often highly sensitive to the domain and specific discretization of PDEs. Previously, we introduced hybrid solvers by combining…

Machine Learning · Computer Science 2025-12-17 Youngkyu Lee , Francesc Levrero Florencio , Jay Pathak , George Em Karniadakis

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

We study the problem of learning equivariant neural networks via gradient descent. The incorporation of known symmetries ("equivariance") into neural nets has empirically improved the performance of learning pipelines, in domains ranging…

Machine Learning · Computer Science 2024-01-04 Bobak T. Kiani , Thien Le , Hannah Lawrence , Stefanie Jegelka , Melanie Weber