English
Related papers

Related papers: Convergence of Stochastic Gradient Methods for Wid…

200 papers

Convolutional neural networks are widely used in imaging and image recognition. Learning such networks from training data leads to the minimization of a non-convex function. This makes the analysis of standard optimization methods such as…

Optimization and Control · Mathematics 2026-01-14 Jona-Maria Diederen , Holger Rauhut , Ulrich Terstiege

Physics-informed neural networks (PINNs) have recently become a powerful tool for solving partial differential equations (PDEs). However, finding a set of neural network parameters that lead to fulfilling a PDE can be challenging and…

Machine Learning · Computer Science 2023-04-12 Aleksandr Dekhovich , Marcel H. F. Sluiter , David M. J. Tax , Miguel A. Bessa

We revisit the original approach of using deep learning and neural networks to solve differential equations by incorporating the knowledge of the equation. This is done by adding a dedicated term to the loss function during the optimization…

Machine Learning · Computer Science 2023-04-05 Hubert Baty , Leo Baty

A novel deep learning technique called Physics Informed Neural Networks (PINNs) is adapted to study steady groundwater flow in unconfined aquifers. This technique utilizes information from underlying physics represented in the form of…

Geophysics · Physics 2021-12-28 Mohammad Afzal Shadab , DingCheng Luo , Yiran Shen , Eric Hiatt , Marc Andre Hesse

The simulation of power system dynamics poses a computationally expensive task. Considering the growing uncertainty of generation and demand patterns, thousands of scenarios need to be continuously assessed to ensure the safety of power…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Jochen Stiasny , Spyros Chatzivasileiadis

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Physics Informed Neural Networks is a numerical method which uses neural networks to approximate solutions of partial differential equations. It has received a lot of attention and is currently used in numerous physical and engineering…

Numerical Analysis · Mathematics 2025-07-10 Dimitrios Gazoulis , Ioannis Gkanis , Charalambos G. Makridakis

Stochastic coordinate descent algorithms are efficient methods in which each iterate is obtained by fixing most coordinates at their values from the current iteration, and approximately minimizing the objective with respect to the remaining…

Machine Learning · Statistics 2025-04-02 Eméric Gbaguidi

Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

Physics-informed neural networks (PINNs) have gained prominence in recent years and are now effectively used in a number of applications. However, their performance remains unstable due to the complex landscape of the loss function. To…

Machine Learning · Computer Science 2025-09-30 Dmitry Bylinkin , Mikhail Aleksandrov , Savelii Chezhegov , Aleksandr Beznosikov

Physics-informed neural networks (PINNs) are promising to replace conventional partial differential equation (PDE) solvers by offering more accurate and flexible PDE solutions. However, they are hampered by the relatively slow convergence…

Machine Learning · Computer Science 2023-05-16 Mohammad H. Taufik , Tariq Alkhalifah

In this study, we present and validate the predictive capability of the Physics-Informed Neural Networks (PINNs) methodology for solving a variety of engineering and biological dynamical systems governed by ordinary differential equations…

Machine Learning · Computer Science 2025-11-19 Tyrus Whitman , Andrew Particka , Christopher Diers , Ian Griffin , Charuka Wickramasinghe , Pradeep Ranaweera

Physics-Informed Neural Networks (PINNs) are a class of deep learning models aiming to approximate solutions of PDEs by training neural networks to minimize the residual of the equation. Focusing on non-equilibrium fluctuating systems, we…

Machine Learning · Computer Science 2025-09-25 Javier Castro , Benjamin Gess

Driven by the need for more efficient and seamless integration of physical models and data, physics-informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and…

Machine Learning · Computer Science 2023-07-04 Sokratis J. Anagnostopoulos , Juan Diego Toscano , Nikolaos Stergiopulos , George Em Karniadakis

Partial differential equations (PDEs) provide a mathematical foundation for simulating and understanding intricate behaviors in both physical sciences and engineering. With the growing capabilities of deep learning, data$-$driven approaches…

Machine Learning · Computer Science 2025-10-14 Narayan S Iyer , Bivas Bhaumik , Ram S Iyer , Satyasaran Changdar

The present work investigates the use of physics-informed neural networks (PINNs) for the 3D reconstruction of unsteady gravity currents from limited data. In the PINN context, the flow fields are reconstructed by training a neural network…

Fluid Dynamics · Physics 2023-06-16 Mickaël Delcey , Yoann Cheny , Sébastien Kiesgen de Richter

With the advantages of fast calculating speed and high precision, the physics-informed neural network method opens up a new approach for numerically solving nonlinear partial differential equations. Based on conserved quantities, we devise…

Exactly Solvable and Integrable Systems · Physics 2022-03-14 Shuning Lin , Yong Chen

We study the convergence properties of gradient descent for training deep linear neural networks, i.e., deep matrix factorizations, by extending a previous analysis for the related gradient flow. We show that under suitable conditions on…

Machine Learning · Computer Science 2021-11-25 Gabin Maxime Nguegnang , Holger Rauhut , Ulrich Terstiege

Neural networks, a central tool in machine learning, have demonstrated remarkable, high fidelity performance on image recognition and classification tasks. These successes evince an ability to accurately represent high dimensional…

Machine Learning · Statistics 2023-02-08 Grant M. Rotskoff , Eric Vanden-Eijnden

Physics-informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward…

Machine Learning · Computer Science 2022-06-22 Ehsan Haghighat , Danial Amini , Ruben Juanes