English
Related papers

Related papers: Improving physics-informed neural networks with me…

200 papers

Physics-informed neural network (PINN) is a data-driven solver for partial and ordinary differential equations(ODEs/PDEs). It provides a unified framework to address both forward and inverse problems. However, the complexity of the…

Machine Learning · Computer Science 2024-01-17 Abdul Hannan Mustajab , Hao Lyu , Zarghaam Rizvi , Frank Wuttke

Neural networks can be trained to solve partial differential equations (PDEs) by using the PDE residual as the loss function. This strategy is called "physics-informed neural networks" (PINNs), but it currently cannot produce high-accuracy…

Machine Learning · Computer Science 2024-04-11 Qi Zeng , Yash Kothari , Spencer H. Bryngelson , Florian Schäfer

Solving inverse problems in dynamical systems governed by high-dimensional coupled ordinary differential equations (ODEs) is a ubiquitous challenge in scientific machine learning. In many real-world applications, researchers seek to uncover…

Machine Learning · Computer Science 2026-05-06 Zhao Wei , Kenneth Hor Cheng Koh , Sheng Yuan Chin , James Chun Yip Chan , Chin Chun Ooi , Yew-Soon Ong

Eigenvalue problems are critical to several fields of science and engineering. We expand on the method of using unsupervised neural networks for discovering eigenfunctions and eigenvalues for differential eigenvalue problems. The obtained…

Machine Learning · Computer Science 2022-03-02 Henry Jin , Marios Mattheakis , Pavlos Protopapas

Combining machine learning with physics is a trending approach for discovering unknown dynamics, and one of the most intensively studied frameworks is the physics-informed neural network (PINN). However, PINN often fails to optimize the…

Machine Learning · Computer Science 2023-11-29 Yuichi Kajiura , Jorge Espin , Dong Zhang

A novel comparison is presented of the effect of optimiser choice on the accuracy of physics-informed neural networks (PINNs). To give insight into why some optimisers are better, a new approach is proposed that tracks the training…

Machine Learning · Computer Science 2023-03-28 Nayara Fonseca , Veronica Guidetti , Will Trojak

With increasing share of renewables in power generation mix, system operators would need to run Optimal Power Flow (OPF) problems closer to real-time to better manage uncertainty. Given that OPF is an expensive optimization problem to…

Signal Processing · Electrical Eng. & Systems 2020-12-22 Alex Robson , Mahdi Jamei , Cozmin Ududec , Letif Mones

Training deep neural networks is a highly nontrivial task, involving carefully selecting appropriate training algorithms, scheduling step sizes and tuning other hyperparameters. Trying different combinations can be quite labor-intensive and…

Machine Learning · Computer Science 2017-06-13 Kaifeng Lv , Shunhua Jiang , Jian Li

A physics-informed neural network is presented for poroelastic problems with coupled flow and deformation processes. The governing equilibrium and mass balance equations are discussed and specific derivations for two-dimensional cases are…

Computational Engineering, Finance, and Science · Computer Science 2020-10-30 Yared W. Bekele

Creating impact in real-world settings requires artificial intelligence techniques to span the full pipeline from data, to predictive models, to decisions. These components are typically approached separately: a machine learning model is…

Machine Learning · Computer Science 2018-11-22 Bryan Wilder , Bistra Dilkina , Milind Tambe

Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods…

Machine Learning · Computer Science 2024-05-24 Wenrui Hao , Xinliang Liu , Yahong Yang

When training neural networks with custom objectives, such as ranking losses and shortest-path losses, a common problem is that they are, per se, non-differentiable. A popular approach is to continuously relax the objectives to provide…

Machine Learning · Computer Science 2024-10-28 Felix Petersen , Christian Borgelt , Tobias Sutter , Hilde Kuehne , Oliver Deussen , Stefano Ermon

Deep learning has shown that learned functions can dramatically outperform hand-designed functions on perceptual tasks. Analogously, this suggests that learned optimizers may similarly outperform current hand-designed optimizers, especially…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Luke Metz , Niru Maheswaranathan , Jeremy Nixon , C. Daniel Freeman , Jascha Sohl-Dickstein

A feed-forward neural network has a remarkable property which allows the network itself to be a universal approximator for any functions.Here we present a universal, machine-learning based solver for multi-variable partial differential…

Disordered Systems and Neural Networks · Physics 2018-11-14 Qianshi Wei , Ying Jiang , Jeff Z. Y. Chen

Efficient physics simulations are essential for numerous applications, ranging from realistic cloth animations or smoke effects in video games, to analyzing pollutant dispersion in environmental sciences, to calculating vehicle drag…

Computational Physics · Physics 2025-04-22 Nils Wandel , Stefan Schulz , Reinhard Klein

The recent rise of deep learning has led to numerous applications, including solving partial differential equations using Physics-Informed Neural Networks. This approach has proven highly effective in several academic cases. However, their…

Numerical Analysis · Mathematics 2024-10-07 Marien Chenaud , Frédéric Magoulès , José Alves

The identification of a mathematical dynamics model is a crucial step in the designing process of a controller. However, it is often very difficult to identify the system's governing equations, especially in complex environments that…

Systems and Control · Electrical Eng. & Systems 2024-07-01 Tobias Nagel , Marco F. Huber

Deep learning models trained on finite data lack a complete understanding of the physical world. On the other hand, physics-informed neural networks (PINNs) are infused with such knowledge through the incorporation of mathematically…

Neural and Evolutionary Computing · Computer Science 2026-02-23 Jian Cheng Wong , Abhishek Gupta , Chin Chun Ooi , Pao-Hsiung Chiu , Jiao Liu , Yew-Soon Ong

We present a method that employs physics-informed deep learning techniques for parametrically solving partial differential equations. The focus is on the steady-state heat equations within heterogeneous solids exhibiting significant phase…

Machine Learning · Computer Science 2024-01-05 Shahed Rezaei , Ahmad Moeineddin , Michael Kaliske , Markus Apel

Neural networks are discrete entities: subdivided into discrete layers and parametrized by weights which are iteratively optimized via difference equations. Recent work proposes networks with layer outputs which are no longer quantized but…

Neural and Evolutionary Computing · Computer Science 2019-09-09 Stefano Massaroli , Michael Poli , Federico Califano , Angela Faragasso , Jinkyoo Park , Atsushi Yamashita , Hajime Asama