English
Related papers

Related papers: Improving physics-informed neural networks with me…

200 papers

In this work, we investigated the feasibility of applying deep learning techniques to solve Poisson's equation. A deep convolutional neural network is set up to predict the distribution of electric potential in 2D or 3D cases. With proper…

Computational Physics · Physics 2017-12-18 Tao Shan , Wei Tang , Xunwang Dang , Maokun Li , Fan Yang , Shenheng Xu , Ji Wu

Learned optimizers -- neural networks that are trained to act as optimizers -- have the potential to dramatically accelerate training of machine learning models. However, even when meta-trained across thousands of tasks at huge…

Machine Learning · Computer Science 2022-09-23 James Harrison , Luke Metz , Jascha Sohl-Dickstein

Physics-informed neural networks exploit the existing models of the underlying physical systems to generate higher accuracy results with fewer data. Such approaches can help drastically reduce the computation time and generate a good…

Systems and Control · Electrical Eng. & Systems 2021-09-28 Rahul Nellikkath , Spyros Chatzivasileiadis

In this paper, numerical methods using Physics-Informed Neural Networks (PINNs) are presented with the aim to solve higher-order ordinary differential equations (ODEs). Indeed, this deep-learning technique is successfully applied for…

Computational Physics · Physics 2023-07-17 Hubert Baty

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Yunian Pan , Tao Li , Quanyan Zhu

This work compares the advantages and limitations of the Finite Difference Method with Physics-Informed Neural Networks, showing where each can best be applied for different problem scenarios. Analysis on the L2 relative error based on…

General Mathematics · Mathematics 2025-02-06 Batyr Sharimbayev , Shirali Kadyrov , Aleksei Kavokin

Physics-Informed Neural Networks (PINNs) have emerged as powerful tools for solving partial differential equations (PDEs). However, training PINNs from scratch is often computationally intensive and time-consuming. To address this problem,…

Numerical Analysis · Mathematics 2024-10-21 Sidi Wu

A classic approach for solving differential equations with neural networks builds upon neural forms, which employ the differential equation with a discretisation of the solution domain. Making use of neural forms for time-dependent…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Toni Schneidereit , Michael Breuß

Recent work has shown a variety of ways in which machine learning can be used to accelerate the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial…

Machine Learning · Computer Science 2024-04-02 Ethan King , James Kotary , Ferdinando Fioretto , Jan Drgona

Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we…

Machine Learning · Computer Science 2023-08-25 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Physics-Informed Neural Networks (PINNs) offer a promising approach to solving differential equations and, more generally, to applying deep learning to problems in the physical sciences. We adopt a recently developed transfer learning…

Machine Learning · Computer Science 2022-11-02 Raphaël Pellegrin , Blake Bullwinkel , Marios Mattheakis , Pavlos Protopapas

We proposed a framework for solving inverse problems in differential equations based on neural networks and automatic differentiation. Neural networks are used to approximate hidden fields. We analyze the source of errors in the framework…

Numerical Analysis · Mathematics 2024-12-20 Kailai Xu , Eric Darve

Physics-informed neural networks (PiNNs) recently emerged as a powerful solver for a large class of partial differential equations under various initial and boundary conditions. In this paper, we propose trapz-PiNNs, physics-informed neural…

Computational Physics · Physics 2023-04-19 Senbao Jiang , Xiaofan Li

We use differential equations based approaches to provide some {\it \textbf{physics}} insights into analyzing the dynamics of popular optimization algorithms in machine learning. In particular, we study gradient descent, proximal gradient…

Machine Learning · Computer Science 2018-10-26 Lin F. Yang , R. Arora , V. Braverman , Tuo Zhao

System identification has greatly benefited from deep learning techniques, particularly for modeling complex, nonlinear dynamical systems with partially unknown physics where traditional approaches may not be feasible. However, deep…

Machine Learning · Computer Science 2025-04-17 Marco Forgione , Ankush Chakrabarty , Dario Piga , Matteo Rufolo , Alberto Bemporad

Physics-informed neural networks have gained growing interest. Specifically, they are used to solve partial differential equations governing several physical phenomena. However, physics-informed neural network models suffer from several…

Computational Engineering, Finance, and Science · Computer Science 2022-11-29 Diab W. Abueidda , Seid Koric , Erman Guleryuz , Nahil A. Sobh

A physics-constrained neural network is presented for predicting the optical response of metasurfaces. Our approach incorporates physical laws directly into the neural network architecture and loss function, addressing critical challenges…

Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and…

Machine Learning · Computer Science 2026-03-17 Vlad Medvedev , Leon Armbruster , Christopher Straub , Georg Kruse , Andreas Rosskopf

Recent work in scientific machine learning has developed so-called physics-informed neural network (PINN) models. The typical approach is to incorporate physical domain knowledge as soft constraints on an empirical loss function and use…

Machine Learning · Computer Science 2021-11-12 Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , Michael W. Mahoney