English
Related papers

Related papers: Understanding and mitigating gradient pathologies …

200 papers

Physics-informed neural networks (PINNs) are at the forefront of scientific machine learning, making possible the creation of machine intelligence that is cognizant of physical laws and able to accurately simulate them. However, today's…

Neural and Evolutionary Computing · Computer Science 2026-02-23 Jian Cheng Wong , Chin Chun Ooi , Abhishek Gupta , Pao-Hsiung Chiu , Joshua Shao Zheng Low , My Ha Dao , Yew-Soon Ong

In this study, we propose a new numerical scheme for physics-informed neural networks (PINNs) that enables precise and inexpensive solution for partial differential equations (PDEs) in case of arbitrary geometries while strictly enforcing…

Numerical Analysis · Mathematics 2024-07-30 Hamed Saidaoui , Luis Espath , Rául Tempone

Recent advances of data-driven machine learning have revolutionized fields like computer vision, reinforcement learning, and many scientific and engineering domains. In many real-world and scientific problems, systems that generate data are…

Machine Learning · Computer Science 2023-03-08 Zhongkai Hao , Songming Liu , Yichi Zhang , Chengyang Ying , Yao Feng , Hang Su , Jun Zhu

The success of the current wave of artificial intelligence can be partly attributed to deep neural networks, which have proven to be very effective in learning complex patterns from large datasets with minimal human intervention. However,…

Machine Learning · Computer Science 2022-06-01 Haakon Robinson , Suraj Pawar , Adil Rasheed , Omer San

Physics-informed neural networks (PINNs) have emerged as a versatile and widely applicable concept across various science and engineering domains over the past decade. This article offers a comprehensive overview of the fundamentals of…

Computational Engineering, Finance, and Science · Computer Science 2024-10-02 Sai Ganga , Ziya Uddin

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

The rapid progress in machine learning in recent years has been based on a highly productive connection to gradient-based optimization. Further progress hinges in part on a shift in focus from pattern recognition to decision-making and…

Machine Learning · Computer Science 2024-02-27 Neha S. Wadia , Yatin Dandi , Michael I. Jordan

Physics-informed neural network (PINN) is a powerful emerging method for studying forward-inverse problems of partial differential equations (PDEs), even from limited sample data. Variable coefficient PDEs, which model real-world phenomena,…

Computational Physics · Physics 2025-03-07 Hui-Juan Zhou , Yong Chen

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

Recently, the advent of deep learning has spurred interest in the development of physics-informed neural networks (PINN) for efficiently solving partial differential equations (PDEs), particularly in a parametric setting. Among all…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Han Gao , Luning Sun , Jian-Xun Wang

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a…

Machine Learning · Computer Science 2024-08-12 Joaquin Alvarez

We propose a new family of neural networks to predict the behaviors of physical systems by learning their underpinning constraints. A neural projection operator lies at the heart of our approach, composed of a lightweight network with an…

Neural and Evolutionary Computing · Computer Science 2020-12-15 Shuqi Yang , Xingzhe He , Bo Zhu

Physics-informed neural networks (PINNs) have been popularized as a deep learning framework that can seamlessly synthesize observational data and partial differential equation (PDE) constraints. Their practical effectiveness however can be…

Machine Learning · Computer Science 2023-08-17 Sifan Wang , Shyam Sankaran , Hanwen Wang , Paris Perdikaris

Physics-Informed Neural Networks (PINNs) have enabled significant improvements in modelling physical processes described by partial differential equations (PDEs). PINNs are based on simple architectures, and learn the behavior of complex…

Physics-Informed Neural Networks (PINNs) are machine learning tools that approximate the solution of general partial differential equations (PDEs) by adding them in some form as terms of the loss/cost function of a Neural Network. Most…

Numerical Analysis · Mathematics 2022-08-29 Antonio Tadeu Azevedo Gomes , Larissa Miguez da Silva , Frederic Valentin

Constructing first-principles models is usually a challenging and time-consuming task due to the complexity of the real-life processes. On the other hand, data-driven modeling, and in particular neural network models often suffer from…

Optimization and Control · Mathematics 2023-02-03 Ece S. Koksal , Erdal Aydin

In an era increasingly focused on green computing and explainable AI, revisiting traditional approaches in theoretical and phenomenological particle physics is paramount. This project evaluates various machine learning (ML)…

High Energy Physics - Phenomenology · Physics 2025-04-30 Vasileios Vatellis

Modeling stiff partial differential equations (PDEs) with sharp gradients remains a significant challenge for scientific machine learning. While Physics-Informed Neural Networks (PINNs) struggle with spectral bias and slow training times,…

Computational Engineering, Finance, and Science · Computer Science 2026-03-09 Akshay Govind Srinivasan , Balaji Srinivasan

This paper presents a constraint-guided deep learning framework for developing physically consistent health indicators in bearing prognostics and health management. Conventional data-driven methods often lack physical plausibility, while…

Machine Learning · Computer Science 2025-03-13 Yonas Tefera , Quinten Van Baelen , Maarten Meire , Stijn Luca , Peter Karsmakers
‹ Prev 1 8 9 10 Next ›