中文
相关论文

相关论文: Understanding and mitigating gradient pathologies …

200 篇论文

Many applications, especially in physics and other sciences, call for easily interpretable and robust machine learning techniques. We propose a fully gradient-based technique for training radial basis function networks with an efficient and…

机器学习 · 计算机科学 2022-09-30 Jussi Määttä , Viacheslav Bazaliy , Jyri Kimari , Flyura Djurabekova , Kai Nordlund , Teemu Roos

Deep learning has been highly successful in some applications. Nevertheless, its use for solving partial differential equations (PDEs) has only been of recent interest with current state-of-the-art machine learning libraries, e.g.,…

机器学习 · 计算机科学 2024-10-22 Hamid El Bahja , Jan Christian Hauffen , Peter Jung , Bubacarr Bah , Issa Karambal

Differential equations are indispensable to engineering and hence to innovation. In recent years, physics-informed neural networks (PINN) have emerged as a novel method for solving differential equations. PINN method has the advantage of…

计算工程、金融与科学 · 计算机科学 2022-01-07 Mayank Raj , Pramod Kumbhar , Ratna Kumar Annabattula

This work addresses the development of a physics-informed neural network (PINN) with a loss term derived from a discretized time-dependent reduced-order system. In this work, first, the governing equations are discretized using a finite…

数值分析 · 数学 2024-01-30 Rahul Halder , Giovanni Stabile , Gianluigi Rozza

Physics-constrained neural networks are commonly employed to enhance prediction robustness compared to purely data-driven models, achieved through the inclusion of physical constraint losses during the model training process. However, one…

机器学习 · 计算机科学 2024-02-06 Hao Zhou , Sibo Cheng , Rossella Arcucci

In this chapter, we utilize dynamical systems to analyze several aspects of machine learning algorithms. As an expository contribution we demonstrate how to re-formulate a wide variety of challenges from deep neural networks, (stochastic)…

动力系统 · 数学 2025-07-08 Dennis Chemnitz , Maximilian Engel , Christian Kuehn , Sara-Viola Kuntz

Complex physical systems are often described by partial differential equations (PDEs) that depend on parameters such as the Reynolds number in fluid mechanics. In applications such as design optimization or uncertainty quantification,…

机器学习 · 计算机科学 2024-08-20 Woojin Cho , Minju Jo , Haksoo Lim , Kookjin Lee , Dongeun Lee , Sanghyun Hong , Noseong Park

Physics-Informed Neural Networks have emerged as a promising methodology for solving PDEs, gaining significant attention in computer science and various physics-related fields. Despite being demonstrated the ability to incorporate the…

机器学习 · 计算机科学 2025-05-01 Yao-Hsuan Tsai , Hsiao-Tung Juan , Pao-Hsiung Chiu , Chao-An Lin

Physics-informed neural networks have emerged as a powerful tool in the scientific machine learning community, with applications to both forward and inverse problems. While they have shown considerable empirical success, significant…

最优化与控制 · 数学 2025-12-11 Federica Caforio , Martin Holler , Matthias Höfler

This paper is a step-by-step, self-contained guide to the complete training cycle of a Physics-Informed Neural Network (PINN) -- a topic that existing tutorials and guides typically delegate to automatic differentiation libraries without…

数值分析 · 数学 2026-04-21 Abdeladhim Tahimi

I provide an introduction to the application of deep learning and neural networks for solving partial differential equations (PDEs). The approach, known as physics-informed neural networks (PINNs), involves minimizing the residual of the…

计算物理 · 物理学 2024-03-04 Hubert Baty

Physics-Informed Neural Networks (PINNs) seek to solve partial differential equations (PDEs) with deep learning. Mainstream approaches that deploy fully-connected multi-layer deep learning architectures require prolonged training to achieve…

机器学习 · 计算机科学 2025-12-16 Shaghayegh Fazliani , Zachary Frangella , Madeleine Udell

We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient…

机器学习 · 计算机科学 2018-06-22 Ayan Sinha , Zhao Chen , Vijay Badrinarayanan , Andrew Rabinovich

The simulation of power system dynamics poses a computationally expensive task. Considering the growing uncertainty of generation and demand patterns, thousands of scenarios need to be continuously assessed to ensure the safety of power…

系统与控制 · 电气工程与系统科学 2023-11-13 Jochen Stiasny , Spyros Chatzivasileiadis

In this paper, we developed a new PINN-based model to predict the potential of point-charged particles surrounded by conductive walls. As a result of the proposed physics-informed neural network model, the mean square error and R2 score are…

计算物理 · 物理学 2023-01-06 Fatemeh Hafezianzade , Morad Biagooi , SeyedEhsan Nedaaee Oskoee

Accurately predicting fluid dynamics and evolution has been a long-standing challenge in physical sciences. Conventional deep learning methods often rely on the nonlinear modeling capabilities of neural networks to establish mappings…

机器学习 · 计算机科学 2025-04-09 Huaguan Chen , Yang Liu , Hao Sun

While Physics-Informed Neural Networks (PINNs) are powerful for solving Partial Differential Equations (PDEs), their training is often paralyzed by gradient pathology. The gradients from the PDE residuals and boundary constraints oppose…

机器学习 · 计算机科学 2026-05-26 Yichen Luo , Peiyu Zhu , Dongxiao Hu , Jia Wang , Tailin Wu , Dapeng Lan , Yu Liu , Zhibo Pang

A long-standing problem at the interface of artificial intelligence and applied mathematics is to devise an algorithm capable of achieving human level or even superhuman proficiency in transforming observed data into predictive mathematical…

机器学习 · 统计学 2018-01-23 Maziar Raissi

Accurate models are essential for design, performance prediction, control, and diagnostics in complex engineering systems. Physics-based models excel during the design phase but often become outdated during system deployment due to changing…

机器学习 · 计算机科学 2025-01-22 Zihan Liu , Prashant N. Kambali , C. Nataraj

In recent years, scientific machine learning, particularly physic-informed neural networks (PINNs), has introduced new innovative methods to understanding the differential equations that describe power system dynamics, providing a more…

系统与控制 · 电气工程与系统科学 2024-03-12 Huynh T. T. Tran , Hieu T. Nguyen