English
Related papers

Related papers: Learnable Activation Functions in Physics-Informed…

200 papers

Physics Informed Neural Networks (PINNs) is a promising application of deep learning. The smooth architecture of a fully connected neural network is appropriate for finding the solutions of PDEs; the corresponding loss function can also be…

Numerical Analysis · Mathematics 2021-12-09 Hwijae Son , Jin Woo Jang , Woo Jin Han , Hyung Ju Hwang

Physics-informed neural networks (PINN) face significant challenges from spectral bias, which impedes their ability to model high-frequency phenomena and limits extrapolation performance. To address this, we introduce xLSTM-PINN, a novel…

Machine Learning · Computer Science 2025-12-08 Ze Tao , Darui Zhao , Fujun Liu , Ke Xu , Xiangsheng Hu

Physics-informed neural networks (PINNs) are a newly emerging research frontier in machine learning, which incorporate certain physical laws that govern a given data set, e.g., those described by partial differential equations (PDEs), into…

Neural and Evolutionary Computing · Computer Science 2023-07-11 Bo Wang , A. K. Qin , Sajjad Shafiei , Hussein Dia , Adriana-Simona Mihaita , Hanna Grzybowska

Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs). To overcome this issue, we propose IFeF-PINN, an…

Machine Learning · Computer Science 2025-10-23 Yulun Wu , Miguel Aguiar , Karl H. Johansson , Matthieu Barreau

We shed light on a pitfall and an opportunity in physics-informed neural networks (PINNs). We prove that a multilayer perceptron (MLP) only with ReLU (Rectified Linear Unit) or ReLU-like Lipschitz activation functions will always lead to a…

Computational Physics · Physics 2023-04-04 Kuangdai Leng , Jeyan Thiyagalingam

In recent years, Scientific Machine Learning (SciML) methods for solving partial differential equations (PDEs) have gained increasing popularity. Within such a paradigm, Physics-Informed Neural Networks (PINNs) are novel deep learning…

Numerical Analysis · Mathematics 2024-04-25 Pasquale Ambrosio , Salvatore Cuomo , Mariapia De Rosa

Approximating solutions to partial differential equations (PDEs) is fundamental for the modeling of dynamical systems in science and engineering. Physics-informed neural networks (PINNs) are a recent machine learning-based approach, for…

Artificial neural networks typically have a fixed, non-linear activation function at each neuron. We have designed a novel form of piecewise linear activation function that is learned independently for each neuron using gradient descent.…

Neural and Evolutionary Computing · Computer Science 2015-04-22 Forest Agostinelli , Matthew Hoffman , Peter Sadowski , Pierre Baldi

With growing investigations into solving partial differential equations by physics-informed neural networks (PINNs), more accurate and efficient PINNs are required to meet the practical demands of scientific computing. One bottleneck of…

Machine Learning · Computer Science 2025-10-29 Tianchi Yu , Yiming Qi , Ivan Oseledets , Shiyi Chen

We propose a meta-learning technique for offline discovery of physics-informed neural network (PINN) loss functions. We extend earlier works on meta-learning, and develop a gradient-based meta-learning algorithm for addressing diverse task…

Machine Learning · Computer Science 2022-04-13 Apostolos F Psaros , Kenji Kawaguchi , George Em Karniadakis

Parallel physical information neural networks (P-PINNs) have been widely used to solve systems with multiple coupled physical fields, such as the coupled Stokes-Darcy equations with Beavers-Joseph-Saffman (BJS) interface conditions.…

Fluid Dynamics · Physics 2025-10-21 Li Shan , Xi Shen

Solving coupled systems of differential equations (DEs) is a central problem across scientific computing. While Physics Informed Neural Networks (PINNs) offer a promising, mesh-free approach, their standard architectures struggle with the…

Quantum Physics · Physics 2026-02-17 Zhao-Wei Wang , Zhao-Ming Wang

Physics-informed neural networks (PINNs), rooted in deep learning, have emerged as a promising approach for solving partial differential equations (PDEs). By embedding the physical information described by PDEs into feedforward neural…

Machine Learning · Computer Science 2024-01-26 Yanzhi Liu , Ruifan Wu , Ying Jiang

Physics-informed neural networks (PINNs) are promising to replace conventional partial differential equation (PDE) solvers by offering more accurate and flexible PDE solutions. However, they are hampered by the relatively slow convergence…

Machine Learning · Computer Science 2023-05-16 Mohammad H. Taufik , Tariq Alkhalifah

Physics intelligence and digital twins often require rapid and repeated performance evaluation of various engineering systems (e.g. robots, autonomous vehicles, semiconductor chips) to enable (almost) real-time actions or decision making.…

Machine Learning · Computer Science 2026-02-10 Yequan Zhao , Xinling Yu , Xian Xiao , Zhixiong Chen , Ziyue Liu , Geza Kurczveil , Raymond G. Beausoleil , Sijia Liu , Zheng Zhang

Physics-Informed Neural Networks (PINNs) provide a learning-based framework for solving partial differential equations (PDEs) by embedding governing physical laws into neural network training. In practice, however, their performance is…

Machine Learning · Computer Science 2026-01-21 Pancheng Niu , Jun Guo , Qiaolin He , Yongming Chen , Yanchao Shi

Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. In forward modeling problems, PINNs are meshless partial…

Machine Learning · Computer Science 2023-11-28 Yicheng Wang , Xiaotian Han , Chia-Yuan Chang , Daochen Zha , Ulisses Braga-Neto , Xia Hu

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: how can models utilize physics or mathematical principles…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang , Ali Mohammad-Djafari

Physics-Informed Neural Networks (PINNs) have emerged as a powerful, mesh-free paradigm for solving partial differential equations (PDEs). However, they notoriously struggle with stiff, multi-scale, and nonlinear systems due to the inherent…

Machine Learning · Computer Science 2026-03-24 Julian Evan Chrisnanto , Nurfauzi Fadillah , Yulison Herry Chrisnanto

Physics-Informed Neural Networks (PINNs) are a class of deep neural networks that are trained, using automatic differentiation, to compute the response of systems governed by partial differential equations (PDEs). The training of PINNs is…

Machine Learning · Computer Science 2021-04-27 Mohammad Amin Nabian , Rini Jasmine Gladstone , Hadi Meidani