English
Related papers

Related papers: Adaptive activation functions accelerate convergen…

200 papers

We propose a new type of neural networks, Kronecker neural networks (KNNs), that form a general framework for neural networks with adaptive activation functions. KNNs employ the Kronecker product, which provides an efficient way of…

Machine Learning · Computer Science 2021-10-22 Ameya D. Jagtap , Yeonjong Shin , Kenji Kawaguchi , George Em Karniadakis

Physics-informed neural networks (PINNs) have emerged as a promising approach to solving partial differential equations (PDEs) using neural networks, particularly in data-scarce scenarios, due to their unsupervised training capability.…

Machine Learning · Computer Science 2025-03-25 Edgar Torres , Jonathan Schiefer , Mathias Niepert

Although physics-informed neural networks (PINNs) have shown great potential in dealing with nonlinear partial differential equations (PDEs), it is common that PINNs will suffer from the problem of insufficient precision or obtaining…

Machine Learning · Computer Science 2024-10-07 Feilong Jiang , Xiaonan Hou , Min Xia

Addressing high-dimensional partial differential equations to derive effective actions within the functional renormalization group is formidable, especially when considering various field configurations, including inhomogeneous states, even…

Disordered Systems and Neural Networks · Physics 2024-08-05 Takeru Yokota

A pivotal aspect in the design of neural networks lies in selecting activation functions, crucial for introducing nonlinear structures that capture intricate input-output patterns. While the effectiveness of adaptive or trainable activation…

Machine Learning · Computer Science 2024-08-06 Farhad Pourkamali-Anaraki , Tahamina Nasrin , Robert E. Jensen , Amy M. Peterson , Christopher J. Hansen

We consider the approximation of a class of dynamic partial differential equations (PDE) of second order in time by the physics-informed neural network (PINN) approach, and provide an error analysis of PINN for the wave equation, the…

Numerical Analysis · Mathematics 2023-03-23 Yanxia Qian , Yongchao Zhang , Yunqing Huang , Suchuan Dong

Activation functions are crucial in graph neural networks (GNNs) as they allow defining a nonlinear family of functions to capture the relationship between the input graph data and their representations. This paper proposes activation…

Signal Processing · Electrical Eng. & Systems 2020-09-16 Bianca Iancu , Luana Ruiz , Alejandro Ribeiro , Elvin Isufi

This research presents the development of an innovative algorithm tailored for the adaptive sampling of residual points within the framework of Physics-Informed Neural Networks (PINNs). By addressing the limitations inherent in existing…

Machine Learning · Computer Science 2023-06-16 Shikhar Nilabh , Fidel Grandia

Physics-informed neural networks (PINNs) show great advantages in solving partial differential equations. In this paper, we for the first time propose to study conformable time fractional diffusion equations by using PINNs. By solving the…

Numerical Analysis · Mathematics 2021-08-18 Yinlin Ye , Yajing Li , Hongtao Fan , Xinyi Liu , Hongbing Zhang

Physics-informed neural networks (PINNs) provide a means of obtaining approximate solutions of partial differential equations and systems through the minimisation of an objective function which includes the evaluation of a residual function…

Machine Learning · Computer Science 2024-10-08 Jose Florido , He Wang , Amirul Khan , Peter K. Jimack

In recent years, the gap between Deep Learning (DL) methods and analytical or numerical approaches in scientific computing is tried to be filled by the evolution of Physics-Informed Neural Networks (PINNs). However, still, there are many…

Machine Learning · Computer Science 2024-08-16 Jassem Abbasi , Pål Østebø Andersen

We propose two approaches of locally adaptive activation functions namely, layer-wise and neuron-wise locally adaptive activation functions, which improve the performance of deep and physics-informed neural networks. The local adaptation of…

Machine Learning · Computer Science 2021-04-28 Ameya D. Jagtap , Kenji Kawaguchi , George Em Karniadakis

This paper establishes an approximation theorem for randomized neural networks (RaNNs) whose hidden-layer parameters are uniformly sampled from a prescribed bounded domain. Our analysis shows that, for RaNNs of the form $\mathop{\sum}_i W_i…

Numerical Analysis · Mathematics 2026-04-13 Ran Bi , Weibing Deng

We develop improved physics-informed neural networks (PINNs) for high-order and high-dimensional power system models described by nonlinear ordinary differential equations. We propose some novel enhancements to improve PINN training and…

Machine Learning · Computer Science 2024-10-11 Vineet Jagadeesan Nair

We consider physics-informed neural networks (PINNs) [Raissi et al., J.~Comput. Phys. 278 (2019) 686-707] for forward physical problems. In order to find optimal PINNs configuration, we introduce a hyper-parameter optimization (HPO)…

Numerical Analysis · Mathematics 2023-02-01 Paul Escapil-Inchauspé , Gonzalo A. Ruz

This paper develops a novel deep learning approach for solving evolutionary equations, which integrates sequential learning strategies with an enhanced hard constraint strategy featuring trainable parameters, addressing the low…

Machine Learning · Computer Science 2025-03-25 Yushi Zhang , Shuai Su , Yong Wang , Yanzhong Yao

Recently, Physics-Informed Neural Networks (PINNs) have gained significant attention for their versatile interpolation capabilities in solving partial differential equations (PDEs). Despite their potential, the training can be…

Geophysics · Physics 2024-04-12 Tariq Alkhalifah , Xinquan Huang

In this paper, we propose the augmented physics-informed neural network (APINN), which adopts soft and trainable domain decomposition and flexible parameter sharing to further improve the extended PINN (XPINN) as well as the vanilla PINN…

Machine Learning · Computer Science 2023-10-03 Zheyuan Hu , Ameya D. Jagtap , George Em Karniadakis , Kenji Kawaguchi

Physics-Informed Neural Networks (PINNs) are mesh-free approaches for the numerical approximation of partial differential equations, where a neural network is trained by minimizing a loss function derived from the governing equations and…

Numerical Analysis · Mathematics 2026-04-03 Medard Govoeyi , Thomas Richter

Physics-informed Neural Networks (PINNs) have been shown to be effective in solving partial differential equations by capturing the physics induced constraints as a part of the training loss function. This paper shows that a PINN can be…

Machine Learning · Computer Science 2023-05-08 Chandrajit Bajaj , Luke McLennan , Timothy Andeen , Avik Roy