English
Related papers

Related papers: Adaptive activation functions accelerate convergen…

200 papers

Different activation functions work best for different deep learning models. To exploit this, we leverage recent advancements in gradient-based search techniques for neural architectures to efficiently identify high-performing activation…

Machine Learning · Computer Science 2024-08-14 Lukas Strack , Mahmoud Safari , Frank Hutter

Physics-Informed Neural Networks (PINNs) have become a popular and powerful framework for solving partial differential equations (PDEs), leveraging neural networks to approximate solutions while embedding PDE constraints, boundary…

Numerical Analysis · Mathematics 2026-02-03 Zijuan Xin , Chenyao Wang , Feng Shi , Yizhong Sun

Physics-Informed Neural Networks (PINNs) provide a learning-based framework for solving partial differential equations (PDEs) by embedding governing physical laws into neural network training. In practice, however, their performance is…

Machine Learning · Computer Science 2026-01-21 Pancheng Niu , Jun Guo , Qiaolin He , Yongming Chen , Yanchao Shi

This work aims to provide an effective deep learning framework to predict the vector-soliton solutions of the coupled nonlinear equations and their interactions. The method we propose here is a physics-informed neural network (PINN)…

Numerical Analysis · Mathematics 2022-11-23 Shu-Mei Qin , Min Li , Tao Xu , Shao-Qun Dong

The simulation of power system dynamics poses a computationally expensive task. Considering the growing uncertainty of generation and demand patterns, thousands of scenarios need to be continuously assessed to ensure the safety of power…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Jochen Stiasny , Spyros Chatzivasileiadis

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Inspired by biological neurons, the activation functions play an essential part in the learning process of any artificial neural network commonly used in many real-world problems. Various activation functions have been proposed in the…

Machine Learning · Computer Science 2022-12-29 Ameya D. Jagtap , George Em Karniadakis

We present the application of a class of deep learning, known as Physics Informed Neural Networks (PINN), to learning and discovery in solid mechanics. We explain how to incorporate the momentum balance and constitutive relations into PINN,…

Machine Learning · Computer Science 2020-05-12 Ehsan Haghighat , Maziar Raissi , Adrian Moure , Hector Gomez , Ruben Juanes

Physics-informed neural networks (PINNs) have recently emerged as a promising way to compute the solutions of partial differential equations (PDEs) using deep neural networks. However, despite their significant success in various fields, it…

Numerical Analysis · Mathematics 2024-07-15 Seungchan Ko , Sang Hyeon Park

The field of artificial neural networks is expected to strongly benefit from recent developments of quantum computers. In particular, quantum machine learning, a class of quantum algorithms which exploit qubits for creating trainable neural…

Quantum Physics · Physics 2022-01-12 Marco Maronese , Claudio Destri , Enrico Prati

Physics-informed neural networks (PINNs) provide a deep learning framework for numerically solving partial differential equations (PDEs), and have been widely used in a variety of PDE problems. However, there still remain some challenges in…

Machine Learning · Computer Science 2022-05-19 Wensheng Li , Chao Zhang , Chuncheng Wang , Hanting Guan , Dacheng Tao

As one kind important phase field equations, Cahn-Hilliard equations contain spatial high order derivatives, strong nonlinearities, and even singularities. When using the physics informed neural network (PINN) to simulate the long time…

Numerical Analysis · Mathematics 2024-04-30 Huang Qiumei , Ma Jiaxuan , Xu Zhen

We study the combination of the alternating direction method of multipliers (ADMM) with physics-informed neural networks (PINNs) for a general class of nonsmooth partial differential equation (PDE)-constrained optimization problems, where…

Optimization and Control · Mathematics 2024-07-30 Yongcun Song , Xiaoming Yuan , Hangrui Yue

The inverse statistical problem of finding direct interactions in complex networks is difficult. In the natural sciences, well-controlled perturbation experiments are widely used to probe the structure of complex networks. However, our…

Disordered Systems and Neural Networks · Physics 2019-10-24 Jialong Jiang , David A. Sivak , Matt Thomson

Inverse problems are extensively studied in applied mathematics, with applications ranging from acoustic tomography for medical diagnosis to geophysical exploration. Physics informed neural networks (PINNs) have emerged as a powerful tool…

Recent advancements in physics-informed neural networks (PINNs) and their variants have garnered substantial focus from researchers due to their effectiveness in solving both forward and inverse problems governed by differential equations.…

Machine Learning · Computer Science 2026-01-06 Shivani Saini , Ramesh Kumar Vats , Arup Kumar Sahoo

Physics Informed Neural Networks (PINNs) is a promising application of deep learning. The smooth architecture of a fully connected neural network is appropriate for finding the solutions of PDEs; the corresponding loss function can also be…

Numerical Analysis · Mathematics 2021-12-09 Hwijae Son , Jin Woo Jang , Woo Jin Han , Hyung Ju Hwang

Physics-informed neural networks (PINNs) have garnered significant interest for their potential in solving partial differential equations (PDEs) that govern a wide range of physical phenomena. By incorporating physical laws into the…

Machine Learning · Computer Science 2026-04-24 Jian Cheng Wong , Isaac Yin Chung Lai , Pao-Hsiung Chiu , Chin Chun Ooi , Abhishek Gupta , Yew-Soon Ong

A crucial property for achieving secure, trustworthy and interpretable deep learning systems is their robustness: small changes to a system's inputs should not result in large changes to its outputs. Mathematically, this means one strives…

Machine Learning · Computer Science 2024-06-04 Bernd Prach , Christoph H. Lampert

Physics-Informed Neural Networks (PINNs) have shown promise in solving partial differential equations (PDEs), including the frequency-domain Helmholtz equation. However, standard training of PINNs using gradient descent (GD) suffers from…

Machine Learning · Computer Science 2025-04-24 Mohammad Mahdi Abedi , David Pardo , Tariq Alkhalifah