English
Related papers

Related papers: Spectral bias in physics-informed and operator lea…

200 papers

Engineering design problems often involve solving parametric Partial Differential Equations (PDEs) under variable PDE parameters and domain geometry. Recently, neural operators have shown promise in learning PDE operators and quickly…

Machine Learning · Computer Science 2024-11-14 Weiheng Zhong , Hadi Meidani

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Ali Harandi , Ahmad Moeineddin , Michael Kaliske , Stefanie Reese , Shahed Rezaei

I provide an introduction to the application of deep learning and neural networks for solving partial differential equations (PDEs). The approach, known as physics-informed neural networks (PINNs), involves minimizing the residual of the…

Computational Physics · Physics 2024-03-04 Hubert Baty

Physics-informed neural networks (PINNs) have recently emerged as an alternative way of solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In…

Analysis of PDEs · Mathematics 2019-09-04 Dongkun Zhang , Lu Lu , Ling Guo , George Em Karniadakis

The rise of Physics-Informed Neural Networks (PINNs) has popularized the concept of solving differential equations via residual minimization. However, neural networks are often viewed as ``black boxes" requiring significant computational…

Numerical Analysis · Mathematics 2026-05-20 Ayman Mourad , Fatima Mroue

The mechanism governing the training dynamics of Quantum Neural Networks (QNNs) remains under-explored. In classical Deep Neural Networks (DNNs), training is dominated by "Spectral Bias," i.e. prioritizing learning low-frequency components…

Quantum Physics · Physics 2025-12-25 Yi-hang Xu , Dan-Bo Zhang , Junchi Yan

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

Boundary conditions (BCs) are important groups of physics-enforced constraints that are necessary for solutions of Partial Differential Equations (PDEs) to satisfy at specific spatial locations. These constraints carry important physical…

Machine Learning · Computer Science 2023-03-06 Nadim Saad , Gaurav Gupta , Shima Alizadeh , Danielle C. Maddix

The physics informed neural network (PINN) is a promising method for solving time-evolution partial differential equations (PDEs). However, the standard PINN method may fail to solve the PDEs with strongly nonlinear characteristics or those…

Numerical Analysis · Mathematics 2023-06-08 Jiawei Guo , Yanzhong Yao , Han Wang , Tongxiang Gu

Partial differential equations (PDEs) govern complex systems, yet neural operators often struggle to efficiently capture the long-range, nonlocal interactions inherent in their solution maps. We introduce Spectral Filtering Operator (SFO),…

Machine Learning · Computer Science 2026-01-27 Noam Koren , Rafael Moschopoulos , Kira Radinsky , Elad Hazan

The widespread use of neural networks across different scientific domains often involves constraining them to satisfy certain symmetries, conservation laws, or other domain knowledge. Such constraints are often imposed as soft penalties…

Machine Learning · Computer Science 2020-01-15 Sifan Wang , Yujun Teng , Paris Perdikaris

We introduce a novel framework for uncertainty quantification of solution operators associated with stochastic partial differential equations (SPDEs). Although SPDEs play a central role in modeling complex physical systems under…

Machine Learning · Statistics 2026-05-19 Phuoc-Toan Huynh , Richard Archibald , Feng Bao

In various engineering and applied science applications, repetitive numerical simulations of partial differential equations (PDEs) for varying input parameters are often required (e.g., aircraft shape optimization over many design…

Machine Learning · Computer Science 2023-10-17 Woojin Cho , Kookjin Lee , Donsub Rim , Noseong Park

Physics-Informed Neural Networks (PINNs) have gained much attention in various fields of engineering thanks to their capability of incorporating physical laws into the models. PINNs integrate the physical constraints by minimizing the…

Machine Learning · Computer Science 2025-07-28 Thi Nguyen Khoa Nguyen , Thibault Dairay , Raphaël Meunier , Christophe Millet , Mathilde Mougeot

Inverse problems involving partial differential equations (PDEs) can be seen as discovering a mapping from measurement data to unknown quantities, often framed within an operator learning approach. However, existing methods typically rely…

Numerical Analysis · Mathematics 2025-02-10 Sung Woong Cho , Hwijae Son

Learning PDE dynamics from limited data with unknown physics is challenging. Existing neural PDE solvers either require large datasets or rely on known physics (e.g., PDE residuals or handcrafted stencils), leading to limited applicability.…

Machine Learning · Computer Science 2026-05-25 Han Wan , Rui Zhang , Hao Sun

Attention mechanisms have emerged as transformative tools in core AI domains such as natural language processing and computer vision. Yet, their largely untapped potential for modeling intricate physical systems presents a compelling…

Machine Learning · Computer Science 2025-05-30 Ning Liu , Yue Yu

Discovering hidden physical laws and identifying governing system parameters from sparse observations are central challenges in computational science and engineering. Existing data-driven methods, such as physics-informed neural networks…

Machine Learning · Computer Science 2026-04-16 Dibakar Roy Sarkar , Vijay Kag , Birupaksha Pal , Somdatta Goswami

Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when…

Machine Learning · Computer Science 2023-07-11 Rajat Arora

Neural operators are becoming the default tools to learn solutions to governing partial differential equations (PDEs) in weather and ocean forecasting applications. Despite early promising achievements, significant challenges remain,…

Machine Learning · Computer Science 2025-10-14 Vahidreza Jahanmard , Ali Ramezani-Kebrya , Robinson Hordoir