English
Related papers

Related papers: Efficient Transformer-Inspired Variants of Physics…

200 papers

Deep Operator Network (DeepONet) is a neural network framework for learning nonlinear operators such as those from ordinary differential equations (ODEs) describing complex systems. Multiple-input deep neural operators (MIONet) extended…

Machine Learning · Computer Science 2023-11-30 Zhihao Kong , Amirhossein Mollaali , Christian Moya , Na Lu , Guang Lin

Accurate temporal extrapolation remains a fundamental challenge for neural operators modeling dynamical systems, where predictions must extend far beyond the training horizon. Conventional DeepONet approaches rely on two limited paradigms:…

Machine Learning · Computer Science 2026-03-17 Dibyajyoti Nayak , Somdatta Goswami

Partial differential equations (PDEs) play a foundational role in modeling physical phenomena. This study addresses the challenging task of determining variable coefficients within PDEs from measurement data. We introduce a novel neural…

Numerical Analysis · Mathematics 2023-10-17 Ke Chen , Jasen Lai , Chunmei Wang

The convergence behavior of classical iterative solvers for parametric partial differential equations (PDEs) is often highly sensitive to the domain and specific discretization of PDEs. Previously, we introduced hybrid solvers by combining…

Machine Learning · Computer Science 2025-12-17 Youngkyu Lee , Francesc Levrero Florencio , Jay Pathak , George Em Karniadakis

Several forms for constructing novel physics-informed neural-networks (PINN) for the solution of partial-differential-algebraic equations based on derivative operator splitting are proposed, using the nonlinear Kirchhoff rod as a prototype…

Numerical Analysis · Mathematics 2026-05-05 Loc Vu-Quoc , Alexander Humer

Physics-Informed Neural Networks have emerged as a promising methodology for solving PDEs, gaining significant attention in computer science and various physics-related fields. Despite being demonstrated the ability to incorporate the…

Machine Learning · Computer Science 2025-05-01 Yao-Hsuan Tsai , Hsiao-Tung Juan , Pao-Hsiung Chiu , Chao-An Lin

One of the most popular recent areas of machine learning predicates the use of neural networks augmented by information about the underlying process in the form of Partial Differential Equations (PDEs). These physics-informed neural…

Fluid Dynamics · Physics 2025-06-17 Luca Menicali , David H. Richter , Stefano Castruccio

Phase-field modeling is an effective but computationally expensive method for capturing the mesoscale morphological and microstructure evolution in materials. Hence, fast and generalizable surrogate models are needed to alleviate the cost…

Materials Science · Physics 2022-07-01 Vivek Oommen , Khemraj Shukla , Somdatta Goswami , Remi Dingreville , George Em Karniadakis

It has been found that residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODEs). In this paper, we explore a deeper relationship between Transformer and numerical methods of ODEs. We show that a…

Computation and Language · Computer Science 2021-04-07 Bei Li , Quan Du , Tao Zhou , Shuhan Zhou , Xin Zeng , Tong Xiao , Jingbo Zhu

Convolutional neural operator is a CNN-based architecture recently proposed to enforce structure-preserving continuous-discrete equivalence and enable the genuine, alias-free learning of solution operators of PDEs. This neural operator was…

Machine Learning · Computer Science 2025-12-23 Peng Fan , Guofei Pang

Particle-in-Cell (PIC) simulations are widely used for modeling plasma kinetics by tracking discrete particle dynamics. However, their computational cost remains prohibitively high, due to the need to simulate large numbers of particles to…

Computational Physics · Physics 2025-04-29 Jianhua Lv , Linlin Zhong

Physics-informed neural network (PINN) is a data-driven solver for partial and ordinary differential equations(ODEs/PDEs). It provides a unified framework to address both forward and inverse problems. However, the complexity of the…

Machine Learning · Computer Science 2024-01-17 Abdul Hannan Mustajab , Hao Lyu , Zarghaam Rizvi , Frank Wuttke

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

Numerical Analysis · Mathematics 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

Optimal transmission switching (OTS) improves optimal power flow (OPF) by selectively opening transmission lines, but its mixed-integer formulation increases computational complexity, especially on large grids. To deal with this, we propose…

Systems and Control · Electrical Eng. & Systems 2025-07-24 Minsoo Kim , Jip Kim

Operator learning for Partial Differential Equations (PDEs) is rapidly emerging as a promising approach for surrogate modeling of intricate systems. Transformers with the self-attention mechanism$\unicode{x2013}$a powerful tool originally…

Machine Learning · Computer Science 2024-05-17 Junfeng Chen , Kailiang Wu

Physics-Informed Neural Networks (PINNs) have emerged as a promising deep learning framework for approximating numerical solutions to partial differential equations (PDEs). However, conventional PINNs, relying on multilayer perceptrons…

Computational Engineering, Finance, and Science · Computer Science 2024-05-08 Zhiyuan Zhao , Xueying Ding , B. Aditya Prakash

Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods…

Machine Learning · Computer Science 2024-05-24 Wenrui Hao , Xinliang Liu , Yahong Yang

In recent years the study of deep learning for solving differential equations has grown substantially. The use of physics-informed neural networks (PINNs) and deep operator networks (DeepONets) have emerged as two of the most useful…

Machine Learning · Computer Science 2025-08-27 Jason Matthews , Alex Bihlo

We present a comprehensive, physics aware deep learning framework for constructing fast and accurate surrogate models of rarefied, shock containing micro nozzle flows. The framework integrates three key components, a Fusion DeepONet…

Machine Learning · Computer Science 2025-10-22 Ehsan Roohi , Amirmehran Mahdavi

Simulation and optimization are crucial for advancing the engineering design of complex systems and processes. Traditional optimization methods require substantial computational time and effort due to their reliance on resource-intensive…

Machine Learning · Computer Science 2025-08-28 Janak M. Patel , Milad Ramezankhani , Anirudh Deodhar , Dagnachew Birru