English
Related papers

Related papers: Learning in PINNs: Phase transition, total diffusi…

200 papers

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a…

Machine Learning · Computer Science 2024-09-24 C G Krishnanunni , Tan Bui-Thanh

In this work, we propose a learning method for solving the linear transport equation under the diffusive scaling. Due to the multiscale nature of our model equation, the model is challenging to solve by using conventional methods. We employ…

Numerical Analysis · Mathematics 2021-02-25 Liu Liu , Tieyong Zeng , Zecheng Zhang

Sparse neural networks are important for achieving better generalization and enhancing computation efficiency. This paper proposes a novel learning approach to obtain sparse fully connected layers in neural networks (NNs) automatically. We…

Machine Learning · Computer Science 2021-04-28 Mengqiao Han , Xiabi Liu , Zhaoyang Hai , Zhengwen Li

This study takes advantage of recent advances in machine learning to establish a physics-based data analytic platform for distributed reconstruction of mechanical properties in layered components from full waveform data. In this vein, two…

Numerical Analysis · Mathematics 2023-10-20 Yang Xu , Fatemeh Pourahmadian , Jian Song , Conglin Wang

The wide application of machine learning (ML) techniques in statistics physics has presented new avenues for research in this field. In this paper, we introduce a semi-supervised learning method based on Siamese Neural Networks (SNN),…

Computational Physics · Physics 2025-08-18 Jianmin Shen , Shiyang Chen , Feiyi Liu , Wei Li , Youju Liu

Physics-informed neural networks (PINNs) have proven to be a promising method for the rapid solving of partial differential equations (PDEs) in both forward and inverse problems. However, due to the smoothness assumption of functions…

Computational Physics · Physics 2026-03-25 Guoqiang Lei , D. Exposito , Xuerui Mao

Current deep neural networks are highly overparameterized (up to billions of connection weights) and nonlinear. Yet they can fit data almost perfectly through variants of gradient descent algorithms and achieve unexpected levels of…

A physics-informed neural network (PINN), which has been recently proposed by Raissi et al [J. Comp. Phys. 378, pp. 686-707 (2019)], is applied to the partial differential equation (PDE) of liquid film flows. The PDE considered is the time…

Physics-informed neural network (PINN) is a data-driven solver for partial and ordinary differential equations(ODEs/PDEs). It provides a unified framework to address both forward and inverse problems. However, the complexity of the…

Machine Learning · Computer Science 2024-01-17 Abdul Hannan Mustajab , Hao Lyu , Zarghaam Rizvi , Frank Wuttke

Despite their great success, there is still no comprehensive theoretical understanding of learning with Deep Neural Networks (DNNs) or their inner organization. Previous work proposed to analyze DNNs in the \textit{Information Plane}; i.e.,…

Machine Learning · Computer Science 2017-05-02 Ravid Shwartz-Ziv , Naftali Tishby

Physics-informed neural networks (PINNs) offer a powerful framework for seismic wavefield modeling, yet they typically require time-consuming retraining when applied to different velocity models. Moreover, their training can suffer from…

Geophysics · Physics 2025-06-03 Shijun Cheng , Tariq Alkhalifah

Although Physics-Informed Neural Networks (PINNs) have been successfully applied in a wide variety of science and engineering fields, they can fail to accurately predict the underlying solution in slightly challenging…

Machine Learning · Computer Science 2023-03-27 Yufeng Wang , Cong Xu , Min Yang , Jin Zhang

Physics-informed neural networks (PINNs) have recently emerged as a promising alternative for extracting unknown quantities from experimental data. Despite this potential, much of the recent literature has relied on sparse, high-fidelity…

Fluid Dynamics · Physics 2026-01-09 Christian Toma , Bharathram Ganapathisubramani , Sean Symon

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Understanding how deep neural networks learn remains a fundamental challenge in modern machine learning. A growing body of evidence suggests that training dynamics undergo a distinct phase transition, yet our understanding of this…

Machine Learning · Computer Science 2025-05-21 Zhanpeng Zhou , Yongyi Yang , Mahito Sugiyama , Junchi Yan

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

Deep learning has been shown to be an effective tool in solving partial differential equations (PDEs) through physics-informed neural networks (PINNs). PINNs embed the PDE residual into the loss function of the neural network, and have been…

Machine Learning · Computer Science 2022-04-06 Jeremy Yu , Lu Lu , Xuhui Meng , George Em Karniadakis

Deep learning-based numerical schemes such as Physically Informed Neural Networks (PINNs) have recently emerged as an alternative to classical numerical schemes for solving Partial Differential Equations (PDEs). They are very appealing at…

Numerical Analysis · Mathematics 2022-05-11 A. Beguinet , V. Ehrlacher , R. Flenghi , M. Fuente , O. Mula , A. Somacal

Diffusion models (DM) have become fundamental components of generative models, excelling across various domains such as image creation, audio generation, and complex data interpolation. Signal-to-Noise diffusion models constitute a diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Khanh Doan , Long Tung Vuong , Tuan Nguyen , Anh Tuan Bui , Quyen Tran , Thanh-Toan Do , Dinh Phung , Trung Le

We develop a physics-informed neural network (PINN) to significantly augment state-of-the-art experimental data and apply it to stratified flows. The PINN is a fully-connected deep neural network fed with time-resolved, three-component…

Fluid Dynamics · Physics 2023-09-27 Lu Zhu , Xianyang Jiang , Adrien Lefauve , Rich R. Kerswell , P. F. Linden