English
Related papers

Related papers: Interpolating Neural Network-Tensor Decomposition …

200 papers

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

Approximating solutions to partial differential equations (PDEs) is fundamental for the modeling of dynamical systems in science and engineering. Physics-informed neural networks (PINNs) are a recent machine learning-based approach, for…

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Physics-informed neural networks (PINNs) have shown promising potential for solving partial differential equations (PDEs) using deep learning. However, PINNs face training difficulties for evolutionary PDEs, particularly for dynamical…

Neural and Evolutionary Computing · Computer Science 2023-12-25 Siqi Chen , Bin Shan , Ye Li

I provide an introduction to the application of deep learning and neural networks for solving partial differential equations (PDEs). The approach, known as physics-informed neural networks (PINNs), involves minimizing the residual of the…

Computational Physics · Physics 2024-03-04 Hubert Baty

Physics-informed neural networks (PINNs) are an increasingly powerful way to solve partial differential equations, generate digital twins, and create neural surrogates of physical models. In this manuscript we detail the inner workings of…

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

This work proposes a solution for the problem of training physics-informed networks under partial integro-differential equations. These equations require an infinite or a large number of neural evaluations to construct a single residual for…

Machine Learning · Computer Science 2024-06-12 Ehsan Saleh , Saba Ghaffari , Timothy Bretl , Luke Olson , Matthew West

We present a method for learning dynamics of complex physical processes described by time-dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of…

Machine Learning · Computer Science 2020-12-07 Jungeun Kim , Kookjin Lee , Dongeun Lee , Sheo Yon Jin , Noseong Park

This work aims to help resolve the two main stumbling blocks in the application of Deep Neural Networks (DNNs), that is, the exceedingly large number of trainable parameters and their physical interpretability. This is achieved through a…

Machine Learning · Computer Science 2020-01-07 Giuseppe G. Calvi , Ahmad Moniri , Mahmoud Mahfouz , Qibin Zhao , Danilo P. Mandic

Implicit Neural Representations (INRs) model signals as continuous, differentiable functions. However, monolithic INRs scale poorly with data dimensionality, leading to excessive training costs. We propose F-INR, a framework that addresses…

Machine Learning · Computer Science 2025-11-27 Sai Karthikeya Vemuri , Tim Büchner , Joachim Denzler

A common trend in simulation-driven engineering applications is the ever-increasing size and complexity of the problem, where classical numerical methods typically suffer from significant computational time and huge memory cost. Methods…

Computational Engineering, Finance, and Science · Computer Science 2025-10-28 Jiachen Guo , Chanwook Park , Xiaoyu Xie , Zhongsheng Sang , Gregory J. Wagner , Wing Kam Liu

Tensorizing a neural network involves reshaping some or all of its dense weight matrices into higher-order tensors and approximating them using low-rank tensor network decompositions. This technique has shown promise as a model compression…

Machine Learning · Computer Science 2025-05-27 Safa Hamreras , Sukhbinder Singh , Román Orús

Deep learning has achieved remarkable success in diverse applications; however, its use in solving partial differential equations (PDEs) has emerged only recently. Here, we present an overview of physics-informed neural networks (PINNs),…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Xuhui Meng , Zhiping Mao , George E. Karniadakis

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

Numerical Analysis · Mathematics 2022-09-07 Xiaodan Ren

As an emerging technology in deep learning, physics-informed neural networks (PINNs) have been widely used to solve various partial differential equations (PDEs) in engineering. However, PDEs based on practical considerations contain…

Machine Learning · Computer Science 2021-11-11 Yuhao Huang

Invertible neural networks (INNs) are neural network architectures with invertibility by design. Thanks to their invertibility and the tractability of Jacobian, INNs have various machine learning applications such as probabilistic modeling,…

Machine Learning · Computer Science 2022-04-18 Isao Ishikawa , Takeshi Teshima , Koichi Tojo , Kenta Oono , Masahiro Ikeda , Masashi Sugiyama

High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on…

Machine Learning · Computer Science 2022-08-03 Pu Ren , Chengping Rao , Yang Liu , Zihan Ma , Qi Wang , Jian-Xun Wang , Hao Sun

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

Machine Learning · Computer Science 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many…