English
Related papers

Related papers: Physics-informed Neural Networks for Solving Inver…

200 papers

Neural networks have been able to achieve groundbreaking accuracy at tasks conventionally considered only doable by humans. Using stochastic gradient descent, optimization in many dimensions is made possible, albeit at a relatively high…

Machine Learning · Computer Science 2017-07-17 Hirsh R. Agarwal , Andrew Huang

Large-scale dynamics of the oceans and the atmosphere are governed by primitive equations (PEs). Due to the nonlinearity and nonlocality, the numerical study of the PEs is generally challenging. Neural networks have been shown to be a…

Numerical Analysis · Mathematics 2023-03-21 Ruimeng Hu , Quyuan Lin , Alan Raydan , Sui Tang

Across scientific domains, a fundamental challenge is to characterize and compute the mappings from underlying physical processes to observed signals and measurements. While nonlinear neural networks have achieved considerable success, they…

Machine Learning · Computer Science 2025-08-11 Alexander DeLise , Kyle Loh , Krish Patel , Meredith Teague , Andrea Arnold , Matthias Chung

In this paper, we develop a deep learning approach for the accurate solution of challenging problems of near-field microscopy that leverages the powerful framework of physics-informed neural networks (PINNs) for the inversion of the complex…

Optics · Physics 2024-06-12 Yuyao Chen , Luca Dal Negro

Physics-informed neural networks (PINNs) have recently emerged as a promising way to compute the solutions of partial differential equations (PDEs) using deep neural networks. However, despite their significant success in various fields, it…

Numerical Analysis · Mathematics 2024-07-15 Seungchan Ko , Sang Hyeon Park

Physics-informed neural networks (PINNs) represent a significant advancement in scientific machine learning by integrating fundamental physical laws into their architecture through loss functions. PINNs have been successfully applied to…

Machine Learning · Computer Science 2024-07-16 Wei Zhou , Y. F. Xu

Distributed implementations of mini-batch stochastic gradient descent (SGD) suffer from communication overheads, attributed to the high frequency of gradient updates inherent in small-batch training. Training with large batches can reduce…

Machine Learning · Statistics 2018-06-12 Lingjiao Chen , Hongyi Wang , Jinman Zhao , Dimitris Papailiopoulos , Paraschos Koutris

Physics-informed neural networks (PINNs) have emerged as a promising deep learning method, capable of solving forward and inverse problems governed by differential equations. Despite their recent advance, it is widely acknowledged that…

Machine Learning · Computer Science 2024-06-11 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

In conventional deep learning, the number of neurons typically remains fixed during training. However, insights from biology suggest that the human hippocampus undergoes continuous neuron generation and pruning of neurons over the course of…

Machine Learning · Computer Science 2025-07-15 Taigo Sakai , Kazuhiro Hotta

Physics-Informed Neural Networks (PINNs) are a class of deep neural networks that are trained, using automatic differentiation, to compute the response of systems governed by partial differential equations (PDEs). The training of PINNs is…

Machine Learning · Computer Science 2021-04-27 Mohammad Amin Nabian , Rini Jasmine Gladstone , Hadi Meidani

In chemometrics, data from infrared or near-infrared (NIR) spectroscopy are often used to identify a compound or to analyze the composition of amaterial. This involves the calibration of models that predict the concentration ofmaterial…

Neural and Evolutionary Computing · Computer Science 2015-03-20 A. Ukil , J. Bernasconi

Inverse problems arise anywhere we have indirect measurement. As, in general they are ill-posed, to obtain satisfactory solutions for them needs prior knowledge. Classically, different regularization methods and Bayesian inference based…

Machine Learning · Statistics 2023-08-31 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

Physics-informed machine learning combines the expressiveness of data-based approaches with the interpretability of physical models. In this context, we consider a general regression problem where the empirical risk is regularized by a…

Artificial Intelligence · Computer Science 2025-07-15 Nathan Doumèche , Francis Bach , Gérard Biau , Claire Boyer

Contrastive learning has emerged as a powerful framework for learning generalizable representations, yet its theoretical understanding remains limited, particularly under imbalanced data distributions that are prevalent in real-world…

Machine Learning · Computer Science 2026-02-12 Haixu Liao , Yating Zhou , Songyang Zhang , Meng Wang , Shuai Zhang

Physics-informed Neural Networks (PINNs) have been shown to be effective in solving partial differential equations by capturing the physics induced constraints as a part of the training loss function. This paper shows that a PINN can be…

Machine Learning · Computer Science 2023-05-08 Chandrajit Bajaj , Luke McLennan , Timothy Andeen , Avik Roy

Full-waveform inversion (FWI) is a powerful geophysical imaging technique that infers high-resolution subsurface physical parameters by solving a non-convex optimization problem. However, due to limitations in observation, e.g., limited…

Numerical Analysis · Mathematics 2023-11-09 Xiong-Bin Yan , Keke Wu , Zhi-Qin John Xu , Zheng Ma

Addressing high-dimensional partial differential equations to derive effective actions within the functional renormalization group is formidable, especially when considering various field configurations, including inhomogeneous states, even…

Disordered Systems and Neural Networks · Physics 2024-08-05 Takeru Yokota

Why rely on dense neural networks and then blindly sparsify them when prior knowledge about the problem structure is already available? Many inverse problems admit algorithm-unrolled networks that naturally encode physics and sparsity. In…

Machine Learning · Computer Science 2025-10-14 Arian Eamaz , Farhang Yeganegi , Mojtaba Soltanalian

Systems biology and systems neurophysiology in particular have recently emerged as powerful tools for a number of key applications in the biomedical sciences. Nevertheless, such models are often based on complex combinations of multiscale…

Neural and Evolutionary Computing · Computer Science 2022-09-27 Matteo Ferrante , Andera Duggento , Nicola Toschi

Mini-batch stochastic gradient descent and variants thereof have become standard for large-scale empirical risk minimization like the training of neural networks. These methods are usually used with a constant batch size chosen by simple…

Machine Learning · Computer Science 2017-06-29 Lukas Balles , Javier Romero , Philipp Hennig