English
Related papers

Related papers: A Least-Squares-Based Neural Network (LS-Net) for …

200 papers

We construct least squares formulations of PDEs with inhomogeneous essential boundary conditions, where boundary residuals are not measured in unpractical fractional Sobolev norms, but which formulations nevertheless are shown to yield a…

Numerical Analysis · Mathematics 2025-05-12 Harald Monsuur , Robin Smeets , Rob Stevenson

The numerical solution of high dimensional partial differential equations (PDEs) is severely constrained by the curse of dimensionality (CoD), rendering classical grid--based methods impractical beyond a few dimensions. In recent years,…

Numerical Analysis · Mathematics 2026-01-27 Wenzhong Zhang , Zheyuan Hu , Wei Cai , George EM Karniadakis

This work investigates the use of shallow physics-informed neural networks (PINNs) for solving forward and inverse problems of nonlinear partial differential equations (PDEs). By reformulating PINNs as nonlinear systems, the…

Numerical Analysis · Mathematics 2026-02-12 Muhammad Luthfi Shahab , Imam Mukhlash , Hadi Susanto

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

When using Neural Networks as trial functions to numerically solve PDEs, a key choice to be made is the loss function to be minimised, which should ideally correspond to a norm of the error. In multiple problems, this error norm coincides…

Numerical Analysis · Mathematics 2022-10-26 Jamie M. Taylor , David Pardo , Ignacio Muga

Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks…

Machine Learning · Computer Science 2022-01-31 Pu Ren , Chengping Rao , Yang Liu , Jianxun Wang , Hao Sun

Linearized shallow neural networks that are constructed by fixing the hidden-layer parameters have recently shown strong performance in solving partial differential equations (PDEs). Such models, widely used in the random feature method…

Numerical Analysis · Mathematics 2026-01-21 Tong Mao , Jinchao Xu , Xiaofeng Xu

In this study, we present a new approach to design a Least Mean Squares (LMS) predictor. This approach exploits the concept of deep neural networks and their supremacy in terms of performance and accuracy. The new LMS predictor is…

Signal Processing · Electrical Eng. & Systems 2019-05-14 Lubna Shibly Mokatren , Ahmet Enis Cetin , Rashid Ansari

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

Statistics Theory · Mathematics 2025-02-20 Vladimir Spokoiny

In recent years, there has been an increasing interest in using deep learning and neural networks to tackle scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods, such…

Machine Learning · Computer Science 2025-02-14 Adrian Celaya , Yimo Wang , David Fuentes , Beatrice Riviere

Within the framework of parameter dependent PDEs, we develop a constructive approach based on Deep Neural Networks for the efficient approximation of the parameter-to-solution map. The research is motivated by the limitations and drawbacks…

Numerical Analysis · Mathematics 2022-12-16 Nicola R. Franco , Andrea Manzoni , Paolo Zunino

In this paper, we propose and study neural network based methods for solutions of high-dimensional quadratic porous medium equation (QPME). Three variational formulations of this nonlinear PDE are presented: a strong formulation and two…

Numerical Analysis · Mathematics 2022-05-09 Jianfeng Lu , Min Wang

To solve high-dimensional parameter-dependent partial differential equations (pPDEs), a neural network architecture is presented. It is constructed to map parameters of the model data to corresponding finite element solutions. To improve…

Numerical Analysis · Mathematics 2024-03-20 Janina E. Schütte , Martin Eigel

We propose a two-scale neural network method for solving partial differential equations (PDEs) with small parameters using physics-informed neural networks (PINNs). We directly incorporate the small parameters into the architecture of…

Numerical Analysis · Mathematics 2024-10-15 Qiao Zhuang , Chris Ziyi Yao , Zhongqiang Zhang , George Em Karniadakis

Least squares estimation, a regression technique based on minimisation of residuals, has been invaluable in bringing the best fit solutions to parameters in science and engineering. However, in dynamic environments such as in Geomatics…

Computational Engineering, Finance, and Science · Computer Science 2018-04-17 C. P. E. Agbachi

Fully connected multilayer perceptrons are used for obtaining numerical solutions of partial differential equations in various dimensions. Independent variables are fed into the input layer, and the output is considered as solution's value.…

Neural and Evolutionary Computing · Computer Science 2020-01-28 V. I. Avrutskiy

The transferable neural network (TransNet) is a two-layer shallow neural network with pre-determined and uniformly distributed neurons in the hidden layer, and the least-squares solvers can be particularly used to compute the parameters of…

Numerical Analysis · Mathematics 2025-02-28 Tianzheng Lu , Lili Ju , Liyong Zhu

In recent years, deep learning-based methods have been proposed for solving inverse scattering problems (ISPs), but most of them heavily rely on data and suffer from limited generalization capabilities. In this paper, a new solving scheme…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Yutong Du , Zicheng Liu , Bazargul Matkerim , Changyou Li , Yali Zong , Bo Qi , Jingwei Kou
‹ Prev 1 3 4 5 6 7 10 Next ›