English
Related papers

Related papers: Least-Squares ReLU Neural Network (LSNN) Method Fo…

200 papers

This paper studies adaptive least-squares finite element methods for convection-dominated diffusion-reaction problems. The least-squares methods are based on the first-order system of the primal and dual variables with various ways of…

Numerical Analysis · Mathematics 2023-01-30 Zhiqiang Cai , Binghe Chen , Jing Yang

A series of third- and fifth-order hybrid compact least-squares central weighted essentially non-oscillatory schemes are proposed and applied to curvilinear structured grids for the finite volume method. In smooth regions, compact…

Fluid Dynamics · Physics 2025-08-05 Jianhua Pan , Luxin Li , Ji Yin , Wei-Gang Zeng

Separable nonlinear least squares (SNLS)problem is a special class of nonlinear least squares (NLS)problems, whose objective function is a mixture of linear and nonlinear functions. It has many applications in many different areas,…

Computational Geometry · Computer Science 2016-11-17 Wajeb Gharibi , Omar Saeed Al-Mushayt

In this paper, we study the least-squares finite element methods (LSFEM) for the linear hyperbolic transport equations. The linear transport equation naturally allows discontinuous solutions and discontinuous inflow conditions, while the…

Numerical Analysis · Mathematics 2019-07-12 Qunjie Liu , Shun Zhang

In this paper, we study the problem of finding the least square solutions of over-determined linear algebraic equations over networks in a distributed manner. Each node has access to one of the linear equations and holds a dynamic state. We…

Optimization and Control · Mathematics 2019-09-10 Tao Yang , Jemin George , Jiahu Qin , Xinlei Yi , Junfeng Wu

This work provides a comparative assessment of several low-dissipation numerical schemes for hyperbolic conservation laws, highlighting their performance relative to the classical Harten-Lax-van Leer (HLL) schemes. The schemes under…

Numerical Analysis · Mathematics 2026-02-04 Shaoshuai Chu , Michael Herty

In this paper, we introduce adaptive neuron enhancement (ANE) method for the best least-squares approximation using two-layer ReLU neural networks (NNs). For a given function f(x), the ANE method generates a two-layer ReLU NN and a…

Numerical Analysis · Mathematics 2022-01-19 Min Liu , Zhiqiang Cai , Jingshuang Chen

We propose a new entropy-compatible neural network method for scalar hyperbolic conservation laws and establish, to our knowledge, the first explicit \(L^1\) convergence rates in this setting that apply to piecewise smooth entropy…

Numerical Analysis · Mathematics 2026-05-20 Jiachuan Cao , Buyang Li , Hao Li

We present a neural network-based method for learning scalar hyperbolic conservation laws. Our method replaces the traditional numerical flux in finite volume schemes with a trainable neural network while preserving the conservative…

We address the approximation of entropy solutions to initial-boundary value problems for nonlinear strictly hyperbolic conservation laws using neural networks. A general and systematic framework is introduced for the design of efficient and…

Analysis of PDEs · Mathematics 2025-09-16 Igor Ciril , Khalil Haddaoui , Yohann Tendero

Recursive least squares (RLS) algorithms were once widely used for training small-scale neural networks, due to their fast convergence. However, previous RLS algorithms are unsuitable for training deep neural networks (DNNs), since they…

Machine Learning · Computer Science 2021-09-08 Chunyuan Zhang , Qi Song , Hui Zhou , Yigui Ou , Hongyao Deng , Laurence Tianruo Yang

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on…

Optimization and Control · Mathematics 2022-11-11 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

A third-order weighted essentially non-oscillatory compact least-squares scheme is developed for the finite volume method on structured curvilinear non-uniform grids. The proposed scheme features compact least-squares reconstruction with…

Fluid Dynamics · Physics 2025-08-05 Jianhua Pana , Luxin Li , Wei-Gang Zeng

We present a non-conforming least squares method for approximating solutions of second order elliptic problems with discontinuous coefficients. The method is based on a general Saddle Point Least Squares (SPLS) method introduced in previous…

Numerical Analysis · Mathematics 2019-04-01 Constantin Bacuta , Jacob Jacavage

Physics-informed Neural Network (PINN) faces significant challenges when approximating solutions to conservation laws, particularly in ensuring conservation and accurately resolving discontinuities. To address these limitations, we propose…

Numerical Analysis · Mathematics 2025-09-10 Weiheng Zeng , Kun Wang , Ruoxi Lu , Tiegang Liu

In this paper, a new Discontinuity Capturing Shallow Neural Network (DCSNN) for approximating $d$-dimensional piecewise continuous functions and for solving elliptic interface problems is developed. There are three novel features in the…

Numerical Analysis · Mathematics 2023-06-13 Wei-Fan Hu , Te-Sheng Lin , Ming-Chih Lai

We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure, both linear and…

Methodology · Statistics 2024-01-09 Jungmin Shin , Seung Jun Shin , Sungwan Bang

In this paper, a few dual least-squares finite element methods and their application to scalar linear hyperbolic problems are studied. The purpose is to obtain $L^2$-norm approximations on finite element spaces of the exact solutions to…

Numerical Analysis · Mathematics 2020-10-06 Delyan Z. Kalchev , Thomas A. Manteuffel , Steffen Münzenmaier

This work develops robust diffusion recursive least squares algorithms to mitigate the performance degradation often experienced in networks of agents in the presence of impulsive noise. The first algorithm minimizes an exponentially…

Machine Learning · Computer Science 2019-02-05 Y. Yu , H. Zhao , R. C. de Lamare , Y. Zakharov , L. Lu