English
Related papers

Related papers: Least-Squares Neural Network (LSNN) Method For Sca…

200 papers

This paper presents a spectral scheme for the numerical solution of nonlinear conservation laws in non-periodic domains under arbitrary boundary conditions. The approach relies on the use of the Fourier Continuation (FC) method for spectral…

Numerical Analysis · Mathematics 2021-11-03 Oscar P. Bruno , Jan S. Hesthaven , Daniel V. Leibovici

This paper investigates two inexact Levenberg-Marquardt (LM) methods for solving systems of nonlinear equations. Both approaches compute approximate search directions by solving the LM linear system inexactly, subject to specific…

Optimization and Control · Mathematics 2025-07-23 Bas Symoens , Morteza Rahimi , Masoud Ahookhosh

In this paper, we introduce a shallow (one-hidden-layer) physics-informed neural network for solving partial differential equations on static and evolving surfaces. For the static surface case, with the aid of level set function, the…

Numerical Analysis · Mathematics 2025-03-20 Wei-Fan Hu , Yi-Jun Shih , Te-Sheng Lin , Ming-Chih Lai

We propose a decoupled divergence-free neural networks basis (Decoupled-DFNN) method for solving incompressible flow problems, including the Stokes and Navier-Stokes equations. To ensure the divergence free property exactly, the velocity…

Numerical Analysis · Mathematics 2026-03-19 Jinbao Cheng , Jianguo Huang , Haoqin Wang , Tao Zhou

We propose a new algorithm for minimizing regularized empirical loss: Stochastic Dual Newton Ascent (SDNA). Our method is dual in nature: in each iteration we update a random subset of the dual variables. However, unlike existing methods…

Machine Learning · Computer Science 2015-02-10 Zheng Qu , Peter Richtárik , Martin Takáč , Olivier Fercoq

Variational Physics-Informed Neural Networks often suffer from poor convergence when using stochastic gradient-descent-based optimizers. By introducing a Least Squares solver for the weights of the last layer of the neural network, we…

Numerical Analysis · Mathematics 2025-03-20 Carlos Uriarte , Manuela Bastidas , David Pardo , Jamie M. Taylor , Sergio Rojas

In this paper, we study the problem of finding the least square solutions of over-determined linear algebraic equations over networks in a distributed manner. Each node has access to one of the linear equations and holds a dynamic state. We…

Optimization and Control · Mathematics 2019-09-10 Tao Yang , Jemin George , Jiahu Qin , Xinlei Yi , Junfeng Wu

We propose an online learning algorithm for a class of machine learning models under a separable stochastic approximation framework. The essence of our idea lies in the observation that certain parameters in the models are easier to…

Machine Learning · Computer Science 2023-05-23 Min Gan , Xiang-xiang Su , Guang-yong Chen , Jing Chen

In this work we develop a novel algorithm, termed as mixed least-squares deep neural network (MLS-DNN), to recover an anisotropic conductivity tensor from the internal measurements of the solutions. It is based on applying the least-squares…

Numerical Analysis · Mathematics 2024-12-03 Siyu Cen , Bangti Jin , Xiyao Li , Zhi Zhou

Robust object skeleton detection requires to explore rich representative visual features and effective feature fusion strategies. In this paper, we first re-visit the implementation of HED, the essential principle of which can be ideally…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Chang Liu , Wei Ke , Fei Qin , Qixiang Ye

We address the approximation of entropy solutions to initial-boundary value problems for nonlinear strictly hyperbolic conservation laws using neural networks. A general and systematic framework is introduced for the design of efficient and…

Analysis of PDEs · Mathematics 2025-09-16 Igor Ciril , Khalil Haddaoui , Yohann Tendero

In this paper, we study the least-squares finite element methods (LSFEM) for the linear hyperbolic transport equations. The linear transport equation naturally allows discontinuous solutions and discontinuous inflow conditions, while the…

Numerical Analysis · Mathematics 2019-07-12 Qunjie Liu , Shun Zhang

A feedforward neural network, including hidden layers, motivated by nonlinear functions (such as Tanh, ReLU, and Sigmoid functions), exhibits uniform approximation properties in Sobolev space, and discontinuous neural networks can reduce…

Numerical Analysis · Mathematics 2025-05-16 Xiaoyu Wang , Long Yuan , Yao Yu

We introduce new adaptive schemes for the one- and two-dimensional hyperbolic systems of conservation laws. Our schemes are based on an adaption strategy recently introduced in [{\sc S. Chu, A. Kurganov, and I. Menshov}, Appl. Numer. Math.,…

Numerical Analysis · Mathematics 2026-04-10 Shaoshuai Chu , Pingyao Feng , Vadim A. Kolotilov , Alexander Kurganov , Vladimir V. Ostapenko

Randomized neural networks (RNN) are a variation of neural networks in which the hidden-layer parameters are fixed to randomly assigned values and the output-layer parameters are obtained by solving a linear system by least squares. This…

Numerical Analysis · Mathematics 2022-06-14 Jingbo Sun , Suchuan Dong , Fei Wang

We present a novel layerwise optimization algorithm for the learning objective of Piecewise-Linear Convolutional Neural Networks (PL-CNNs), a large class of convolutional neural networks. Specifically, PL-CNNs employ piecewise linear…

Machine Learning · Computer Science 2017-03-07 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

We present a second-order accurate numerical method for a class of nonlocal nonlinear conservation laws called the "nonlocal pair-interaction model" which was recently introduced by Du, Huang, and LeFloch. Our numerical method uses…

Numerical Analysis · Mathematics 2021-05-14 Ulrik Skre Fjordholm , Adrian Montgomery Ruf

We present a non-conforming least squares method for approximating solutions of second order elliptic problems with discontinuous coefficients. The method is based on a general Saddle Point Least Squares (SPLS) method introduced in previous…

Numerical Analysis · Mathematics 2019-04-01 Constantin Bacuta , Jacob Jacavage

This paper investigates the Sensor Network Localization (SNL) problem, which seeks to determine sensor locations based on known anchor locations and partially given anchors-sensors and sensors-sensors distances. Two primary methods for…

Optimization and Control · Mathematics 2023-08-09 Mingyu Lei , Jiayu Zhang , Yinyu Ye

Data remap between non-matching meshes is a critical step in multiphysics coupling using a partitioned approach. The data fields being transferred often have jumps in function values or derivatives. It is important but very challenging to…

Numerical Analysis · Mathematics 2021-01-26 Yipeng Li , Qiao Chen , Xuebin Wang , Xiangmin Jiao