English
Related papers

Related papers: A Least-Squares-Based Neural Network (LS-Net) for …

200 papers

In this paper, a physics-informed multiresolution wavelet neural network (PIMWNN) method is proposed for solving partial differential equations (PDEs). This method uses the multiresolution wavelet neural network (MWNN) to approximate…

Numerical Analysis · Mathematics 2025-08-12 Feng Han , Jianguo Wang , Guoliang Peng , Xueting Shi

Deep neural networks have proved very successful on archetypal tasks for which large training sets are available, but when the training data are scarce, their performance suffers from overfitting. Many existing methods of reducing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Wei Zhu , Qiang Qiu , Jiaji Huang , Robert Calderbank , Guillermo Sapiro , Ingrid Daubechies

The a posteriori error estimator using the least-squares functional can be used for adaptive mesh refinement and error control even if the numerical approximations are not obtained from the corresponding least-squares method. This suggests…

Numerical Analysis · Mathematics 2024-07-19 Ziyan Li , Shun Zhang

The closest point method (Ruuth and Merriman, J. Comput. Phys. 227(3):1943-1961, [2008]) is an embedding method developed to solve a variety of partial differential equations (PDEs) on smooth surfaces, using a closest point representation…

Numerical Analysis · Mathematics 2024-12-20 A. Petras , L. Ling , C. Piret , S. J. Ruuth

We consider the least-squares finite element method (lsfem) for systems of nonlinear ordinary differential equations and establish an optimal error estimate for this method when piecewise linear elements are used. The main assumptions are…

Numerical Analysis · Mathematics 2021-10-01 Matthias Chung , Justin Krueger , Honghu Liu

We develop theoretical results that establish a connection across various regression methods such as the non-negative least squares, bounded variable least squares, simplex constrained least squares, and lasso. In particular, we show in…

Computation · Statistics 2024-10-29 James Yang , Trevor Hastie

Solving partial differential equations (PDEs) has been indispensable in scientific and engineering applications. Recently, deep learning methods have been widely used to solve high-dimensional problems, one of which is the physics-informed…

Numerical Analysis · Mathematics 2025-04-16 Qing Li , Jingrun Chen

There are many practical applications based on the Least Square Error (LSE) approximation. It is based on a square error minimization 'on a vertical' axis. The LSE method is simple and easy also for analytical purposes. However, if data…

Graphics · Computer Science 2018-02-22 Vaclav Skala

We study the problem of finding the best linear model that can minimize least-squares loss given a data-set. While this problem is trivial in the low dimensional regime, it becomes more interesting in high dimensions where the population…

Machine Learning · Computer Science 2021-02-09 Yahya Sattar , Samet Oymak

We present a novel method for using Neural Networks (NNs) for finding solutions to a class of Partial Differential Equations (PDEs). Our method builds on recent advances in Neural Radiance Field research (NeRFs) and allows for a NN to…

Machine Learning · Computer Science 2022-05-31 Jaroslaw Rzepecki , Daniel Bates , Chris Doran

Solving large-scale Partial Differential Equations (PDEs) on complex three-dimensional geometries represents a central challenge in scientific and engineering computing, often impeded by expensive pre-processing stages and substantial…

Computational Engineering, Finance, and Science · Computer Science 2025-10-21 Peijian Zeng , Guan Wang , Haohao Gu , Xiaoguang Hu , Tiezhu Gao , Zhuowei Wang , Aimin Yang , Xiaoyu Song

The present work deals with the rational model order reduction method based on the single-point Least-Square (LS) Pad\'e approximation technique introduced in [3]. Algorithmical aspects concerning the construction of the rational LS-Pad\'e…

Numerical Analysis · Mathematics 2018-06-08 Francesca Bonizzoni , Fabio Nobile , Ilaria Perugia , Davide Pradovera

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

In this work, we study the problem of non-blind image deconvolution and propose a novel recurrent network architecture that leads to very competitive restoration results of high image quality. Motivated by the computational efficiency and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Iaroslav Koshelev , Daniil Selikhanovych , Stamatios Lefkimmiatis

Surface partial differential equations arise in numerous scientific and engineering applications. Their numerical solution on static and evolving surfaces remains challenging due to geometric complexity and, for evolving geometries, the…

Numerical Analysis · Mathematics 2026-03-03 Jingbo Sun , Fei Wang

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be tackled by solving a linear least-square problem, which can be done by finding the eigenvector…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Zheng Dang , Kwang Moo Yi , Yinlin Hu , Fei Wang , Pascal Fua , Mathieu Salzmann

We propose a framework for solving nonlinear partial differential equations (PDEs) by combining perturbation theory with one-shot transfer learning in Physics-Informed Neural Networks (PINNs). Nonlinear PDEs with polynomial terms are…

Numerical Analysis · Mathematics 2025-11-17 Samuel Auroy , Pavlos Protopapas

Partial Least Squares (PLS) is a widely used method for data integration, designed to extract latent components shared across paired high-dimensional datasets. Despite decades of practical success, a precise theoretical understanding of its…

Machine Learning · Statistics 2025-12-18 Victor Léger , Florent Chatelain

The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each…

Machine Learning · Statistics 2024-06-06 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

The method of ``Total Least Squares'' is proposed as a more natural way (than ordinary least squares) to approximate the data if both the matrix and and the right-hand side are contaminated by ``errors''. In this tutorial note, we give a…

Rings and Algebras · Mathematics 2025-10-20 P. P. N. de Groen