English
Related papers

Related papers: An Optimal Least-Square Solver For Scaled Partial-…

200 papers

A new algorithm is presented for computing a direct solution to a system of consistent linear equations. It produces a minimum norm particular solution, a generalized inverse (of type {124}), and a null space projection operator. In…

Rings and Algebras · Mathematics 2013-04-30 Michael F. Zimmer

We consider the problem of efficiently solving large-scale linear least squares problems that have one or more linear constraints that must be satisfied exactly. Whilst some classical approaches are theoretically well founded, they can face…

Numerical Analysis · Mathematics 2021-12-24 Jennifer Scott , Miroslav Tuma

In this paper, given a linear system of equations A x = b, we are finding locations in the plane to place objects such that sending waves from the source points and gathering them at the receiving points solves that linear system of…

Numerical Analysis · Mathematics 2021-02-16 Kthim Imeri

We present a novel algorithm attaining excessively fast, the sought solution of linear systems of equations. The algorithm is short in its basic formulation and, by definition, vectorized, while the memory allocation demands are trivial,…

Machine Learning · Computer Science 2023-09-26 Nikolaos P. Bakas

We introduce a direct numerical treatment of nonlinear higher-index differential-algebraic equations by means of overdetermined polynomial least-squares collocation. The procedure is not much more computationally expensive than standard…

Numerical Analysis · Mathematics 2019-03-22 Michael Hanke , Roswitha März

This paper is essentially an exercise in studying the minima of a certain least squares optimization using the second partial derivative test. The motivation is to gain insight into an optimization-based solution to the problem of tracking…

Robotics · Computer Science 2016-05-27 Jad Nohra

Nowadays, Non-Linear Least-Squares embodies the foundation of many Robotics and Computer Vision systems. The research community deeply investigated this topic in the last years, and this resulted in the development of several open-source…

In many problems in Computational Physics and Chemistry, one finds a special kind of sparse matrices, termed "banded matrices". These matrices, which are defined as having non-zero entries only within a given distance from the main…

Computational Physics · Physics 2013-06-21 Pablo García-Risueño , Pablo Echenique

In this paper, we prove a new identity for the least-square solution of an over-determined set of linear equation $Ax=b$, where $A$ is an $m\times n$ full-rank matrix, $b$ is a column-vector of dimension $m$, and $m$ (the number of…

Optimization and Control · Mathematics 2015-02-27 Saeid Haghighatshoar , Mohammad J. Taghizadeh , Afsaneh Asaei

Partial least squares regression (PLSR) has been a popular technique to explore the linear relationship between two datasets. However, most of algorithm implementations of PLSR may only achieve a suboptimal solution through an optimization…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Haoran Chen , Yanfeng Sun , Junbin Gao , Yongli Hu , Baocai Yin

We develop spectral methods for ODEs and operator eigenvalue problems that are based on a least-squares formulation of the problem. The key tool is a method for rectangular generalized eigenvalue problems, which we extend to quasimatrices…

Numerical Analysis · Mathematics 2021-09-14 Behnam Hashemi , Yuji Nakatsukasa

This paper designs a distributed least square solution method for a linear algebraic equation over a multiagent network. The coefficient matrix is divided into multiple blocks, and each agent only knows a subset of these blocks. The…

Systems and Control · Electrical Eng. & Systems 2023-12-29 Viet Hoang Pham , Hyo-Sung Ahn

The least square solution of minimum norm of a rectangular linear system of equations can be found out iteratively by using matrix splittings. However, the convergence of such an iteration scheme arising out of a matrix splitting is…

Numerical Analysis · Mathematics 2025-08-07 Chinmay Kumar Giri , Debasisha Mishra

We consider the Minimum Steiner Cut problem on undirected planar graphs with non-negative edge weights. This problem involves finding the minimum cut of the graph that separates a specified subset $X$ of vertices (terminals) into two parts.…

Data Structures and Algorithms · Computer Science 2020-01-01 Stephen Jue , Philip N. Klein

Randomized iterative algorithms have recently been proposed to solve large-scale linear systems. In this paper, we present a simple randomized extended block Kaczmarz algorithm that exponentially converges in the mean square to the unique…

Numerical Analysis · Mathematics 2020-07-09 Kui Du , Wutao Si , Xiaohui Sun

A method for moving least squares interpolation and differentiation is presented in the framework of orthogonal polynomials on discrete points. This yields a robust and efficient method which can avoid singularities and breakdowns in the…

Numerical Analysis · Mathematics 2010-09-21 Michael Carley

In this paper, a Gauss-Seidel method with oblique direction (GSO) is proposed for finding the least-squares solution to a system of linear equations, where the coefficient matrix may be full rank or rank deficient and the system is…

Numerical Analysis · Mathematics 2021-06-02 Fang Wang , Weiguo Li , Wendi Bao , Zhonglu Lv

We introduce a quantum linear system solving algorithm based on the Kaczmarz method, a widely used workhorse for large linear systems and least-squares problems that updates the solution by enforcing one equation at a time. Its simplicity…

Quantum Physics · Physics 2026-01-06 Nhat A. Nghiem , Tuan K. Do , Trung V. Phan

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

Machine Learning · Statistics 2016-08-01 Abolfazl Hashemi , Haris Vikalo

Developing efficient methods for solving parametric partial differential equations is crucial for addressing inverse problems. This work introduces a Least-Squares-based Neural Network (LS-Net) method for solving linear parametric PDEs. It…

Numerical Analysis · Mathematics 2025-02-13 Shima Baharlouei , Jamie M. Taylor , Carlos Uriarte , David Pardo