English
Related papers

Related papers: Solution Methods and Perturbation Analysis for the…

200 papers

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

We address the phase retrieval problem with errors in the sensing vectors. A number of recent methods for phase retrieval are based on least squares (LS) formulations which assume errors in the quadratic measurements. We extend this…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Sidharth Gupta , Ivan Dokmanić

In this paper, we present explicit expressions for the mixed and componentwise condition numbers of the truncated total least squares (TTLS) solution of $A\boldsymbol{x} \approx \boldsymbol{b} $ under the genericity condition, where $A$ is…

Numerical Analysis · Mathematics 2020-04-30 Qing-Le Meng , Huai-An Diao , Zheng-Jian Bai

We propose a Binary Robust Least Squares (BRLS) model that encompasses key robust least squares formulations, such as those involving uncertain binary labels and adversarial noise constrained within a hypercube. We show that the geometric…

Optimization and Control · Mathematics 2025-10-14 Yang Zhou , Xiaojun Chen

Regression analysis is an important instrument to determine the effect of the explanatory variables on response variables. When outliers and bias errors are present, the standard weighted least squares estimator may perform poorly. For this…

Computation · Statistics 2025-02-11 Justo Puerto , Alberto Torrejon

In this paper, the problem of target localization in the presence of outlying sensors is tackled. This problem is important in practice because in many real-world applications the sensors might report irrelevant data unintentionally or…

Optimization and Control · Mathematics 2018-02-15 Alireza Zaeemzadeh , Mohsen Joneidi , Behzad Shahrasbi , Nazanin Rahnavard

The Total Least Squares solution of an overdetermined, approximate linear equation $Ax \approx b$ minimizes a nonlinear function which characterizes the backward error. We show that a globally convergent variant of the Gauss--Newton…

Numerical Analysis · Mathematics 2019-11-01 Dario Fasino , Antonio Fazzi

The total least squares~(TLS) method is widely used in data-fitting. Compared with the least squares fitting method, the TLS fitting takes into account not only observation errors, but also errors from the measurement matrix of the…

Quantum Physics · Physics 2019-06-05 Hefeng Wang , Hua Xiang

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

The reduced-rank method exploits the distortion-variance tradeoff to yield superior solutions for classic problems in statistical signal processing such as parameter estimation and filtering. The central idea is to reduce the variance of…

Information Theory · Computer Science 2019-03-06 K. G. Nagananda , Pramod Khargonekar

A new algorithm for 3D localization in multiplatform radar networks, comprising one transmitter and multiple receivers, is proposed. To take advantage of the monostatic sensor radiation pattern features, ad-hoc constraints are imposed in…

Signal Processing · Electrical Eng. & Systems 2022-04-06 Augusto Aubry , Paolo Braca , Antonio De Maio , Angela Marino

In this paper, we apply randomized algorithms to approximate the total least squares (TLS) solution of the problem $Ax\approx b$ in the large-scale discrete ill-posed problems. A regularization technique, based on the multiplicative…

Numerical Analysis · Mathematics 2018-08-09 Liping Zhang , Yimin Wei

Iteratively reweighted least square (IRLS) is a popular approach to solve sparsity-enforcing regression problems in machine learning. State of the art approaches are more efficient but typically rely on specific coordinate pruning schemes.…

Machine Learning · Statistics 2022-10-03 Clarice Poon , Gabriel Peyré

We consider the problem of efficiently solving large-scale linear least squares problems that have one or more linear constraints that must be satisfied exactly. Whilst some classical approaches are theoretically well founded, they can face…

Numerical Analysis · Mathematics 2021-12-24 Jennifer Scott , Miroslav Tuma

Least squares approximation is a technique to find an approximate solution to a system of linear equations that has no exact solution. In a typical setting, one lets $n$ be the number of constraints and $d$ be the number of variables, with…

Data Structures and Algorithms · Computer Science 2010-09-28 Petros Drineas , Michael W. Mahoney , S. Muthukrishnan , Tamas Sarlos

In the total least squares problem, one is given an $m \times n$ matrix $A$, and an $m \times d$ matrix $B$, and one seeks to "correct" both $A$ and $B$, obtaining matrices $\hat{A}$ and $\hat{B}$, so that there exists an $X$ satisfying the…

Data Structures and Algorithms · Computer Science 2019-09-30 Huaian Diao , Zhao Song , David P. Woodruff , Xin Yang

The problem of biclustering consists of the simultaneous clustering of rows and columns of a matrix such that each of the submatrices induced by a pair of row and column clusters is as uniform as possible. In this paper we approximate the…

Data Structures and Algorithms · Computer Science 2008-08-22 Kai Puolamäki , Sami Hanhijärvi , Gemma C. Garriga

This paper investigates the optimality analysis of the recursive least-squares (RLS) algorithm for autoregressive systems with exogenous inputs (ARX systems). A key challenge in analyzing is managing the potential unboundedness of the…

Optimization and Control · Mathematics 2025-05-27 Xingrui Liu , Jieming Ke , Yanlong Zhao

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

We study the total least squares (TLS) problem that generalizes least squares regression by allowing measurement errors in both dependent and independent variables. TLS is widely used in applied fields including computer vision, system…

Machine Learning · Statistics 2014-07-01 Dmitry Malioutov , Nikolai Slavov