English
Related papers

Related papers: Approximate Least Squares

200 papers

In this work we present a new simple but efficient scheme - Subsquares approach - for development of algorithms for enclosing the solution set of overdetermined interval linear systems. We are going to show two algorithms based on this…

Numerical Analysis · Computer Science 2013-05-07 Jaroslav Horáček , Milan Hladík

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

A nonlinear sea-ice problem is considered in a least-squares finite element setting. The corresponding variational formulation approximating simultaneously the stress tensor and the velocity is analysed. In particular, the least-squares…

Numerical Analysis · Mathematics 2023-05-22 Fleurianne Bertrand , Henrik Schneider

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

Gaussian mixtures are a powerful and widely used tool to model non-Gaussian estimation problems. They are able to describe measurement errors that follow arbitrary distributions and can represent ambiguity in assignment tasks like point set…

Robotics · Computer Science 2021-04-02 Tim Pfeifer , Sven Lange , Peter Protzel

Real-time identification of electrical equivalent circuit models is a critical requirement in many practical systems, such as batteries and electric motors. Significant work has been done in the past developing different types of algorithms…

Systems and Control · Electrical Eng. & Systems 2021-01-15 Balakumar Balasingam , Krishna Pattipati

We propose a new least squares finite element method to solve the Poisson equation. By using a piecewisely irrotational space to approximate the flux, we split the classical method into two sequential steps. The first step gives the…

Numerical Analysis · Mathematics 2024-12-20 Ruo Li , Fanyi Yang

The aim of this paper is to provide a new estimator of parameters for LARCH$(\infty)$ processes, and thus also for LARCH$(p)$ or GLARCH$(p,q)$ processes. This estimator results from minimising a contrast leading to a least squares estimator…

Statistics Theory · Mathematics 2023-03-27 Jean-Marc Bardet

Iterative refinement (IR) is a popular scheme for solving a linear system of equations based on gradually improving the accuracy of an initial approximation. Originally developed to improve upon the accuracy of Gaussian elimination,…

Numerical Analysis · Mathematics 2025-06-24 Chai Wah Wu , Mark S. Squillante , Vasileios Kalantzis , Lior Horesh

We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We prove an oracle…

Machine Learning · Computer Science 2019-02-05 Max Simchowitz , Ross Boczar , Benjamin Recht

We describe a generalised method for ellipsoid fitting against a minimum set of data points. The proposed method is numerically stable and applies to a wide range of ellipsoidal shapes, including highly elongated and arbitrarily oriented…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Amit Reza , Anand S. Sengupta

We present an $O(mn)$ direct least-squares solver for $m \times n$ linear systems with a scaled partial isometry. The proposed algorithm is also useful when the system is block diagonal and each block is a scaled partial isometry with…

Numerical Analysis · Mathematics 2025-07-03 Suvendu Kar , Murugesan Venkatapathi

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

Machine Learning · Statistics 2016-08-01 Abolfazl Hashemi , Haris Vikalo

In this paper we combine two existing approaches for approximating attractors. One of them approximates the attractors arbitrarily well by sublevel sets related to solutions of infinite dimensional linear programming problems. A downside…

Optimization and Control · Mathematics 2023-10-06 Corbinian Schlosser

We present a complete algorithm for finding an exact minimal polynomial from its approximate value by using an improved parameterized integer relation construction method. Our result is superior to the existence of error controlling on…

Symbolic Computation · Computer Science 2010-01-06 Xiaolin Qin , Yong Feng , Jingwei Chen , Jingzhong Zhang

In this paper, we propose a sparse least squares (SLS) optimization model for solving multilinear equations, in which the sparsity constraint on the solutions can effectively reduce storage and computation costs. By employing variational…

Optimization and Control · Mathematics 2023-10-10 Xin Li , Ziyan Luo , Yang Chen

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably…

Methodology · Statistics 2010-12-24 Yilun Chen , Yuantao Gu , Alfred O. Hero

An extension of the Gauss-Newton algorithm is proposed to find local minimizers of penalized nonlinear least squares problems, under generalized Lipschitz assumptions. Convergence results of local type are obtained, as well as an estimate…

Optimization and Control · Mathematics 2011-03-03 Saverio Salzo , Silvia Villa

The least squares method allows fitting parameters of a mathematical model from experimental data. This article proposes a general approach of this method. After introducing the method and giving a formal definition, the transitivity of the…

Optimization and Control · Mathematics 2015-02-27 Benjamin Lenoir

We present a new, simple and computationally efficient iterative method for low rank matrix completion. Our method is inspired by the class of factorization-type iterative algorithms, but substantially differs from them in the way the…

Optimization and Control · Mathematics 2021-06-30 Jonathan Bauch , Boaz Nadler , Pini Zilber