English
Related papers

Related papers: Mixed precision iterative refinement for least squ…

200 papers

We provide a randomized linear time approximation scheme for a generic problem about clustering of binary vectors subject to additional constrains. The new constrained clustering problem encompasses a number of problems and by solving it,…

Data Structures and Algorithms · Computer Science 2018-07-20 Fedor V. Fomin , Petr A. Golovach , Daniel Lokshtanov , Fahad Panolan , Saket Saurabh

The convergence of an adaptive mixed finite element method for general second order linear elliptic problems defined on simply connected bounded polygonal domains is analyzed in this paper. The main difficulties in the analysis are posed by…

Numerical Analysis · Mathematics 2014-02-14 Asha K. Dond , Neela Nataraj , Amiya K. Pani

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

The least trimmed squares (LTS) is a reasonable formulation of robust regression whereas it suffers from high computational cost due to the nonconvexity and nonsmoothness of its objective function. The most frequently used FAST-LTS…

Computation · Statistics 2024-10-08 Shotaro Yagishita

In this paper we describe in detail the computational algorithm used by our parallel multigrid elliptic equation solver with adaptive mesh refinement. Our code uses truncation error estimates to adaptively refine the grid as part of the…

General Relativity and Quantum Cosmology · Physics 2009-11-10 J. David Brown , Lisa L. Lowe

We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption,…

Machine Learning · Computer Science 2020-06-26 Bhaskar Mukhoty , Govind Gopakumar , Prateek Jain , Purushottam Kar

The Minimum Spanning Tree with Conflicting Edge Pairs is a generalization that adds conflict constraints to a classical optimization problem on graphs used to model several real-world applications. In the last few years several approaches,…

Optimization and Control · Mathematics 2025-04-22 Roberto Montemanni , Derek H. Smith

We introduce fast algorithms for solving $\ell_{p}$ regression problems using the iteratively reweighted least squares (IRLS) method. Our approach achieves state-of-the-art iteration complexity, outperforming the IRLS algorithm by…

Data Structures and Algorithms · Computer Science 2025-10-03 Alina Ene , Ta Duy Nguyen , Adrian Vladu

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

For a linear complementarity problem, we present a relaxaiton accelerated two-sweep matrix splitting iteration method. The convergence analysis illustrates that the proposed method converges to the exact solution of the linear…

Optimization and Control · Mathematics 2020-12-02 Dongkai Li , Li Wang , Yuying Liu

In this work, we propose a novel discrete-time distributed algorithm for finding least-squares solutions of linear algebraic equations with a scheduling protocol to further enhance its scalability. Each agent in the network is assumed to…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Shenyu Liu

We consider the problem of mixed linear regression (MLR), where each observed sample belongs to one of $K$ unknown linear models. In practical applications, the proportions of the $K$ components are often imbalanced. Unfortunately, most MLR…

Machine Learning · Statistics 2023-01-31 Pini Zilber , Boaz Nadler

In this work, we study the problem of finding approximate, with minimum support set, solutions to matrix max-plus equations, which we call sparse approximate solutions. We show how one can obtain such solutions efficiently and in polynomial…

Optimization and Control · Mathematics 2020-12-22 Nikos Tsilivis , Anastasios Tsiamis , Petros Maragos

This paper proposes a novel Hessian approximation for Maximum a Posteriori estimation problems in robotics involving Gaussian mixture likelihoods. Previous approaches manipulate the Gaussian mixture likelihood into a form that allows the…

Robotics · Computer Science 2024-08-28 Vassili Korotkine , Mitchell Cohen , James Richard Forbes

Given a full column rank matrix $A \in \mathbb{R}^{m\times n}$ ($m\geq n$), we consider a special class of linear systems of the form $A^\top Ax=A^\top b+c$ with $x, c \in \mathbb{R}^{n}$ and $b \in \mathbb{R}^{m}$. The occurrence of $c$ in…

Numerical Analysis · Mathematics 2019-11-04 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

There are many practical applications based on the Least Square Error (LSE) approximation. It is based on a square error minimization 'on a vertical' axis. The LSE method is simple and easy also for analytical purposes. However, if data…

Graphics · Computer Science 2018-02-22 Vaclav Skala

Augmentation methods for mixed-integer (linear) programs are a class of primal solution approaches in which a current iterate is augmented to a better solution or proved optimal. It is well known that the performance of these methods, i.e.,…

Optimization and Control · Mathematics 2015-10-20 Pierre Le Bodic , Jeffrey W. Pavelka , Marc E. Pfetsch , Sebastian Pokutta

Mixed-integer linear programs (MILPs) are extensively used to model practical problems such as planning and scheduling. A prominent method for solving MILPs is large neighborhood search (LNS), which iteratively seeks improved solutions…

Optimization and Control · Mathematics 2024-12-12 Wenbo Liu , Akang Wang , Wenguo Yang , Qingjiang Shi

For the constrained LiGME model, a nonconvexly regularized least squares estimation model, we present an iterative algorithm of guaranteed convergence to its globally optimal solution. The proposed algorithm can deal with two different…

Optimization and Control · Mathematics 2024-04-05 Wataru Yata , Isao Yamada

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh