English
Related papers

Related papers: Solving large linear least squares problems with l…

200 papers

The problem of polynomial least squares fitting in the standard Lagrange basis is addressed in this work. Although the matrices involved in the corresponding overdetermined linear systems are not totally positive, rectangular totally…

Numerical Analysis · Mathematics 2023-09-25 Ana Marco , José-Javier Martínez , Raquel Viaña

Many applications of generalised linear models (GLMs) can be improved by applying constraints that impose assumptions on the associations or improve consistency of the estimators. Yet, there are still barriers to the implementation and…

Methodology · Statistics 2026-02-19 Pierre Masselot , Devon Nenon , Jacopo Vanoli , Zaid Chalabi , Antonio Gasparrini

We propose an iterative algorithm for low-rank matrix completion that can be interpreted as an iteratively reweighted least squares (IRLS) algorithm, a saddle-escaping smoothing Newton method or a variable metric proximal gradient method…

Optimization and Control · Mathematics 2021-06-07 Christian Kümmerle , Claudio Mayrink Verdun

Many problems in nonlinear analysis and optimization, among them variational inequalities and minimization of convex functions, can be reduced to finding zeros (namely, roots) of set-valued operators. Hence numerous algorithms have been…

Optimization and Control · Mathematics 2018-10-23 Daniel Reem , Simeon Reich

We study a class of combinatorial scheduling problems characterized by a particular type of constraint often associated with electrical power or gas energy. This constraint appears in several practical applications and is expressed as a sum…

Data Structures and Algorithms · Computer Science 2023-12-27 Trung Thanh Nguyen , Khaled Elbassioni , Areg Karapetyan , Majid Khonji

Solution and analysis of mathematical programming problems may be simplified when these problems are symmetric under appropriate linear transformations. In particular, a knowledge of the symmetries may help reduce the problem dimension, cut…

Optimization and Control · Mathematics 2020-10-13 A. V. Eremeev , A. S. Yurkov

In this paper, we focus on nonlinear infinite-norm minimization problems that have many applications, especially in computer science and operations research. We set a reliable Lagrangian dual aproach for solving this kind of problems in…

Computational Complexity · Computer Science 2011-06-07 Wajeb Gharibi , Yong Xia

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

Detectability of failures of linear programming (LP) decoding and its potential for improvement by adding new constraints motivate the use of an adaptive approach in selecting the constraints for the LP problem. In this paper, we make a…

Information Theory · Computer Science 2007-07-13 Mohammad H. Taghavi N. , Paul H. Siegel

We present an algorithm based on continuation techniques that can be applied to solve numerically minimization problems with equality constraints. We focus on problems with a great number of local minima which are hard to obtain by local…

Numerical Analysis · Mathematics 2019-09-17 Elisabete Alberdi , Mikel Antoñana , Joseba Makazaga , Ander Murua

We introduce a generic framework for solving linear programs (LPs) with many constraints $(n \gg d)$ via adaptive sparsification. Our approach provides a principled generalization of the techniques of [Assadi '23] from matching problems to…

Quantum Physics · Physics 2025-10-10 Étienne Objois , Adrian Vladu

Quadratic Unconstrained Binary Optimization models are useful for solving a diverse range of optimization problems. Constraints can be added by incorporating quadratic penalty terms into the objective, often with the introduction of slack…

Optimization and Control · Mathematics 2021-05-18 Amit Verma , Mark Lewis

This paper presents a generalization of the "weighted least-squares" (WLS), named "weighted pairing least-squares" (WPLS), which uses a rectangular weight matrix and is suitable for data alignment problems. Two fast solving methods,…

Mathematical Software · Computer Science 2009-05-29 Pierre Courrieu

We consider the constrained Linear Inverse Problem (LIP), where a certain atomic norm (like the $\ell_1 $ norm) is minimized subject to a quadratic constraint. Typically, such cost functions are non-differentiable, which makes them not…

Optimization and Control · Mathematics 2025-07-08 Mohammed Rayyan Sheriff , Floor Fenne Redel , Peyman Mohajerin Esfahani

This survey describes a class of methods known as "fast direct solvers". These algorithms address the problem of solving a system of linear equations $\boldsymbol{Ax}=\boldsymbol{b}$ arising from the discretization of either an elliptic PDE…

Numerical Analysis · Mathematics 2025-11-12 Per-Gunnar Martinsson , Michael O'Neil

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

Machine Learning · Computer Science 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

We consider algorithmic approaches to the D-optimality problem for cases where the input design matrix is large and highly structured, in particular implicitly specified as a full quadratic or linear response-surface model in several levels…

Optimization and Control · Mathematics 2023-09-11 Gabriel Ponte , Marcia Fampa , Jon Lee

In this paper, a class of optimization problems with nonlinear inequality constraints is discussed. Based on the ideas of sequential quadratic programming algorithm and the method of strongly sub-feasible directions, a new superlinearly…

Optimization and Control · Mathematics 2012-06-28 Jin-Bao Jian , Chuan-Hao Guo , Chun-Ming Tang , Yan-Qin Bai

Differentiable systems in this paper means systems of equations that are described by differentiable real functions in real matrix variables. This paper proposes algorithms for finding minimal rank solutions to such systems over (arbitrary…

Optimization and Control · Mathematics 2017-05-30 Thanh Hieu Le

Linear constraints are the linear counterpart of Haskell's class constraints. Linearly typed parameters allow the programmer to control resources such as file handles and manually managed memory as linear arguments. Indeed, a linear type…

Programming Languages · Computer Science 2026-04-24 Arnaud Spiwack , Csongor Kiss , Jean-Philippe Bernardy , Nicolas Wu , Richard A. Eisenberg