English
Related papers

Related papers: Tsnnls: A solver for large sparse least squares pr…

200 papers

The problem of finding sparse solutions to underdetermined systems of linear equations arises in several applications (e.g. signal and image processing, compressive sensing, statistical inference). A standard tool for dealing with sparse…

Optimization and Control · Mathematics 2016-08-03 Marianna De Santis , Stefano Lucidi , Francesco Rinaldi

Gr{\"o}bner bases is one the most powerful tools in algorithmic non-linear algebra. Their computation is an intrinsically hard problem with a complexity at least single exponential in the number of variables. However, in most of the cases,…

Symbolic Computation · Computer Science 2019-02-04 Matías Bender , Jean-Charles Faugère , Elias Tsigaridas

Many computer vision applications require robust and efficient estimation of camera geometry from a minimal number of input data measurements, i.e., solving minimal problems in a RANSAC framework. Minimal problems are usually formulated as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Snehal Bhayani , Janne Heikkilä , Zuzana Kukelova

Many applications of generalised linear models (GLMs) can be improved by applying constraints that impose assumptions on the associations or improve consistency of the estimators. Yet, there are still barriers to the implementation and…

Methodology · Statistics 2026-02-19 Pierre Masselot , Devon Nenon , Jacopo Vanoli , Zaid Chalabi , Antonio Gasparrini

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

Methodology · Statistics 2025-10-31 Zhiqiang Liao , Zhaonan Qu

The Lanczos algorithm has proven itself to be a valuable matrix eigensolver for problems with large dimensions, up to hundreds of millions or even tens of billions. The computational cost of using any Lanczos algorithm is dominated by the…

Computational Physics · Physics 2023-08-09 Ryan M. Zbikowski , Calvin W. Johnson

We describe a parallel iterative least squares solver named \texttt{LSRN} that is based on random normal projection. \texttt{LSRN} computes the min-length solution to $\min_{x \in \mathbb{R}^n} \|A x - b\|_2$, where $A \in \mathbb{R}^{m…

Data Structures and Algorithms · Computer Science 2012-02-21 Xiangrui Meng , Michael A. Saunders , Michael W. Mahoney

Sparse and convolutional constraints form a natural prior for many optimization problems that arise from physical processes. Detecting motifs in speech and musical passages, super-resolving images, compressing videos, and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2014-06-11 Hilton Bristow , Simon Lucey

Iterative sketching and sketch-and-precondition are randomized algorithms used for solving overdetermined linear least-squares problems. When implemented in exact arithmetic, these algorithms produce high-accuracy solutions to least-squares…

Numerical Analysis · Mathematics 2024-04-15 Ethan N. Epperly

Sparse inverse covariance selection is a fundamental problem for analyzing dependencies in high dimensional data. However, such a problem is difficult to solve since it is NP-hard. Existing solutions are primarily based on convex…

Numerical Analysis · Computer Science 2018-04-05 Ganzhao Yuan , Haoxian Tan , Wei-Shi Zheng

We present iterative solvers to approximate the solution of numerical schemes for stochastic Stefan problems. After briefly talking about the convergence results, we tackle the question of efficient strategies for solving the nonlinear…

Numerical Analysis · Mathematics 2025-08-12 Muhammad Awais Khan , Jérôme Droniou , Kim-Ngan Le , Iuliu Sorin Pop

We analyze an Iteratively Re-weighted Least Squares (IRLS) algorithm for promoting l1-minimization in sparse and compressible vector recovery. We prove its convergence and we estimate its local rate. We show how the algorithm can be…

Numerical Analysis · Mathematics 2008-07-04 Ingrid Daubechies , Ronald DeVore , Massimo Fornasier , C. Sinan Gunturk

Logistic regression, the Support Vector Machine (SVM), and least squares are well-studied methods in the statistical and computer science community, with various practical applications. High-dimensional data arriving on a real-time basis…

Machine Learning · Computer Science 2024-11-07 Debbie Lim , Yixian Qiu , Patrick Rebentrost , Qisheng Wang

The sparse inverse covariance estimation problem is commonly solved using an $\ell_{1}$-regularized Gaussian maximum likelihood estimator known as "graphical lasso", but its computational cost becomes prohibitive for large data sets. A…

Machine Learning · Statistics 2018-06-08 Richard Y. Zhang , Salar Fattahi , Somayeh Sojoudi

This paper begins with a class of convex quadratic programs (QPs) with bounded variables solvable by the parametric principal pivoting algorithm with $\mathcal{O}(n^3)$ strongly polynomial complexity, where $n$ is the number of variables of…

Optimization and Control · Mathematics 2022-09-28 Jong-Shi Pang , Shaoning Han

This paper presents a new Matlab toolbox, aimed at facilitating the use of polynomial optimization for stability analysis of nonlinear systems. In the past decade several decisive contributions made it possible to recast this type of…

Optimization and Control · Mathematics 2024-04-03 Stéphane Drobot , Matteo Tacchi , Carmen Cardozo , Colin N. Jones

This paper presents PIQP, a high-performance toolkit for solving generic sparse quadratic programs (QP). Combining an infeasible Interior Point Method (IPM) with the Proximal Method of Multipliers (PMM), the algorithm can handle…

Optimization and Control · Mathematics 2023-09-18 Roland Schwan , Yuning Jiang , Daniel Kuhn , Colin N. Jones

We give a new theoretical tool to solve sparse systems with finitely many solutions. It is based on toric varieties and basic linear algebra; eigenvalues, eigenvectors and coefficient matrices. We adapt Eigenvalue theorem and Eigenvector…

Algebraic Geometry · Mathematics 2015-08-07 César Massri

We present FastLSQ, a framework for PDE solving and inverse problems built on trigonometric random Fourier features with exact analytical derivatives. Trigonometric features admit closed-form derivatives of any order in $\mathcal{O}(1)$,…

Numerical Analysis · Mathematics 2026-03-24 Antonin Sulc