English
Related papers

Related papers: Fast nonnegative least squares through flexible Kr…

200 papers

This work proposes a space-time least-squares Petrov-Galerkin (ST-LSPG) projection method for model reduction of nonlinear dynamical systems. In contrast to typical nonlinear model-reduction methods that first apply (Petrov-)Galerkin…

Numerical Analysis · Computer Science 2018-11-14 Youngsoo Choi , Kevin Carlberg

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

This paper introduces and analyzes an original class of Krylov subspace methods that provide an efficient alternative to many well-known conjugate-gradient-like (CG-like) Krylov solvers for square nonsymmetric linear systems arising from…

Numerical Analysis · Mathematics 2017-09-13 Silvia Gazzola , Paolo Novati

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on…

Optimization and Control · Mathematics 2022-11-11 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

For many applications involving a sequence of linear systems with slowly changing system matrices, subspace recycling, which exploits relationships among systems and reuses search space information, can achieve huge gains in iterations…

Numerical Analysis · Mathematics 2023-06-28 Misha E. Kilmer , Eric de Sturler

We propose a method to recover the sparse discrete Fourier transform (DFT) of a signal that is both noisy and potentially incomplete, with missing values. The problem is formulated as a penalized least-squares minimization based on the…

Optimization and Control · Mathematics 2025-02-07 Wei Kuang , Alexis Montoison , Vishwas Rao , François Pacaud , Mihai Anitescu

Krylov subspace methods are among the most extensively studied early fault-tolerant quantum algorithms for estimating ground-state energies of quantum systems. However, the rapid onset of ill-conditioning might make accurate energies…

Quantum Physics · Physics 2026-04-14 Maria Gabriela Jordão Oliveira , Karl Michael Ziems , Nina Glaser

For linear inverse problems with a large number of unknown parameters, uncertainty quantification remains a challenging task. In this work, we use Krylov subspace methods to approximate the posterior covariance matrix and describe efficient…

Numerical Analysis · Mathematics 2019-05-22 Arvind K. Saibaba , Julianne Chung , Katrina Petroske

Iterative Krylov projection methods have become widely used for solving large-scale linear inverse problems. However, methods based on orthogonality include the computation of inner-products, which become costly when the number of…

Numerical Analysis · Mathematics 2025-02-06 Malena Sabaté Landman , Ariana N. Brown , Julianne Chung , James G. Nagy

Nonnegative least squares problems with multiple right-hand sides (MNNLS) arise in models that rely on additive linear combinations. In particular, they are at the core of most nonnegative matrix factorization algorithms and have many…

Machine Learning · Computer Science 2023-01-26 Nicolas Nadisic , Jeremy E Cohen , Arnaud Vandaele , Nicolas Gillis

In this paper we present deflation and augmentation techniques that have been designed to accelerate the convergence of Krylov subspace methods for the solution of linear systems of equations. We review numerical approaches both for linear…

Numerical Analysis · Mathematics 2013-03-25 Olivier Coulaud , Luc Giraud , Pierre Ramet , Xavier Vasseur

We propose an alternative implementation of preconditioning techniques for the solution of non-linear problems. Within the framework of Newton-Krylov methods, preconditioning techniques are needed to improve the performance of the solvers.…

Computational Physics · Physics 2008-04-02 G. Lapenta , S. Ju

We present a monolithic geometric multigrid preconditioner for solving fluid-solid interaction problems in Stokes limit. The problems are discretized by a spatially adaptive high-order meshless method, the generalized moving least squares…

Numerical Analysis · Mathematics 2022-09-07 Zisheng Ye , Xiaozhe Hu , Wenxiao Pan

We present a non-conforming least squares method for approximating solutions of second order elliptic problems with discontinuous coefficients. The method is based on a general Saddle Point Least Squares (SPLS) method introduced in previous…

Numerical Analysis · Mathematics 2019-04-01 Constantin Bacuta , Jacob Jacavage

We consider efficient methods for computing solutions to dynamic inverse problems, where both the quantities of interest and the forward operator (measurement process) may change at different time instances but we want to solve for all the…

Numerical Analysis · Mathematics 2021-07-14 Mirjeta Pasha , Arvind K. Saibaba , Silvia Gazzola , Malena I. Espanol , Eric de Sturler

Interior point methods are widely used for different types of mathematical optimization problems. Many implementations of interior point methods in use today rely on direct linear solvers to solve systems of equations in each iteration. The…

Optimization and Control · Mathematics 2024-02-27 Felix Liu , Albin Fredriksson , Stefano Markidis

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

We investigate the regularizing behavior of an iterative Krylov subspace method for the solution of linear inverse problems in precisions lower than double. Recent works have considered the projection of iterated Tikhonov methods using…

Numerical Analysis · Mathematics 2025-12-02 Chelsea Drum , James. G. Nagy , Lucas Onisk

Non-negative least squares (NNLS) problem is one of the most important fundamental problems in numeric analysis. It has been widely used in scientific computation and data modeling. In big data, the limitations of algorithm speed and…

Optimization and Control · Mathematics 2015-07-10 Duy Khuong Nguyen , Tu Bao Ho

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman