English
Related papers

Related papers: 2-norm error bounds and estimates for Lanczos appr…

200 papers

The generalized Lanczos trust-region (GLTR) method is one of the most popular approaches for solving large-scale trust-region subproblem (TRS). Recently, Jia and Wang [Z. Jia and F. Wang, \emph{SIAM J. Optim., 31 (2021), pp. 887--914}]…

Numerical Analysis · Mathematics 2023-06-27 Bo Feng , Gang Wu

There has been much recent interest in finding unconstrained local minima of smooth functions, due in part of the prevalence of such problems in machine learning and robust statistics. A particular focus is algorithms with good complexity…

Optimization and Control · Mathematics 2017-12-12 Clément W. Royer , Stephen J. Wright

We consider linear ill-conditioned operator equations in a Hilbert space setting. Motivated by the aggregation method, we consider approximate solutions constructed from linear combinations of Tikhonov regularization, which amounts to…

Numerical Analysis · Mathematics 2023-06-07 Stefan Kindermann , Werner Zellinger

LSQR, a Lanczos bidiagonalization based Krylov subspace iterative method, and its mathematically equivalent CGLS applied to normal equations system, are commonly used for large-scale discrete ill-posed problems. It is well known that LSQR…

Numerical Analysis · Mathematics 2019-09-24 Yi Huang , Zhongxiao Jia

We propose and study a class of novel algorithms that aim at solving bilinear and quadratic inverse problems. Using a convex relaxation based on tensorial lifting, and applying first-order proximal algorithms, these problems could be solved…

Optimization and Control · Mathematics 2021-03-19 Robert Beinert , Kristian Bredies

Reynolds' lubrication approximation is used extensively to study flows between moving machine parts, in narrow channels, and in thin films. The solution of Reynolds' equation may be thought of as the zeroth order term in an expansion of the…

Analysis of PDEs · Mathematics 2010-06-11 Jon Wilkening

In this paper we compare two methods for finding extremal eigenvalues and eigenvectors: the restarted Lanczos method and momentum accelerated power iterations. The convergence of both methods is based on ratios of Chebyshev polynomials…

Numerical Analysis · Mathematics 2026-03-03 Alessandro Barletta , Nicholas Marshall , Sara Pollock

In this paper we develop algorithms for approximating matrix multiplication with respect to the spectral norm. Let A\in{\RR^{n\times m}} and B\in\RR^{n \times p} be two matrices and \eps>0. We approximate the product A^\top B using two…

Data Structures and Algorithms · Computer Science 2010-10-28 Avner Magen , Anastasios Zouzias

In this paper we propose and analyze an algorithm for identifying spectral gaps of a real symmetric matrix $A$ by simultaneously approximating the traces of spectral projectors associated with multiple different spectral slices. Our method…

Numerical Analysis · Mathematics 2025-09-09 Michele Benzi , Michele Rinelli , Igor Simunec

In practical conjugate gradient (CG) computations it is important to monitor the quality of the approximate solution to $Ax=b$ so that the CG algorithm can be stopped when the required accuracy is reached. The relevant convergence…

Numerical Analysis · Mathematics 2018-10-05 Gérard Meurant , Petr Tichý

The goal of this work is to fill a gap in [Yang, SIAM J. Matrix Anal. Appl, 41 (2020), 1797--1825]. In that work, an approximation procedure was proposed for orthogonal low-rank tensor approximation; however, the approximation lower bound…

Optimization and Control · Mathematics 2021-01-01 Yuning Yang

Building on a previously introduced block Lanczos method, we demonstrate how to approximate any operator function of the form Trf (A) when the argument A is given as a Hermitian matrix product operator. This gives access to quantities that,…

Quantum Physics · Physics 2018-08-22 Moritz August , Mari Carmen Banuls

We consider the approximation of $B^T (A+sI)^{-1} B$ for large s.p.d. $A\in\mathbb{R}^{n\times n}$ with dense spectrum and $B\in\mathbb{R}^{n\times p}$, $p\ll n$. We target the computations of Multiple-Input Multiple-Output (MIMO) transfer…

Numerical Analysis · Mathematics 2025-04-18 Vladimir Druskin , Jörn Zimmerling

The randomized Arnoldi process has been used in large-scale scientific computing because it produces a well-conditioned basis for the Krylov subspace more quickly than the standard Arnoldi process. However, the resulting Hessenberg matrix…

Numerical Analysis · Mathematics 2026-01-16 Laura Grigori , Daniel Kressner , Nian Shao , Igor Simunec

This paper presents two new techniques relating to inexact solution of subproblems in augmented Lagrangian methods for convex programming. The first involves combining a relative error criterion for solution of the subproblems with over- or…

Optimization and Control · Mathematics 2025-09-17 Jonathan Eckstein , Chang Yu

We introduce a proximal version of the stochastic dual coordinate ascent method and show how to accelerate the method using an inner-outer iteration procedure. We analyze the runtime of the framework and obtain rates that improve…

Machine Learning · Statistics 2013-10-09 Shai Shalev-Shwartz , Tong Zhang

We present randUBV, a randomized algorithm for matrix sketching based on the block Lanzcos bidiagonalization process. Given a matrix $\bf{A}$, it produces a low-rank approximation of the form ${\bf UBV}^T$, where $\bf{U}$ and $\bf{V}$ have…

Numerical Analysis · Mathematics 2021-02-09 Eric Hallman

We consider iterative methods for solving linear ill-posed problems with compact operator and right-hand side only available via noise-polluted measurements. Conjugate gradients (CG) applied to the normal equations with an appropriate…

Numerical Analysis · Mathematics 2026-02-19 Daniel Gerth , Kirk M. Soodhalter

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

The method of quantum Lanczos recursion is extended to solve for multiple excitations on the quantum computer. While quantum Lanczos recursion is in principle capable of obtaining excitations, the extension to a block Lanczos routine can…

Quantum Physics · Physics 2021-09-30 Thomas E. Baker