English
Related papers

Related papers: Double precision is not necessary for LSQR for sol…

200 papers

Computer simulations serve as powerful tools for scientists and engineers to gain insights into complex systems. Less costly than physical experiments, computer experiments sometimes involve large number of trials. Conventional design…

Methodology · Statistics 2025-06-06 Xu He , Junpeng Gong , Zhaohui Li

A deflated restarted Lanczos algorithm is given for both solving symmetric linear equations and computing eigenvalues and eigenvectors. The restarting limits the storage so that finding eigenvectors is practical. Meanwhile, the deflating…

Mathematical Physics · Physics 2014-08-27 Abdou M. Abdel-Rehim , Ronald B. Morgan , Dywayne A. Nicely , Walter Wilcox

A deflated and restarted Lanczos algorithm to solve hermitian linear systems, and at the same time compute eigenvalues and eigenvectors for application to multiple right-hand sides, is described. For the first right-hand side, eigenvectors…

High Energy Physics - Lattice · Physics 2010-01-21 Abdou M. Abdel-Rehim , Ronald B. Morgan , Dywayne Nicely , Walter Wilcox

In this work, we study a novel class of projection-based algorithms for linearly constrained problems (LCPs) which have a lot of applications in statistics, optimization, and machine learning. Conventional primal gradient-based methods for…

Optimization and Control · Mathematics 2021-01-06 Xiang Li , Zhihua Zhang

The discretization of least-squares problems for linear ill-posed operator equations in Hilbert spaces is considered. The main subject of this article concerns conditions for convergence of the associated discretized minimum-norm…

Numerical Analysis · Mathematics 2016-02-10 Stefan Kindermann

A major challenge of applying zeroth-order (ZO) methods is the high query complexity, especially when queries are costly. We propose a novel gradient estimation technique for ZO methods based on adaptive lazy queries that we term as LAZO.…

Machine Learning · Computer Science 2022-06-16 Quan Xiao , Qing Ling , Tianyi Chen

We study nonlinear constrained optimization problems in which only function evaluations of the objective and constraints are available. Existing zeroth-order methods rely on noisy gradient and Jacobian surrogates in high dimensions, making…

Optimization and Control · Mathematics 2026-04-03 Runyu Zhang , Gioele Zardini

Multiple-input multiple-output (MIMO) systems have been widely acclaimed in order to provide high data rates. Recently Lattice Reduction (LR) aided detectors have been proposed to achieve near Maximum Likelihood (ML) performance with low…

Information Theory · Computer Science 2016-02-22 Mehnaz Rahman , Gwan S. Choi

We present randomized algorithms for estimating the log-determinant of regularized symmetric positive semi-definite matrices. The algorithms access the matrix only through matrix vector products, and are based on the introduction of a…

Numerical Analysis · Mathematics 2026-02-20 Alice Cortinovis , Daniele Toni

We introduce a hybrid oscillator-qubit formulation of linear combination of Hamiltonian simulation (LCHS) for solving linear ordinary differential equations. Instead of representing the quadrature rule with a discrete-variable (DV) ancilla…

Quantum Physics · Physics 2026-05-12 Elin Ranjan Das , Muqing Zheng , Rishab Dutta , Ang Li , Timothy Stavenger , Yuan Liu

The numerical solution of singular eigenvalue problems is complicated by the fact that small perturbations of the coefficients may have an arbitrarily bad effect on eigenvalue accuracy. However, it has been known for a long time that such…

Numerical Analysis · Mathematics 2023-01-10 Daniel Kressner , Ivana Šain Glibić

The Lanczos method is one of the most powerful and fundamental techniques for solving an extremal symmetric eigenvalue problem. Convergence-based error estimates depend heavily on the eigenvalue gap. In practice, this gap is often…

Numerical Analysis · Mathematics 2020-09-17 John C. Urschel

A classical approach for solving discrete time nonlinear control on a finite horizon consists in repeatedly minimizing linear quadratic approximations of the original problem around current candidate solutions. While widely popular in many…

Optimization and Control · Mathematics 2025-07-08 Vincent Roulet , Siddhartha Srinivasa , Maryam Fazel , Zaid Harchaoui

We study the Sparse Plus Low-Rank decomposition problem (SLR), which is the problem of decomposing a corrupted data matrix into a sparse matrix of perturbations plus a low-rank matrix containing the ground truth. SLR is a fundamental…

Machine Learning · Statistics 2023-11-15 Dimitris Bertsimas , Ryan Cory-Wright , Nicholas A. G. Johnson

Two new hybrid algorithms are proposed for large-scale linear discrete ill-posed problems in general-form regularization. They are both based on Krylov subspace inner-outer iterative algorithms. At each iteration, they need to solve a…

Numerical Analysis · Mathematics 2024-09-02 Yanfei Yang

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

The need for large-scale electronic structure calculations arises recently in the field of material physics and efficient and accurate algebraic methods for large simultaneous linear equations become greatly important. We investigate the…

Mesoscale and Nanoscale Physics · Physics 2015-05-27 H. Teng , T. Fujiwara , T. Hoshi , T. Sogabe , S. -L. Zhang , S. Yamamoto

Strong gravitational lensing is a powerful probe of cosmology and the dark matter distribution. Efficient lensing software is already a necessity to fully use its potential and the performance demands will only increase with the upcoming…

Instrumentation and Methods for Astrophysics · Physics 2019-02-12 Markus Rexroth , Christoph Schäfer , Gilles Fourestey , Jean-Paul Kneib

We describe an efficient implementation of a recent simplex-type algorithm for the exact solution of separated continuous linear programs, and compare it with linear programming approximation of these problems obtained via discretization of…

Optimization and Control · Mathematics 2021-10-07 Evgeny Shindin , Michael Masin , Gideon Weiss , Alexander Zadorojniy

In this paper, we propose a distributed first-order algorithm with backtracking linesearch for solving multi-agent minimisation problems, where each agent handles a local objective involving nonsmooth and smooth components. Unlike existing…

Optimization and Control · Mathematics 2025-05-14 Felipe Atenas , Minh N. Dao , Matthew K. Tam