English
Related papers

Related papers: Randomized Implicitly Restarted Arnoldi method for…

200 papers

We consider the problem of reconstructing rank-one matrices from random linear measurements, a task that appears in a variety of problems in signal processing, statistics, and machine learning. In this paper, we focus on the Alternating…

Machine Learning · Computer Science 2022-04-26 Kiryung Lee , Dominik Stöger

Iterative refinement is particularly popular for numerical solution of linear systems of equations. We extend it to Low Rank Approximation of a matrix (LRA) and observe close link of the resulting algorithm to oversampling techniques,…

Numerical Analysis · Mathematics 2024-11-28 Victor Y. Pan , Qi Luan , Soo Go

A deflated restarted Lanczos algorithm is given for both solving symmetric linear equations and computing eigenvalues and eigenvectors. The restarting limits the storage so that finding eigenvectors is practical. Meanwhile, the deflating…

Mathematical Physics · Physics 2014-08-27 Abdou M. Abdel-Rehim , Ronald B. Morgan , Dywayne A. Nicely , Walter Wilcox

We identify a relationship between the solutions of a nonsymmetric algebraic T-Riccati equation (T-NARE) and the deflating subspaces of a palindromic matrix pencil, obtained by arranging the coefficients of the T-NARE. The interplay between…

Numerical Analysis · Mathematics 2021-10-08 Peter Benner , Bruno Iannazzo , Beatrice Meini , Davide Palitta

We present novel algorithms for simulation optimization using random directions stochastic approximation (RDSA). These include first-order (gradient) as well as second-order (Newton) schemes. We incorporate both continuous-valued as well as…

Optimization and Control · Mathematics 2015-08-11 Prashanth L. A. , Shalabh Bhatnagar , Michael Fu , Steve Marcus

We describe a strategy for solving nonlinear eigenproblems numerically. Our approach is based on the approximation of a vector-valued function, defined as solution of a non-homogeneous version of the eigenproblem. This approximation step is…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

In this paper, we describe a new algorithm that approximates the extreme eigenvalue/eigenvector pairs of a symmetric matrix. The proposed algorithm can be viewed as an extension of the Jacobi eigenvalue method for symmetric matrices…

Numerical Analysis · Mathematics 2025-09-16 Cristian Rusu

We present the first algorithm to efficiently compute certifiably optimal solutions to range-aided simultaneous localization and mapping (RA-SLAM) problems. Robotic navigation systems increasingly incorporate point-to-point ranging sensors,…

The Kaczmarz method is successfully used for solving discretizations of linear inverse problems, especially in computed tomography where it is known as ART. Practitioners often observe and appreciate its fast convergence in the first few…

Numerical Analysis · Mathematics 2026-01-13 Per Christian Hansen , Michiel E. Hochstenbach

Certain applications that analyze damping effects require the solution of quadratic eigenvalue problems (QEPs). We use refined isogeometric analysis (rIGA) to solve quadratic eigenproblems. rIGA discretization, while conserving desirable…

Numerical Analysis · Mathematics 2022-07-27 Ali Hashemian , Daniel Garcia , David Pardo , Victor M. Calo

In this paper, SAR image reconstruction with joint phase error estimation (autofocusing) is formulated as an inverse problem. An optimization model utilising a sparsity-enforcing Cauchy regularizer is proposed, and an alternating…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Zi-Yao Zhang , Odysseas Pappas , Igor G. Rizaev , Alin Achim

Rotation averaging (RA) is a fundamental problem in robotics and computer vision. In RA, the goal is to estimate a set of $N$ unknown orientations $R_{1}, ..., R_{N} \in SO(3)$, given noisy measurements $R_{ij} \sim R^{-1}_{i} R_{j}$ of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Owen Howell , Haoen Huang , David Rosen

Fisher discriminant analysis (FDA) is a widely used method for classification and dimensionality reduction. When the number of predictor variables greatly exceeds the number of observations, one of the alternatives for conventional FDA is…

Machine Learning · Statistics 2018-11-30 Agniva Chowdhury , Jiasen Yang , Petros Drineas

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

Phase estimation is a quantum algorithm for measuring the eigenvalues of a Hamiltonian. We propose and rigorously analyse a randomized phase estimation algorithm with two distinctive features. First, our algorithm has complexity independent…

Quantum Physics · Physics 2022-08-09 Kianna Wan , Mario Berta , Earl T. Campbell

In this paper, we study and analyze the mini-batch version of StochAstic Recursive grAdient algoritHm (SARAH), a method employing the stochastic recursive gradient, for solving empirical loss minimization for the case of nonconvex losses.…

Machine Learning · Statistics 2017-05-23 Lam M. Nguyen , Jie Liu , Katya Scheinberg , Martin Takáč

Recent denoising algorithms based on the "blind-spot" strategy show impressive blind image denoising performances, without utilizing any external dataset. While the methods excel in recovering highly contaminated images, we observe that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-07 Chaewon Kim , Jaeho Lee , Jinwoo Shin

The iterative weighted shrinkage-thresholding algorithm (IWSTA) has shown superiority to the classic unweighted iterative shrinkage-thresholding algorithm (ISTA) for solving linear inverse problems, which address the attributes differently.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Bingxue Wu , Jiao Wei , Chen Li , Yudong Yao , Yueyang Teng

The aim of this paper is to develop an algebraic multigrid method to solve eigenvalue problems based on the combination of the multilevel correction scheme and the algebraic multigrid method for linear equations. Our approach uses the…

Numerical Analysis · Mathematics 2020-03-02 Ning Zhang , Xiaole Han , Yunhui He , Hehu Xie , Chun'guang You

In this work, we develop efficient solvers for linear inverse problems based on randomized singular value decomposition (RSVD). This is achieved by combining RSVD with classical regularization methods, e.g., truncated singular value…

Numerical Analysis · Mathematics 2019-09-05 Kazufumi Ito , Bangti Jin