English
Related papers

Related papers: Randomized Joint Diagonalization of Symmetric Matr…

200 papers

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

In this paper, we investigate decentralized non-convex optimization with orthogonal constraints. Conventional algorithms for this setting require either manifold retractions or other types of projection to ensure feasibility, both of which…

Machine Learning · Computer Science 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

We describe an algorithm that, given any full-rank matrix A having fewer rows than columns, can rapidly compute the orthogonal projection of any vector onto the null space of A, as well as the orthogonal projection onto the row space of A,…

Numerical Analysis · Computer Science 2011-05-26 Vladimir Rokhlin , Mark Tygert

Performing global resolvent analysis for high-Reynolds-number turbulent flow calls for the handling of a large discrete operator. Even though such large operator is required in the analysis, most applications of resolvent analysis extracts…

Fluid Dynamics · Physics 2020-03-25 Jean Hélder Marques Ribeiro , Chi-An Yeh , Kunihiko Taira

We demonstrate an implementation for an approximate rank-k SVD factorization, combining well-known randomized projection techniques with previously known paralel solutions in order to compute steps of the random projection based SVD…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Burak Bayramli

We present economical iterative algorithms built on the Biconjugate $A$-Orthonormalization Procedure for real unsymmetric and complex non-Hermitian systems. The principal characteristics of the developed solvers is that they are fast…

Numerical Analysis · Mathematics 2010-04-12 B. Carpentieri , Y. -F. Jing , T. -Z. Huang , Y. Duan

Symmetric Nonnegative Matrix Factorization (SymNMF) is a technique in data analysis and machine learning that approximates a symmetric matrix with a product of a nonnegative, low-rank matrix and its transpose. To design faster and more…

Machine Learning · Computer Science 2024-12-02 Koby Hayashi , Sinan G. Aksoy , Grey Ballard , Haesun Park

To achieve the greatest possible speed, practitioners regularly implement randomized algorithms for low-rank approximation and least-squares regression with structured dimension reduction maps. Despite significant research effort, basic…

Data Structures and Algorithms · Computer Science 2025-09-01 Chris Camaño , Ethan N. Epperly , Raphael A. Meyer , Joel A. Tropp

In this paper we consider a family of algorithms for approximate implicitization of rational parametric curves and surfaces. The main approximation tool in all of the approaches is the singular value decomposition, and they are therefore…

Numerical Analysis · Mathematics 2016-05-30 Oliver J. D. Barrowclough , Tor Dokken

This paper studies the unitary diagonalization of matrices over formal power series rings. Our main result shows that a normal matrix is unitarily diagonalizable if and only if its minimal polynomial completely splits over the ring and the…

Commutative Algebra · Mathematics 2026-02-10 Zihao Dai , Hao Liang , Jingyu Lu , Lihong Zhi

The largest eigenvalue of a matrix is always larger or equal than its largest diagonal entry. We show that for a large class of random Laplacian matrices, this bound is essentially tight: the largest eigenvalue is, up to lower order terms,…

Probability · Mathematics 2015-07-28 Afonso S. Bandeira

Recently, randomized algorithms for low-rank approximation of quaternion matrices have received increasing attention. However, for large-scale problems, existing quaternion orthonormalizations are inefficient, leading to slow rangefinders.…

Numerical Analysis · Mathematics 2024-06-19 Chao Chang , Yuning Yang

Matrix operations such as matrix inversion, eigenvalue decomposition, singular value decomposition are ubiquitous in real-world applications. Unfortunately, many of these matrix operations so time and memory expensive that they are…

Mathematical Software · Computer Science 2015-11-04 Shusen Wang

The Kaczmarz method is a popular iterative scheme for solving large-scale linear systems. The randomized Kaczmarz method (RK) greatly improves the convergence rate of the Kaczmarz method, by using the rows of the coefficient matrix in…

Numerical Analysis · Mathematics 2020-12-01 Yutong Jiang , Gang Wu , Long Jiang

The log Euclidean polyrigid registration framework provides a way to smoothly estimate and interpolate poly-rigid/affine transformations for which the invertibility is guaranteed. This powerful and flexible mathematical framework is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 K. Makki , B. Borotikar , M. Garetier , S. Brochard , D. Ben Salem , F. Rousseau

In this paper, we investigate diagonal estimation for large or implicit matrices, aiming to develop a novel and efficient stochastic algorithm that incorporates adaptive parameter selection. We explore the influence of different eigenvalue…

Machine Learning · Statistics 2024-10-16 Zongyuan Han , Wenhao Li , Shengxin Zhu

The Scheduled Relaxation Jacobi (SRJ) method is a linear solver algorithm which greatly improves the convergence of the Jacobi iteration through the use of judiciously chosen relaxation factors (an SRJ scheme) which attenuate the solution…

Numerical Analysis · Mathematics 2021-12-14 Mohammad Shafaet Islam , Qiqi Wang

We present a greedy algorithm for computing selected eigenpairs of a large sparse matrix $H$ that can exploit localization features of the eigenvector. When the eigenvector to be computed is localized, meaning only a small number of its…

Computational Physics · Physics 2021-02-09 Taylor M. Hernandez , Roel Van Beeumen , Mark A. Caprio , Chao Yang

We analyze two classical algorithms for solving additively composite convex optimization problems where the objective is the sum of a smooth term and a nonsmooth regularizer: proximal stochastic gradient method for a single regularizer; and…

Optimization and Control · Mathematics 2026-02-06 Kevin Kurian Thomas Vaidyan , Michael P. Friedlander , Ahmet Alacaoglu

The high-order relations between the content in social media sharing platforms are frequently modeled by a hypergraph. Either hypergraph Laplacian matrix or the adjacency matrix is a big matrix. Randomized algorithms are used for low-rank…

Social and Information Networks · Computer Science 2019-08-23 Georgios Karantaidis , Ioannis Sarridis , Constantine Kotropoulos