English
Related papers

Related papers: Improved analysis of randomized SVD for top-eigenv…

200 papers

We propose an adaptive random quantum algorithm to obtain an optimized eigensolver. Specifically, we introduce a general method to parametrize and optimize the probability density function of a random number generator, which is the core of…

In order to compute fast approximations to the singular value decompositions (SVD) of very large matrices, randomized sketching algorithms have become a leading approach. However, a key practical difficulty of sketching an SVD is that the…

Machine Learning · Statistics 2020-03-12 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

This paper proposes hybrid high-order eigensolvers for the computation of guaranteed lower eigenvalue bounds. These bounds display higher order convergence rates and are accessible to adaptive mesh-refining algorithms. The involved…

Numerical Analysis · Mathematics 2026-04-23 Ngoc Tien Tran

We propose a novel approach for hyperspectral super-resolution, that is based on low-rank tensor approximation for a coupled low-rank multilinear (Tucker) model. We show that the correct recovery holds for a wide range of multilinear ranks.…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Clémence Prévost , Konstantin Usevich , Pierre Comon , David Brie

Aiming to provide a faster and convenient truncated SVD algorithm for large sparse matrices from real applications (i.e. for computing a few of largest singular values and the corresponding singular vectors), a dynamically shifted power…

Mathematical Software · Computer Science 2024-04-16 Xu Feng , Wenjian Yu , Yuyang Xie , Jie Tang

We focus in this work on the estimation of the first $k$ eigenvectors of any graph Laplacian using filtering of Gaussian random signals. We prove that we only need $k$ such signals to be able to exactly recover as many of the smallest…

Data Structures and Algorithms · Computer Science 2016-11-07 Johan Paratte , Lionel Martin

Suppose that there is a ground set which consists of a large number of vectors in a Hilbert space. Consider the problem of selecting a subset of the ground set such that the projection of a vector of interest onto the subspace spanned by…

Information Theory · Computer Science 2015-07-20 Zhenliang Zhang , Yuan Wang , Edwin K. P. Chong , Ali Pezeshki , Louis Scharf

We study the stochastic Riemannian gradient algorithm for matrix eigen-decomposition. The state-of-the-art stochastic Riemannian algorithm requires the learning rate to decay to zero and thus suffers from slow convergence and sub-optimal…

Machine Learning · Computer Science 2016-05-30 Zhiqiang Xu , Yiping Ke

For a connected graph $\mathcal{G}=(V,E)$ with $n$ nodes, $m$ edges, and Laplacian matrix $\boldsymbol{{\mathit{L}}}$, a grounded Laplacian matrix $\boldsymbol{{\mathit{L}}}(S)$ of $\mathcal{G}$ is a $(n-k) \times (n-k)$ principal submatrix…

Information Theory · Computer Science 2023-03-16 Run Wang , Xiaotian Zhou , Wei Li , Zhongzhi Zhang

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

We propose a new randomized algorithm for solving L2-regularized least-squares problems based on sketching. We consider two of the most popular random embeddings, namely, Gaussian embeddings and the Subsampled Randomized Hadamard Transform…

Machine Learning · Computer Science 2020-10-26 Jonathan Lacotte , Mert Pilanci

The efficient calculation of the centrality or "hierarchy" of nodes in a network has gained great relevance in recent years due to the generation of large amounts of data. The eigenvector centrality (aka eigencentrality) is quickly becoming…

We study two important SVM variants: hard-margin SVM (for linearly separable cases) and $\nu$-SVM (for linearly non-separable cases). We propose new algorithms from the perspective of saddle point optimization. Our algorithms achieve…

Machine Learning · Computer Science 2018-01-30 Yifei Jin , Lingxiao Huang , Jian Li

Joint diagonalization, the process of finding a shared set of approximate eigenvectors for a collection of matrices, arises in diverse applications such as multidimensional harmonic analysis or quantum information theory. This task is…

Optimization and Control · Mathematics 2025-02-12 Erik Troedsson , Marcus Carlsson , Herwig Wendt

This paper presents a method for computing eigenvalues and eigenvectors for some types of nonlinear eigenvalue problems. The main idea is to approximate the functions involved in the eigenvalue problem by rational functions and then apply a…

Numerical Analysis · Mathematics 2020-06-11 Yousef Saad , Mohamed El-Guide , Agnieszka Międlar

We investigate the noise sensitivity of the top eigenvector of a Wigner matrix in the following sense. Let $v$ be the top eigenvector of an $N\times N$ Wigner matrix. Suppose that $k$ randomly chosen entries of the matrix are resampled,…

Probability · Mathematics 2020-03-03 Charles Bordenave , Gábor Lugosi , Nikita Zhivotovskiy

Efficiently computing a subset of a correlation matrix consisting of values above a specified threshold is important to many practical applications. Real-world problems in genomics, machine learning, finance other applications can produce…

Computation · Statistics 2016-03-15 James Baglama , Michael Kane , Bryan Lewis , Alex Poliakov

We prove a central limit theorem for the components of the largest eigenvectors of the adjacency matrix of a finite-dimensional random dot product graph whose true latent positions are unknown. In particular, we follow the methodology…

Statistics Theory · Mathematics 2013-12-24 Avanti Athreya , Vince Lyzinski , David J. Marchette , Carey E. Priebe , Daniel L. Sussman , Minh Tang

We propose a rank-$k$ variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation ($1$-SVD) in Frank-Wolfe with a top-$k$ singular-vector…

Machine Learning · Computer Science 2017-11-10 Zeyuan Allen-Zhu , Elad Hazan , Wei Hu , Yuanzhi Li

We present randUBV, a randomized algorithm for matrix sketching based on the block Lanzcos bidiagonalization process. Given a matrix $\bf{A}$, it produces a low-rank approximation of the form ${\bf UBV}^T$, where $\bf{U}$ and $\bf{V}$ have…

Numerical Analysis · Mathematics 2021-02-09 Eric Hallman