English
Related papers

Related papers: Faster Matrix Completion Using Randomized SVD

200 papers

In this paper we develop a new Bayesian inference method for low rank matrix reconstruction. We call the new method the Relevance Singular Vector Machine (RSVM) where appropriate priors are defined on the singular vectors of the underlying…

Numerical Analysis · Computer Science 2014-07-02 Martin Sundin , Saikat Chatterjee , Magnus Jansson , Cristian R. Rojas

In this paper, we consider the tensor completion problem, which has many researchers in the machine learning particularly concerned. Our fast and precise method is built on extending the $L_{2,1}$-norm minimization and Qatar Riyal…

Numerical Analysis · Mathematics 2020-11-10 Yongming Zheng , An-Bao Xu

Visual autoregressive (AR) generation models have demonstrated strong potential for image generation, yet their next-token-prediction paradigm introduces considerable inference latency. Although speculative decoding (SD) has been proven…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Haotian Dong , Ye Li , Rongwei Lu , Chen Tang , Shu-Tao Xia , Zhi Wang

Iterative method selection is crucial for solving sparse linear systems because these methods inherently lack robustness. Though image-based selection approaches have shown promise, their feature extraction techniques might encode distinct…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Kaiqi Zhang , Mingguan Yang , Dali Chang , Chun Chen , Yuxiang Zhang , Kexun He , Jing Zhao

This paper describes Sparse Frequent Directions, a variant of Frequent Directions for sketching sparse matrices. It resembles the original algorithm in many ways: both receive the rows of an input matrix $A^{n \times d}$ one by one in the…

Data Structures and Algorithms · Computer Science 2016-02-18 Mina Ghashami , Edo Liberty , Jeff M. Phillips

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

Modern data analysis increasingly requires identifying shared latent structure across multiple high-dimensional datasets. A commonly used model assumes that the data matrices are noisy observations of low-rank matrices with a shared…

Machine Learning · Statistics 2025-07-31 Tavor Z. Baharav , Phillip B. Nicol , Rafael A. Irizarry , Rong Ma

The earlier works in the context of low-rank-sparse-decomposition (LRSD)-driven stationary synthetic aperture radar (SAR) imaging have shown significant improvement in the reconstruction-decomposition process. Neither of the proposed…

Image and Video Processing · Electrical Eng. & Systems 2025-12-12 Hamid Reza Hashempour , Majid Moradikia , Hamed Bastami , Ahmed Abdelhadi , Mojtaba Soltanalian

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

In this paper, we propose new randomization based algorithms for large scale linear discrete ill-posed problems with general-form regularization: ${\min} \|Lx\|$ subject to ${\min} \|Ax - b\|$, where $L$ is a regularization matrix. Our…

Numerical Analysis · Mathematics 2019-09-24 Zhongxiao Jia , Yanfei Yang

In Visual SLAM, achieving accurate feature matching consumes a significant amount of time, severely impacting the real-time performance of the system. This paper proposes an accelerated method for Visual SLAM by integrating GMS (Grid-based…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shaojie Zhang , Yinghui Wang , Jiaxing Ma , Wei Li , Jinlong Yang , Tao Yan , Yukai Wang , Liangyi Huang , Mingfeng Wang , Ibragim R. Atadjanov

This paper aims to develop a simple procedure to reduce and control the condition number of random matrices, and investigate the effect on the persistent homology (PH) of point clouds of well- and ill-conditioned matrices. For a square…

Algebraic Topology · Mathematics 2023-02-23 Jehan Ghafuri , Sabah Jassim

We revisit the inductive matrix completion problem that aims to recover a rank-$r$ matrix with ambient dimension $d$ given $n$ features as the side prior information. The goal is to make use of the known $n$ features to reduce sample and…

Machine Learning · Statistics 2018-03-06 Xiao Zhang , Simon S. Du , Quanquan Gu

Storing data is particularly a challenge when dealing with image data which often involves large file sizes due to the high resolution and complexity of images. Efficient image compression algorithms are crucial to better manage data…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Zahra Golpayegani , Nizar Bouguila

Higher-order tensor decompositions are analogous to the familiar Singular Value Decomposition (SVD), but they transcend the limitations of matrices (second-order tensors). SVD is a powerful tool that has achieved impressive results in…

Machine Learning · Computer Science 2007-11-14 Peter D. Turney

Large collections of matrices arise throughout modern machine learning, signal processing, and scientific computing, where they are commonly compressed by concatenation followed by truncated singular value decomposition (SVD). This strategy…

Numerical Analysis · Mathematics 2026-01-21 Maksym Shamrai

The truncated singular value decomposition (SVD) of the measurement matrix is the optimal solution to the_representation_ problem of how to best approximate a noisy measurement matrix using a low-rank matrix. Here, we consider the…

Statistics Theory · Mathematics 2014-04-21 Raj Rao Nadakuditi

We present a simple yet novel parameterized form of linear mapping to achieves remarkable network compression performance: a pseudo SVD called Ternary SVD (TSVD). Unlike vanilla SVD, TSVD limits the $U$ and $V$ matrices in SVD to ternary…

Machine Learning · Computer Science 2023-08-16 Boyu Chen , Hanxuan Chen , Jiao He , Fengyu Sun , Shangling Jui

We revisit the use of Stochastic Gradient Descent (SGD) for solving convex optimization problems that serve as highly popular convex relaxations for many important low-rank matrix recovery problems such as \textit{matrix completion},…

Machine Learning · Computer Science 2020-06-16 Dan Garber

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao