English
Related papers

Related papers: Efficient algorithms for computing a rank-revealin…

200 papers

Discrete-action reinforcement learning algorithms often falter in tasks with high-dimensional discrete action spaces due to the vast number of possible actions. A recent advancement leverages value-decomposition, a concept from multi-agent…

Machine Learning · Computer Science 2024-03-11 David Ireland , Giovanni Montana

Modern deep neural networks (DNNs) often require high memory consumption and large computational loads. In order to deploy DNN algorithms efficiently on edge or mobile devices, a series of DNN compression algorithms have been explored,…

Machine Learning · Computer Science 2020-04-21 Huanrui Yang , Minxue Tang , Wei Wen , Feng Yan , Daniel Hu , Ang Li , Hai Li , Yiran Chen

This paper introduces a high performance implementation of \texttt{Zolo-SVD} algorithm on distributed memory systems, which is based on the polar decomposition (PD) algorithm via the Zolotarev's function (\texttt{Zolo-PD}), originally…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-19 Shengguo Li , Jie Liu , Yunfei Du

In this paper, a complexity study is conducted for Versatile Video Codec (VVC) intra partitioning to accelerate the exhaustive search involved in Rate-Distortion Optimization (RDO) process. To address this problem, two main machine learning…

Machine Learning · Computer Science 2025-11-26 M. E. A. Kherchouche , F. Galpin , T. Dumas , F. Schnitzler , D. Menard , L. Zhang

The traditional method of computing singular value decomposition (SVD) of a data matrix is based on a least squares principle, thus, is very sensitive to the presence of outliers. Hence the resulting inferences across different applications…

Statistics Theory · Mathematics 2024-09-17 Subhrajyoty Roy , Abhik Ghosh , Ayanendranath Basu

The matrix-completion problem has attracted a lot of attention, largely as a result of the celebrated Netflix competition. Two popular approaches for solving the problem are nuclear-norm-regularized matrix approximation (Candes and Tao,…

Methodology · Statistics 2014-10-10 Trevor Hastie , Rahul Mazumder , Jason Lee , Reza Zadeh

In this work, we present a mixed precision algorithm that leverages the Gram matrix and Jacobi methods to compute the singular value decomposition (SVD) of tall-and-skinny matrices. By constructing the Gram matrix in higher precision and…

Numerical Analysis · Mathematics 2026-03-13 Erin Carson , Yuxin Ma , Meiyue Shao

This paper introduces RankMap, a platform-aware end-to-end framework for efficient execution of a broad class of iterative learning algorithms for massive and dense datasets. Our framework exploits data structure to factorize it into an…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-28 Azalia Mirhoseini , Eva L. Dyer , Ebrahim. M. Songhori , Richard G. Baraniuk , Farinaz Koushanfar

For a datastream, the change over a short interval is often of low rank. For high throughput information arranged in matrix format, recomputing an optimal SVD approximation after each step is typically prohibitive. Instead, incremental and…

Numerical Analysis · Mathematics 2025-09-04 Johannes J. Brust , Michael A. Saunders

Singular value decomposition (SVD) is widely used for dimensionality reduction and noise suppression, and it plays a pivotal role in numerous scientific and engineering applications. As the dimensions of the matrix grow rapidly, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Fangqiang Du , Sixuan Chong , Zixuan Huang , Rui Qin , Fengnan Mi , Caibao Hu , Jiangang Chen

Simulations of large scale dynamical systems in multi-query or real-time contexts require efficient surrogate modelling techniques, as e.g. achieved via Model Order Reduction (MOR). Recently, symplectic methods like the complex singular…

Numerical Analysis · Mathematics 2023-03-08 Robin Herkert , Patrick Buchfink , Bernard Haasdonk , Johannes Rettberg , Jörg Fehr

Computational protein structure determination involves optimization in a problem space much too large to exhaustively search. Existing approaches include optimization algorithms such as gradient descent and simulated annealing, but these…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Michael Bryson , Xijiang Miao , Homayoun Valafar

The computation of accurate low-rank matrix approximations is central to improving the scalability of various techniques in machine learning, uncertainty quantification, and control. Traditionally, low-rank approximations are constructed…

Numerical Analysis · Mathematics 2025-09-29 Nathaniel Pritchard , Taejun Park , Yuji Nakatsukasa , Per-Gunnar Martinsson

The tensor-vector contraction (TVC) is the most memory-bound operation of its class and a core component of the higher-order power method (HOPM). This paper brings distributed-memory parallelization to a native TVC algorithm for dense…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-26 Pedro J. Martinez-Ferrer , Albert-Jan Yzelman , Vicenç Beltran

Given multiple time series data, how can we efficiently find latent patterns in an arbitrary time range? Singular value decomposition (SVD) is a crucial tool to discover hidden factors in multiple time series data, and has been used in many…

Numerical Analysis · Computer Science 2018-12-21 Jun-Gi Jang , Dongjin Choi , Jinhong Jung , U Kang

In this paper, we introduce a randomized QLP decomposition called Rand-QLP. Operating on a matrix $\bf A$, Rand-QLP gives ${\bf A}={\bf QLP}^T$, where $\bf Q$ and $\bf P$ are orthonormal, and $\bf L$ is lower-triangular. Under the…

Numerical Analysis · Mathematics 2023-01-31 M. F. Kaloorazi , K. Liu , J. Chen , R. C. de Lamare

Array codes have been widely employed in storage systems, such as Redundant Arrays of Inexpensive Disks (RAID). The row-diagonal parity (RDP) codes and EVENODD codes are two popular double-parity array codes. As the capacity of hard disks…

Information Theory · Computer Science 2018-03-12 Hanxu Hou , Yunghsiang S. Han , Kenneth W. Shum , Hui Li

This paper considers the problem of updating the rank-k truncated Singular Value Decomposition (SVD) of matrices subject to the addition of new rows and/or columns over time. Such matrix problems represent an important computational kernel…

Ordering vertices of a graph is key to minimize fill-in and data structure size in sparse direct solvers, maximize locality in iterative solvers, and improve performance in graph algorithms. Except for naturally parallelizable ordering…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-27 Ariful Azad , Mathias Jacquelin , Aydin Buluc , Esmond G. Ng

Computing the top eigenvectors of a matrix is a problem of fundamental interest to various fields. While the majority of the literature has focused on analyzing the reconstruction error of low-rank matrices associated with the retrieved…

Machine Learning · Computer Science 2022-02-17 Ruo-Chun Tzeng , Po-An Wang , Florian Adriaens , Aristides Gionis , Chi-Jen Lu