English
Related papers

Related papers: A New High Performance and Scalable SVD algorithm …

200 papers

Large kernel systems are prone to be ill-conditioned. Pivoted Cholesky decomposition (PCD) render a stable and efficient solution to the systems without a perturbation of regularization. This paper proposes a new PCD algorithm by tuning…

Numerical Analysis · Mathematics 2019-04-29 Dishi Liu , Hermann G. Matthies

Matrix completion is a widely used technique for image inpainting and personalized recommender system, etc. In this work, we focus on accelerating the matrix completion using faster randomized singular value decomposition (rSVD). Firstly,…

Machine Learning · Computer Science 2018-10-17 Xu Feng , Wenjian Yu , Yaohang Li

We introduce a backward stable algorithm for computing the CS decomposition of a partitioned $2n \times n$ matrix with orthonormal columns, or a rank-deficient partial isometry. The algorithm computes two $n \times n$ polar decompositions…

Numerical Analysis · Mathematics 2018-04-25 Evan S. Gawlik , Yuji Nakatsukasa , Brian D. Sutton

The recently-discovered polar codes are seen as a major breakthrough in coding theory; they provably achieve the theoretical capacity of discrete memoryless channels using the low complexity successive cancellation (SC) decoding algorithm.…

Hardware Architecture · Computer Science 2015-03-19 Camille Leroux , Alexandre J. Raymond , Gabi Sarkis , Ido Tal , Alexander Vardy , Warren J. Gross

Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications and data storage systems. SC codes are constructed by partitioning an…

Information Theory · Computer Science 2021-09-21 Siyi Yang , Ahmed Hareedy , Robert Calderbank , Lara Dolecek

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

We present methods for computing the generalized polar decomposition of a matrix based on the dynamically weighted Halley (DWH) iteration. This method is well established for computing the standard polar decomposition. A stable…

Numerical Analysis · Mathematics 2021-04-15 Peter Benner , Yuji Nakatsukasa , Carolin Penke

In the era of big data, effectively compressing large datasets while performing complex mathematical operations is crucial. Tensor-based decomposition methods have shown superior compression capabilities with minimal loss of accuracy…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-18 Md Taufique Hussain , Grey Ballard , Aditya Devarakonda , Srinivas Eswar , Naman Pesricha , Vishwas Rao

This article studies the problem of decentralized Singular Value Decomposition (d-SVD), which is fundamental in various signal processing applications. Two scenarios are considered depending on the availability of the data matrix under…

Signal Processing · Electrical Eng. & Systems 2025-01-10 Yufan Fan , Marius Pesavento

This paper proposes a method to optimize communication code rates via the application of neural polar decoders (NPDs). Employing this approach enables simultaneous optimization of code rates over input distributions while providing a…

Information Theory · Computer Science 2025-06-23 Ziv Aharoni , Bashar Huleihel , Henry D Pfister , Haim H Permuter

Nowadays polar codes are becoming one of the most favorable capacity achieving error correction codes for their low encoding and decoding complexity. However, due to the large code length required by practical applications, the few existing…

Hardware Architecture · Computer Science 2011-11-04 Chuan Zhang , Bo Yuan , Keshab K. Parhi

Polar codes are the first error-correcting code proven to achieve channel capacity based on infinite code length. The Successive Cancellation List Flip (SCLF) decoding algorithm was proposed by flipping an erroneous bit during the next…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Fu-Siang Liang , Shan Lu , Yeong-Luh Ueng

This paper reports a development in the proper symplectic decomposition (PSD) for model reduction of forced Hamiltonian systems. As an analogy to the proper orthogonal decomposition (POD), PSD is designed to build a symplectic subspace to…

Numerical Analysis · Mathematics 2016-03-14 Liqian Peng , Kamran Mohseni

This paper studies delayed stochastic algorithms for weakly convex optimization in a distributed network with workers connected to a master node. Recently, Xu et al. 2022 showed that an inertial stochastic subgradient method converges at a…

Optimization and Control · Mathematics 2023-11-02 Wenzhi Gao , Qi Deng

Since being analyzed by Rokhlin, Szlam, and Tygert and popularized by Halko, Martinsson, and Tropp, randomized Simultaneous Power Iteration has become the method of choice for approximate singular value decomposition. It is more accurate…

Data Structures and Algorithms · Computer Science 2015-11-02 Cameron Musco , Christopher Musco

We present a distributed framework of the Primal-Dual Hybrid Gradient (PDHG) algorithm for solving massive-scale linear programming (LP) problems. Although PDHG-based solvers demonstrate strong performance on single-node GPU architectures,…

Optimization and Control · Mathematics 2026-05-11 Hongpei Li , Yicheng Huang , Huikang Liu , Dongdong Ge , Yinyu Ye

Singular Value Decomposition (SVD) has become an important technique for reducing the computational burden of Vision Language Models (VLMs), which play a central role in tasks such as image captioning and visual question answering. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Haiyu Wang , Yutong Wang , Jack Jiang , Sai Qian Zhang

The structure-preserving doubling algorithm (SDA) is a fairly efficient method for solving problems closely related to Hamiltonian (or Hamiltonian-like) matrices, such as computing the required solutions to algebraic Riccati equations.…

Numerical Analysis · Mathematics 2020-05-19 Zhen-Chen Guo , Eric King-Wah Chu , Xin Liang , Wen-Wei Lin

Diffusion-based Large Language Models (dLLMs) have emerged as a competitive alternative to autoregressive models, offering unique advantages through bidirectional attention and parallel generation paradigms. However, the generation results…

Computation and Language · Computer Science 2025-10-07 Yifeng Gao , Ziang Ji , Yuxuan Wang , Biqing Qi , Hanlin Xu , Linfeng Zhang

Boundary value problems involving elliptic PDEs such as the Laplace and the Helmholtz equations are ubiquitous in mathematical physics and engineering. Many such problems can be alternatively formulated as integral equations that are…

Numerical Analysis · Mathematics 2024-02-20 Tianyu Liang , Chao Chen , Per-Gunnar Martinsson , George Biros