English
Related papers

Related papers: Enhancing the SVD Compression

200 papers

In this paper, we present a class of high order methods to approximate the singular value decomposition of a given complex matrix (SVD). To the best of our knowledge, only methods up to order three appear in the the literature. A first part…

Numerical Analysis · Mathematics 2023-09-13 Diego Armentano , Jean-Claude Yakoubsohn

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during simulations or instrument data acquisitions. Not only can it significantly…

Machine Learning · Computer Science 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Sian Jin , Dingwen Tao , Xin Liang , Zizhong Chen , Franck Cappello

The goal of this work is to fill a gap in [Yang, SIAM J. Matrix Anal. Appl, 41 (2020), 1797--1825]. In that work, an approximation procedure was proposed for orthogonal low-rank tensor approximation; however, the approximation lower bound…

Optimization and Control · Mathematics 2021-01-01 Yuning Yang

In a Big Data setting computing the dominant SVD factors is restrictive due to the main memory requirements. Recently introduced streaming Randomized SVD schemes work under the restrictive assumption that the singular value spectrum of the…

Numerical Analysis · Mathematics 2021-03-22 Gurpreet Singh , Soumyajit Gupta , Matthew Lease , Clint Dawson

In our earlier work [Fareed et al., Comput. Math. Appl. 75 (2018), no. 6, 1942-1960], we developed an incremental approach to compute the proper orthogonal decomposition (POD) of PDE simulation data. Specifically, we developed an…

Numerical Analysis · Mathematics 2021-02-01 Hiba Fareed , John R. Singler

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD such as…

Mathematical Software · Computer Science 2020-09-03 Drew Schmidt

Truncated Singular Value Decomposition (SVD) calculates the closest rank-$k$ approximation of a given input matrix. Selecting the appropriate rank $k$ defines a critical model order choice in most applications of SVD. To obtain a principled…

Information Theory · Computer Science 2013-01-08 Mario Frank , Joachim M. Buhmann

The growing demands of distributed learning on resource constrained edge devices underscore the importance of efficient on device model compression. Tensor Train Decomposition (TTD) offers high compression ratios with minimal accuracy loss,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-19 Hyunseok Kwak , Kyeongwon Lee , Kyeongpil Min , Chaebin Jung , Woojoo Lee

This work presents an independent reproducibility study of a lossy image compression technique that integrates singular value decomposition (SVD) and wavelet difference reduction (WDR). The original paper claims that combining SVD and WDR…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Alena Makarova

The generalized singular value decomposition (GSVD, a.k.a. "SVD triplet", "duality diagram" approach) provides a unified strategy and basis to perform nearly all of the most common multivariate analyses (e.g., principal components,…

Mathematical Software · Computer Science 2020-11-19 Derek Beaton

In this paper, we introduce the algorithms of Orthogonal Deep Neural Networks (OrthDNNs) to connect with recent interest of spectrally regularized deep learning methods. OrthDNNs are theoretically motivated by generalization analysis of…

Machine Learning · Computer Science 2019-10-16 Kui Jia , Shuai Li , Yuxin Wen , Tongliang Liu , Dacheng Tao

The volume of remote sensing data is experiencing rapid growth, primarily due to the plethora of space and air platforms equipped with an array of sensors. Due to limited hardware and battery constraints the data is transmitted back to…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Alessandro Giuliano , S. Andrew Gadsden , Waleed Hilal , John Yawney

As deep learning (DL) techniques become integral to various applications, ensuring model fairness while maintaining high performance has become increasingly critical, particularly in sensitive fields such as medical diagnosis. Although a…

Machine Learning · Computer Science 2025-11-21 Yuanbo Guo , Jun Xia , Yiyu Shi

Learned image compression has recently shown the potential to outperform the standard codecs. State-of-the-art rate-distortion (R-D) performance has been achieved by context-adaptive entropy coding approaches in which hyperprior and…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

Tensor network decomposition, originated from quantum physics to model entangled many-particle quantum systems, turns out to be a promising mathematical technique to efficiently represent and process big data in parsimonious manner. In this…

Machine Learning · Computer Science 2018-12-12 Jenn-Bing Ong , Wee-Keong Ng , C. -C. Jay Kuo

Aiming to provide a faster and convenient truncated SVD algorithm for large sparse matrices from real applications (i.e. for computing a few of largest singular values and the corresponding singular vectors), a dynamically shifted power…

Mathematical Software · Computer Science 2024-04-16 Xu Feng , Wenjian Yu , Yuyang Xie , Jie Tang

This paper is devoted to proposing a general weighted low-rank recovery model and designing a fast SVD-free computational scheme to solve it. First, our generic weighted low-rank recovery model unifies several existing approaches in the…

Optimization and Control · Mathematics 2022-08-02 Aritra Dutta , Jingwei Liang , Xin Li

We consider a streaming data model in which n sensors observe individual streams of data, presented in a turnstile model. Our goal is to analyze the singular value decomposition (SVD) of the matrix of data defined implicitly by the stream…

Information Theory · Computer Science 2012-11-05 Anna C. Gilbert , Jae Young Park , Michael B. Wakin

Matched-filtering for the identification of compact object mergers in gravitational-wave antenna data involves the comparison of the data stream to a bank of template gravitational waveforms. Typically the template bank is constructed from…

General Relativity and Quantum Cosmology · Physics 2013-05-30 Kipp Cannon , J. D. Emberson , Chad Hanna , Drew Keppel , Harald Pfeiffer

Higher-order singular value decomposition (HOSVD) is an efficient way for data reduction and also eliciting intrinsic structure of multi-dimensional array data. It has been used in many applications, and some of them involve incomplete…

Numerical Analysis · Mathematics 2016-08-11 Yangyang Xu