English
Related papers

Related papers: PatchSVD: A Non-uniform SVD-based Image Compressio…

200 papers

This paper evaluates Tucker decomposition and Singular Value Decomposition (SVD) for compressing neuroimaging data. Tucker decomposition preserves multi-dimensional relationships, achieving superior reconstruction fidelity and perceptual…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Jaeho Kim , Daniel David , Ana Vizitiv

Vision-Language Models (VLMs) are integral to tasks such as image captioning and visual question answering, but their high computational cost, driven by large memory footprints and processing time, limits their scalability and real-time…

Machine Learning · Computer Science 2025-10-21 Yutong Wang , Haiyu Wang , Sai Qian Zhang

The singular value decomposition (SVD) and the principal component analysis are fundamental tools and probably the most popular methods for data dimension reduction. The rapid growth in the size of data matrices has lead to a need for…

Statistics Theory · Mathematics 2020-02-03 Ting-Li Chen , Su-Yun Huang , Weichung Wang

Singular Value Decomposition (SVD) is a powerful tool for multivariate analysis. However, independent computation of the SVD for each sample taken from a bandlimited matrix random process will result in singular value sample paths whose…

Statistics Theory · Mathematics 2007-06-13 D. W. Browne , M. W. Browne , M. P. Fitz

Analyzing complex experimental data with multiple parameters is challenging. We propose using Singular Value Decomposition (SVD) as an effective solution. This method, demonstrated through real experimental data analysis, surpasses…

Data Analysis, Statistics and Probability · Physics 2024-07-24 Judith F. Stein , Aviad Frydman , Richard Berkovits

Singular Value Decomposition (SVD) has recently seen a surge of interest as a simple yet powerful tool for large language models (LLMs) compression, with a growing number of works demonstrating 20-80% parameter reductions at minimal…

Machine Learning · Computer Science 2025-08-05 Zishan Shao , Yixiao Wang , Qinsi Wang , Ting Jiang , Zhixu Du , Hancheng Ye , Danyang Zhuo , Yiran Chen , Hai Li

Engineering simulations are usually based on complex, grid-based, or mesh-free methods for solving partial differential equations. The results of these methods cover large fields of physical quantities at very many discrete spatial…

Fluid Dynamics · Physics 2025-08-08 Eduardo Di Costanzo , Niklas Kühl , Jean-Christophe Marongiu , Thomas Rung

Large language models (LLMs) have achieved remarkable success in natural language processing (NLP) tasks, yet their substantial memory requirements present significant challenges for deployment on resource-constrained devices. Singular…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Zhiteng Li , Mingyuan Xia , Jingyuan Zhang , Zheng Hui , Haotong Qin , Linghe Kong , Yulun Zhang , Xiaokang Yang

The ever-increasing computational demands and deployment costs of large language models (LLMs) have spurred numerous compressing methods. Compared to quantization and unstructured pruning, SVD compression offers superior hardware…

Machine Learning · Computer Science 2025-06-26 Xuan Ding , Rui Sun , Yunjian Zhang , Xiu Yan , Yueqi Zhou , Kaihao Huang , Suzhong Fu , Chuanlong Xie , Yao Zhu

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

This work presents an analysis of Higher Order Singular Value Decomposition (HO-SVD) applied to lossy compression of 3D mesh animations. We describe strategies for choosing a number of preserved spatial and temporal components after tensor…

Graphics · Computer Science 2013-10-07 Michał Romaszewski , Piotr Gawron , Sebastian Opozda

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD such as…

Mathematical Software · Computer Science 2020-09-03 Drew Schmidt

The singular value decomposition (SVD) of large-scale matrices is a key tool in data analytics and scientific computing. The rapid growth in the size of matrices further increases the need for developing efficient large-scale SVD…

Numerical Analysis · Mathematics 2016-08-31 Ting-Li Chen , Dawei D. Chang , Su-Yun Huang , Hung Chen , Chienyao Lin , Weichung Wang

Singular value decomposition (SVD) is a widely used technique for dimensionality reduction and computation of basis vectors. In many applications, especially in fluid mechanics and image processing the matrices are dense, but low-rank…

Numerical Analysis · Computer Science 2019-05-13 Vinita Vasudevan , M. Ramakrishna

We propose an efficient, distributed, out-of-memory implementation of the truncated singular value decomposition (t-SVD) for heterogeneous (CPU+GPU) high performance computing (HPC) systems. Various implementations of SVD have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Ismael Boureima , Manish Bhattarai , Maksim E. Eren , Nick Solovyev , Hristo Djidjev , Boian S. Alexandrov

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

Image hash algorithms generate compact binary representations that can be quickly matched by Hamming distance, thus become an efficient solution for large-scale image retrieval. This paper proposes RV-SSDH, a deep image hash algorithm that…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Li Weng , Lingzhi Ye , Jiangmin Tian , Jiuwen Cao , Jianzhong Wang

Personalized text-to-image models such as DreamBooth require fine-tuning large-scale diffusion backbones, resulting in significant storage overhead when maintaining many subject-specific models. We present Delta-SVD, a post-hoc,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Tangyuan Zhang , Shangyu Chen , Qixiang Chen , Jianfei Cai

This paper explores signal and image analysis by using the Singular Value Decomposition (SVD) and its extension, the Generalized Singular Value Decomposition (GSVD). A key strength of SVD lies in its ability to separate information into…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Oscar Romero , Néstor Thome

Image-based anomaly detection systems are of vital importance in various manufacturing applications. The resolution and acquisition rate of such systems is increasing significantly in recent years under the fast development of image sensing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Shancong Mou , Jianjun Shi