English
Related papers

Related papers: An Incremental Singular Value Decomposition Approa…

200 papers

In this work we present a novel methodology that combines Higher Order Singular Value Decomposition (HOSVD) with Deep Learning (DL) techniques for super-resolution in computational fluid dynamics (CFD) and sparse experimental datasets. This…

In this letter, we propose a simple yet effective singular value decomposition (SVD) based strategy to reduce the optimization problem dimension in data-enabled predictive control (DeePC). Specifically, in the case of linear time-invariant…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Kaixiang Zhang , Yang Zheng , Chao Shang , Zhaojian Li

The singular value decomposition (SVD) is a crucial tool in machine learning and statistical data analysis. However, it is highly susceptible to outliers in the data matrix. Existing robust SVD algorithms often sacrifice speed for…

Machine Learning · Statistics 2024-02-16 Sangil Han , Kyoowon Kim , Sungkyu Jung

Fluid Dynamics problems are characterized by being multidimensional and nonlinear. Therefore, experiments and numerical simulations are complex and time-consuming. Motivated by this, the need arises to find new techniques to obtain data in…

Fluid Dynamics · Physics 2023-05-16 Paula Díaz , Adrián Corrochano , Manuel López-Martín , Soledad Le Clainche

Singular Value Decomposition (SVD) is a popular approach in various network applications, such as link prediction and network parameter characterization. Incremental SVD approaches are proposed to process newly changed nodes and edges in…

Social and Information Networks · Computer Science 2017-11-28 Ziwei Zhang , Peng Cui , Jian Pei , Xiao Wang , Wenwu Zhu

In streaming Singular Value Decomposition (SVD), $d$-dimensional rows of a possibly infinite matrix arrive sequentially as points in $\mathbb{R}^d$. An $\epsilon$-coreset is a (much smaller) matrix whose sum of square distances of the rows…

Data Structures and Algorithms · Computer Science 2020-11-30 Vladimir Braverman , Dan Feldman , Harry Lang , Daniela Rus , Adiel Statman

While transfer learning is an effective strategy, it often overlooks the opportunity to leverage knowledge from numerous available models online. Addressing this multi-source transfer learning problem is a promising path to boost…

Machine Learning · Computer Science 2026-04-24 Marcin Osial , Bartosz Wójcik , Bartosz Zieliński , Sebastian Cygert

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

The cost of writing, transferring, and storing large data from unsteady simulations limits access to the entire solution, often leaving much of the flow under-sampled or unanalyzed. For example, modeling transient behavior of rare dynamic…

Data Analysis, Statistics and Probability · Physics 2024-10-17 Spencer L. Stahl , Stuart I. Benton

We evaluate performance of associative memory in a neural network by based on the singular value decomposition (SVD) of image data stored in the network. We consider the situation in which the original image and its highly coarse-grained…

Statistical Mechanics · Physics 2017-03-08 Tatsuya Kumamoto , Mao Suzuki , Hiroaki Matsueda

The deployment of Large Language Models is constrained by the memory and bandwidth demands of static weights and dynamic Key-Value cache. SVD-based compression provides a hardware-friendly solution to reduce these costs. However, existing…

Computation and Language · Computer Science 2026-04-03 Ruoling Qi , Yirui Liu , Xuaner Wu , Xiangyu Wang , Ming Li , Chen Chen , Jian Chen , Yin Chen , Qizhen Weng

Diffusion transformer (DiT) models have achieved remarkable success in image generation, thanks for their exceptional generative capabilities and scalability. Nonetheless, the iterative nature of diffusion models (DMs) results in high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Zhiyuan Chen , Keyi Li , Yifan Jia , Le Ye , Yufei Ma

Analyzing complex experimental data with multiple parameters is challenging. We propose using Singular Value Decomposition (SVD) as an effective solution. This method, demonstrated through real experimental data analysis, surpasses…

Data Analysis, Statistics and Probability · Physics 2024-07-24 Judith F. Stein , Aviad Frydman , Richard Berkovits

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

It is well known that the numerical solution of the Non-Fickian flows at the current stage depends on all previous time instances. Consequently, the storage requirement increases linearly, while the computational complexity grows…

Numerical Analysis · Mathematics 2024-04-15 Gang Chen , Yangwen Zhang , Dujin Zuo

We propose a novel scheme for watermarking of digital images based on singular value decomposition (SVD), which makes use of the fact that the SVD subspace preserves significant amount of information of an image, as compared to its singular…

Multimedia · Computer Science 2008-08-05 Chirag Jain , Siddharth Arora , Prasanta K. Panigrahi

This paper considers the problem of updating the rank-k truncated Singular Value Decomposition (SVD) of matrices subject to the addition of new rows and/or columns over time. Such matrix problems represent an important computational kernel…

Sparsity regularization has garnered significant interest across multiple disciplines, including statistics, imaging, and signal processing. Standard techniques for addressing sparsity regularization include iterative soft thresholding…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

The singular value decomposition (SVD) is a powerful tool in modern numerical linear algebra, which underpins computational methods such as principal component analysis (PCA), low-rank approximations, and randomized algorithms. Many…

Mathematical Software · Computer Science 2026-04-10 Ahmad Abdelfattah , Massimiliano Fasi

We extend the randomized singular value decomposition (SVD) algorithm \citep{Halko2011finding} to estimate the SVD of a shifted data matrix without explicitly constructing the matrix in the memory. With no loss in the accuracy of the…

Machine Learning · Statistics 2019-12-02 Ali Basirat