English
Related papers

Related papers: Low-cost singular value decomposition with optimal…

200 papers

We develop a data-driven regularization method for the severely ill-posed problem of photoacoustic image reconstruction from limited view data. Our approach is based on the regularizing networks that have been recently introduced and…

Numerical Analysis · Mathematics 2024-12-20 Johannes Schwab , Stephan Antholzer , Robert Nuster , Günther Paltauf , Markus Haltmeier

Low-rank approximation of images via singular value decomposition is well-received in the era of big data. However, singular value decomposition (SVD) is only for order-two data, i.e., matrices. It is necessary to flatten a higher order…

Machine Learning · Computer Science 2022-08-26 Liang Liao , Sen Lin , Lun Li , Xiuwei Zhang , Song Zhao , Yan Wang , Xinqiang Wang , Qi Gao , Jingyu Wang

A heuristic procedure based on novel recursive formulation of sinusoid (RFS) and on regression with predictive least-squares (LS) enables to decompose both uniformly and nonuniformly sampled 1-d signals into a sparse set of sinusoids (SSS).…

Information Theory · Computer Science 2017-04-13 Ivan Maric

Wireless sensor networks are widely adopted in military, civilian and commercial applications, which fuels an exponential explosion of sensory data. However, a major challenge to deploy effective sensing systems is the presence of {\em…

Information Theory · Computer Science 2015-09-15 Xiao-Yang Liu , Xiaodong Wang , Linghe Kong , Meikang Qiu , Min-You Wu

The oriented singular value decomposition (O-SVD) proposed by Zeng and Ng provides a hybrid approach to the t-product based third-order tensor singular value decomposition with the transform matrix being a factor matrix of the higher order…

Numerical Analysis · Mathematics 2023-02-28 Minghui Ding , Yimin Wei , Pengpeng Xie

Large language models (LLMs) have demonstrated impressive capabilities in a wide range of downstream natural language processing tasks. Nevertheless, their considerable sizes and memory demands hinder practical deployment, underscoring the…

Computation and Language · Computer Science 2026-03-17 Haolei Bai , Siyong Jian , Tuo Liang , Yu Yin , Huan Wang

With the first year of data taking at the LHC by the experiments, unfolding methods for measured spectra are reconsidered with much interest. Here, we present a novel ROOT-based implementation of the Singular Value Decomposition approach to…

Data Analysis, Statistics and Probability · Physics 2011-12-13 Kerstin Tackmann , Andreas Hoecker

Dictionary learning and component analysis are part of one of the most well-studied and active research fields, at the intersection of signal and image processing, computer vision, and statistical machine learning. In dictionary learning,…

Machine Learning · Statistics 2017-07-27 Mehdi Bahri , Yannis Panagakis , Stefanos Zafeiriou

In the framework of multidimensional Compressed Sensing (CS), we introduce an analytical reconstruction formula that allows one to recover an $N$th-order $(I_1\times I_2\times \cdots \times I_N)$ data tensor $\underline{\mathbf{X}}$ from a…

Information Theory · Computer Science 2015-06-19 Cesar F. Caiafa , Andrzej Cichocki

A well known result from functional analysis states that any compact operator between Hilbert spaces admits a singular value decomposition (SVD). This decomposition is a powerful tool that is the workhorse of many methods both in…

Functional Analysis · Mathematics 2022-03-25 Mazen Ali , Anthony Nouy

Least squares (LS) fitting is one of the most fundamental techniques in science and engineering. It is used to estimate parameters from multiple noisy observations. In many problems the parameters are known a-priori to be bounded integer…

Information Theory · Computer Science 2009-01-05 Amir Leshem , Jacob Goldberger

Low-rank decomposition has emerged as an important problem in Large Language Model (LLM) fine-tuning and inference. Through Singular Value Decomposition (SVD), the weight matrix can be factorized into low-rank spaces optimally. Previously,…

Machine Learning · Computer Science 2026-04-02 Yuhang Li , Donghyun Lee , Ruokai Yin , Priyadarshini Panda

The spectral decomposition of a real skew-symmetric matrix $A$ can be mathematically transformed into a specific structured singular value decomposition (SVD) of $A$. Based on such equivalence, a skew-symmetric Lanczos bidiagonalization…

Numerical Analysis · Mathematics 2024-08-20 Jinzhi Huang , Zhongxiao Jia

Higher order singular value decomposition (HOSVD) is an important tool for analyzing big data in multilinear algebra and machine learning. In this paper, we present two quantum algorithms for HOSVD. Our methods allow one to decompose a…

Quantum Physics · Physics 2020-04-07 Lejia Gu , Xiaoqiang Wang , H. W. Joseph Lee , Guofeng Zhang

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

In this paper, we propose a novel low complexity scaling strategy of min-sum decoding algorithm for irregular LDPC codes. In the proposed method, we generalize our previously proposed simplified Variable Scaled Min-Sum (SVS-min-sum) by…

Information Theory · Computer Science 2015-01-30 Ahmed A. Emran , Maha Elsabrouty

We consider online change detection of high dimensional data streams with sparse changes, where only a subset of data streams can be observed at each sensing time point due to limited sensing capacities. On the one hand, the detection…

Machine Learning · Statistics 2020-09-23 Jie Guo , Hao Yan , Chen Zhang , Steven Hoi

Solving compressible flows containing both smooth and discontinuous flow structures remains a significant challenge for finite volume methods. Godunov-type finite volume methods are commonly used for numerical simulations of compressible…

Fluid Dynamics · Physics 2025-02-07 Minsheng Huang , Lidong Cheng , Wenjun Ying , Xi Deng , Feng Xiao

Solving high-dimensional dynamical systems in multi-query or real-time applications requires efficient surrogate modelling techniques, as e.g., achieved via model order reduction (MOR). If these systems are Hamiltonian systems their…

Numerical Analysis · Mathematics 2024-05-20 Robin Herkert , Patrick Buchfink , Bernard Haasdonk , Johannes Rettberg , Jörg Fehr

The singular value decomposition (SVD) of large-scale matrices is a key tool in data analytics and scientific computing. The rapid growth in the size of matrices further increases the need for developing efficient large-scale SVD…

Numerical Analysis · Mathematics 2016-08-31 Ting-Li Chen , Dawei D. Chang , Su-Yun Huang , Hung Chen , Chienyao Lin , Weichung Wang