English
Related papers

Related papers: SVD method for sparse recovery

200 papers

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

In this paper, we propose a novel variable-separation (NVS) method for generic multivariate functions. The idea of NVS is extended to to obtain the solution in tensor product structure for stochastic partial differential equations (SPDEs).…

Numerical Analysis · Mathematics 2016-11-15 Qiuqi Li , Lijian Jiang

Storing data is particularly a challenge when dealing with image data which often involves large file sizes due to the high resolution and complexity of images. Efficient image compression algorithms are crucial to better manage data…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Zahra Golpayegani , Nizar Bouguila

We study the sparse recovery problem with an underdetermined linear system characterized by a Kronecker-structured dictionary and a Kronecker-supported sparse vector. We cast this problem into the sparse Bayesian learning (SBL) framework…

Signal Processing · Electrical Eng. & Systems 2023-08-03 Yanbin He , Geethu Joseph

In this paper we propose novel methods for completion (from limited samples) and de-noising of multilinear (tensor) data and as an application consider 3-D and 4- D (color) video data completion and de-noising. We exploit the recently…

Computer Vision and Pattern Recognition · Computer Science 2014-10-31 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

The Singular Value Decomposition is a matrix decomposition technique widely used in the analysis of multivariate data, such as complex space-time images obtained in both physical and biological systems. In this paper, we examine the…

Statistical Mechanics · Physics 2009-09-25 A. M. Sengupta , P. P. Mitra

Understanding and modeling complex dynamic systems is crucial for enhancing vehicle performance and safety, especially in the context of autonomous driving. Recently, popular methods such as Koopman operators and their approximators, known…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Chinnawut Nantabut

In this paper, we study the problem of image recovery from given partial (corrupted) observations. Recovering an image using a low-rank model has been an active research area in data analysis and machine learning. But often, images are not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Pawan Goyal , Hussam Al Daas , Peter Benner

The deployment of Large Language Models is constrained by the memory and bandwidth demands of static weights and dynamic Key-Value cache. SVD-based compression provides a hardware-friendly solution to reduce these costs. However, existing…

Computation and Language · Computer Science 2026-04-03 Ruoling Qi , Yirui Liu , Xuaner Wu , Xiangyu Wang , Ming Li , Chen Chen , Jian Chen , Yin Chen , Qizhen Weng

Classical data analysis requires computational efforts that become intractable in the age of Big Data. An essential task in time series analysis is the extraction of physically meaningful information from a noisy time series. One algorithm…

Matrix factorizations in dual number algebra, a hypercomplex system, have been applied to kinematics, mechanisms, and other fields recently. We develop an approach to identify spatiotemporal patterns in the brain such as traveling waves…

Numerical Analysis · Mathematics 2023-08-21 Tong Wei , Weiyang Ding , Yimin Wei

Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy. Besides of this insight, it can be used as a good initial guess for the network…

Machine Learning · Computer Science 2019-09-16 Bernhard Bermeitinger , Tomas Hrycej , Siegfried Handschuh

Computing eigenvalue decomposition (EVD) of a given linear operator, or finding its leading eigenvalues and eigenfunctions, is a fundamental task in many machine learning and scientific computing problems. For high-dimensional eigenvalue…

Machine Learning · Computer Science 2024-08-22 J. Jon Ryu , Xiangxiang Xu , H. S. Melihcan Erol , Yuheng Bu , Lizhong Zheng , Gregory W. Wornell

The earlier works in the context of low-rank-sparse-decomposition (LRSD)-driven stationary synthetic aperture radar (SAR) imaging have shown significant improvement in the reconstruction-decomposition process. Neither of the proposed…

Image and Video Processing · Electrical Eng. & Systems 2025-12-12 Hamid Reza Hashempour , Majid Moradikia , Hamed Bastami , Ahmed Abdelhadi , Mojtaba Soltanalian

An algorithm of the tensor renormalization group is proposed based on a randomized algorithm for singular value decomposition. Our algorithm is applicable to a broad range of two-dimensional classical models. In the case of a square…

Statistical Mechanics · Physics 2018-03-23 Satoshi Morita , Ryo Igarashi , Hui-Hai Zhao , Naoki Kawashima

Learning a dynamical system from input/output data is a fundamental task in the control design pipeline. In the partially observed setting there are two components to identification: parameter estimation to learn the Markov parameters, and…

Optimization and Control · Mathematics 2021-09-08 Han Wang , James Anderson

We consider cost-constrained sparse sensor selection for full-state reconstruction, applying a well-known greedy algorithm to dynamical systems for which the usual singular value decomposition (SVD) basis may not be available or preferred.…

Optimization and Control · Mathematics 2020-03-20 Emily Clark , J. Nathan Kutz , Steven L. Brunton

Regularization techniques help prevent overfitting and therefore improve the ability of convolutional neural networks (CNNs) to generalize. One reason for overfitting is the complex co-adaptations among different parts of the network, which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Rinor Cakaj , Jens Mehnert , Bin Yang

In usual (non-stochastic) tensor network calculations, the truncated singular value decomposition (SVD) is often used for approximating a tensor, and it causes systematic errors. By introducing stochastic noise in the approximation,…

High Energy Physics - Lattice · Physics 2023-07-05 Erika Arai , Hiroshi Ohki , Shinji Takeda , Masaaki Tomii

We present and analyze a novel sparse polynomial technique for approximating high-dimensional Hilbert-valued functions, with application to parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our…

Numerical Analysis · Mathematics 2020-01-22 Nick Dexter , Hoang Tran , Clayton Webster