English
Related papers

Related papers: Low-rank and Adaptive Sparse Signal (LASSI) Models…

200 papers

This paper addresses the problem of identifying sparse linear time-invariant (LTI) systems from a single sample trajectory generated by the system dynamics. We introduce a Lasso-like estimator for the parameters of the system, taking into…

Systems and Control · Computer Science 2019-04-23 Salar Fattahi , Nikolai Matni , Somayeh Sojoudi

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

Machine Learning · Statistics 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

Post-training compression of large language models (LLMs) often relies on low-rank weight approximations that represent each column of the weight matrix in a shared low-dimensional subspace. This strategy is computationally efficient but…

Computation and Language · Computer Science 2026-05-05 Denis Makhov , Dmitriy Shopkhoev , Magauiya Zhussip , Ammar Ali , Stamatios Lefkimmiatis

In many signal processing applications, one wishes to acquire images that are sparse in transform domains such as spatial finite differences or wavelets using frequency domain samples. For such applications, overwhelming empirical evidence…

Computer Vision and Pattern Recognition · Computer Science 2013-10-22 Felix Krahmer , Rachel Ward

Motivation: The high dimensionality of genomic data calls for the development of specific classification methodologies, especially to prevent over-optimistic predictions. This challenge can be tackled by compression and variable selection,…

Methodology · Statistics 2021-04-10 G. Durif , L. Modolo , J. Michaelsson , J. E. Mold , S. Lambert-Lacroix , F. Picard

Bridging the gap between data-rich training regimes and observation-sparse deployment conditions remains a central challenge in spatiotemporal field reconstruction, particularly when target domains exhibit distributional shifts,…

Machine Learning · Computer Science 2026-01-30 Xingyue Zhang , Yuxuan Bao , Mars Liyao Gao , J. Nathan Kutz

Sparse linear regression with ill-conditioned Gaussian random designs is widely believed to exhibit a statistical/computational gap, but there is surprisingly little formal evidence for this belief, even in the form of examples that are…

Data Structures and Algorithms · Computer Science 2022-03-08 Jonathan A. Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Adapting Vision-Language Models (VLMs) to new domains with few labeled samples remains a significant challenge due to severe overfitting and computational constraints. State-of-the-art solutions, such as low-rank reparameterization,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Nairouz Mrabah , Nicolas Richet , Ismail Ben Ayed , Éric Granger

The paper introduces a framework for the recoverability analysis in compressive sensing for imaging applications such as CI cameras, rapid MRI and coded apertures. This is done using the fact that the Spherical Section Property (SSP) of a…

Information Theory · Computer Science 2012-12-07 Mahdi S. Hosseini , Konstantinos N. Plataniotis

In this age of information, images are a critical medium for storing and transmitting information. With the rapid growth of image data amount, visual compression and visual data perception are two important research topics attracting a lot…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Yuefeng Zhang , Chuanmin Jia , Jiannhui Chang , Siwei Ma

Many applications of machine learning involve the analysis of large data frames-matrices collecting heterogeneous measurements (binary, numerical, counts, etc.) across samples-with missing values. Low-rank models, as studied by Udell et al.…

Machine Learning · Statistics 2018-12-21 Geneviève Robin , Hoi-To Wai , Julie Josse , Olga Klopp , Éric Moulines

Sparse representation has attracted great attention because it can greatly save storage resources and find representative features of data in a low-dimensional space. As a result, it may be widely applied in engineering domains including…

Neural and Evolutionary Computing · Computer Science 2022-11-09 Chunming Jiang , Yilei Zhang

We develop a Bayesian nonparametric model for reconstructing magnetic resonance images (MRI) from highly undersampled k-space data. We perform dictionary learning as part of the image reconstruction process. To this end, we use the beta…

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Yue Huang , John Paisley , Qin Lin , Xinghao Ding , Xueyang Fu , Xiao-ping Zhang

Parametric images provide insight into the spatial distribution of physiological parameters, but they are often extremely noisy, due to low SNR of tomographic data. Direct estimation from projections allows accurate noise modeling,…

This work develops a fast, memory-efficient, and general algorithm for accelerated/undersampled dynamic MRI by assuming an approximate LR model on the matrix formed by the vectorized images of the sequence. By general, we mean that our…

Image and Video Processing · Electrical Eng. & Systems 2025-02-28 Silpa Babu , Sajan Goud Lingala , Namrata Vaswani

This paper aims at developing a clustering approach with spectral images directly from the compressive measurements of coded aperture snapshot spectral imager (CASSI). Assuming that compressed measurements often lie approximately in low…

Image and Video Processing · Electrical Eng. & Systems 2020-09-30 Jianchen Zhu

We propose and analyze an online algorithm for reconstructing a sequence of signals from a limited number of linear measurements. The signals are assumed sparse, with unknown support, and evolve over time according to a generic nonlinear…

Optimization and Control · Mathematics 2015-03-12 Joao F. C. Mota , Nikos Deligiannis , Aswin C. Sankaranarayanan , Volkan Cevher , Miguel R. D. Rodrigues

We consider a compressive hyperspectral imaging reconstruction problem, where three-dimensional spatio-spectral information about a scene is sensed by a coded aperture snapshot spectral imager (CASSI). The CASSI imaging process can be…

Information Theory · Computer Science 2016-04-20 Jin Tan , Yanting Ma , Hoover Rueda , Dror Baron , Gonzalo Arce

Magnetic resonance imaging (MRI) is a powerful imaging modality that revolutionizes medicine and biology. The imaging speed of high-dimensional MRI is often limited, which constrains its practical utility. Recently, low-rank tensor models…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Zichang He , Bo Zhao , Zheng Zhang

Compressed sensing is a novel technique where one can recover sparse signals from the undersampled measurements. In this correspondence, a $K \times N$ measurement matrix for compressed sensing is deterministically constructed via additive…

Information Theory · Computer Science 2010-10-04 Nam Yul Yu