English
Related papers

Related papers: A null space analysis of the L1 synthesis method i…

200 papers

Large Language Models have demonstrated remarkable progress in general-purpose capabilities and can achieve strong performance in specific domains through fine-tuning on domain-specific data. However, acquiring high-quality data for target…

Artificial Intelligence · Computer Science 2026-05-29 Tong Ye , Hang Yu , Tengfei Ma , Xuhong Zhang , Jianguo Li , Peng Di , Peiyu Liu , Jianwei Yin , Wenhai Wang

Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging. Compressed sensing…

Machine Learning · Computer Science 2015-10-26 Saiprasad Ravishankar , Yoram Bresler

Compressive sensing is a powerful technique for recovering sparse solutions of underdetermined linear systems, which is often encountered in uncertainty quantification analysis of expensive and high-dimensional physical models. We perform…

The success of deep learning requires high-quality annotated and massive data. However, the size and the quality of a dataset are usually a trade-off in practice, as data collection and cleaning are expensive and time-consuming. In…

Computation and Language · Computer Science 2023-06-16 Ruibin Yuan , Hanzhi Yin , Yi Wang , Yifan He , Yushi Ye , Lei Zhang , Zhizheng Wu

Large Language Models (LLMs) have demonstrated remarkable proficiency in language comprehension and generation; however, their widespread adoption is constrained by substantial bandwidth and computational demands. While pruning and low-rank…

Computation and Language · Computer Science 2025-10-31 Zeliang Zong , Kai Zhang , Zheyang Li , Wenming Tan , Ye Ren , Yiyan Zhai , Jilin Hu

We present a simple and effective algorithm for the problem of \emph{sparse robust linear regression}. In this problem, one would like to estimate a sparse vector $w^* \in \mathbb{R}^n$ from linear measurements corrupted by sparse noise…

Data Structures and Algorithms · Computer Science 2019-01-08 Sushrut Karmalkar , Eric Price

In compressed sensing sparse solutions are usually obtained by solving an $\ell^1$-minimization problem. Furthermore, the sparsity of the signal does need not be directly given. In fact, it is sufficient to have a signal that is sparse…

Information Theory · Computer Science 2016-09-21 Jackie Ma

We examine the text-free speech representations of raw audio obtained from a self-supervised learning (SSL) model by analyzing the synthesized speech using the SSL representations instead of conventional text representations. Since raw…

Computation and Language · Computer Science 2024-12-05 Joonyong Park , Daisuke Saito , Nobuaki Minematsu

Compressive sensing involves the inversion of a mapping $SD \in \mathbb{R}^{m \times n}$, where $m < n$, $S$ is a sensing matrix, and $D$ is a sparisfying dictionary. The restricted isometry property is a powerful sufficient condition for…

Information Theory · Computer Science 2022-07-13 Jinn Ho , Wen-Liang Hwang

Reliable and energy-efficient wireless data transmission remains a major challenge in resource-constrained wireless neural recording tasks, where data compression is generally adopted to relax the burdens on the wireless data link.…

Information Theory · Computer Science 2016-02-02 Biao Sun , Wenfeng Zhao , Xinshan Zhu

Sparse binary matrices are of great interest in the field of sparse recovery, nonnegative compressed sensing, statistics in networks, and theoretical computer science. This class of matrices makes it possible to perform signal recovery with…

Information Theory · Computer Science 2024-12-09 Pedro Abdalla

High-dimensional data often lie in low-dimensional subspaces corresponding to different classes they belong to. Finding sparse representations of data points in a dictionary built using the collection of data helps to uncover…

Machine Learning · Statistics 2016-02-16 Ehsan Elhamifar , Mahdi Soltanolkotabi , Shankar Sastry

We generalize the system level synthesis framework to systems defined by bounded causal linear operators, and use this parameterization to make connections between robust system level synthesis and classical results from the robust control…

Optimization and Control · Mathematics 2020-05-15 Nikolai Matni , Anish A. Sarma

Compressed sensing is a technique for recovering a high-dimensional signal from lower-dimensional data, whose components represent partial information about the signal, utilizing prior knowledge on the sparsity of the signal. For further…

Information Theory · Computer Science 2014-02-18 Yingying Xu , Yoshiyuki Kabashima

Tensor completion is a fundamental tool for incomplete data analysis, where the goal is to predict missing entries from partial observations. However, existing methods often make the explicit or implicit assumption that the observed entries…

Machine Learning · Statistics 2022-03-18 Yuning Qiu , Guoxu Zhou , Qibin Zhao , Shengli Xie

This paper investigates the problem of recovering the support of structured signals via adaptive compressive sensing. We examine several classes of structured support sets, and characterize the fundamental limits of accurately recovering…

Statistics Theory · Mathematics 2016-09-05 Rui M. Castro , Ervin Tánczos

Sparsity driven signal processing has gained tremendous popularity in the last decade. At its core, the assumption is that the signal of interest is sparse with respect to either a fixed transformation or a signal dependent dictionary. To…

Computer Vision and Pattern Recognition · Computer Science 2014-06-10 Yuanming Suo , Minh Dao , Umamahesh Srinivas , Vishal Monga , Trac D. Tran

In this note, we address the theoretical properties of $\Delta_p$, a class of compressed sensing decoders that rely on $\ell^p$ minimization with 0<p<1 to recover estimates of sparse and compressible signals from incomplete and inaccurate…

Information Theory · Computer Science 2009-08-10 Rayan Saab , Ozgur Yilmaz

The goal of compressed sensing is to estimate a vector from an underdetermined system of noisy linear measurements, by making use of prior knowledge on the structure of vectors in the relevant domain. For almost all results in this…

Machine Learning · Statistics 2017-03-10 Ashish Bora , Ajil Jalal , Eric Price , Alexandros G. Dimakis

Deep compressed sensing assumes the data has sparse representation in a latent space, i.e., it is intrinsically of low-dimension. The original data is assumed to be mapped from a low-dimensional space through a low-to-high-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2021-06-22 Ashkan Esmaeili