English
Related papers

Related papers: Comparing Measures of Sparsity

200 papers

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

Applications · Statistics 2017-04-04 Emiliano Diaz

The performance of image based stereo estimation suffers from lighting variations, repetitive patterns and homogeneous appearance. Moreover, to achieve good performance, stereo supervision requires sufficient densely-labeled data, which are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Yu-Kai Huang , Yueh-Cheng Liu , Tsung-Han Wu , Hung-Ting Su , Winston H. Hsu

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

Machine Learning · Computer Science 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos

This paper studies the question of how well a signal can be reprsented by a sparse linear combination of reference signals from an overcomplete dictionary. When the dictionary size is exponential in the dimension of signal, then the exact…

Information Theory · Computer Science 2009-05-14 Halyun Jeong , Young-Han Kim

Compressed sensing (CS) shows that a signal having a sparse or compressible representation can be recovered from a small set of linear measurements. In classical CS theory, the sampling matrix and representation matrix are assumed to be…

Information Theory · Computer Science 2015-07-03 Yipeng Liu

We investigate the information content of various cosmic shear statistics on the theory of gravity. Focusing on the Hu-Sawicki-type $f(R)$ model, we perform a set of ray-tracing simulations and measure the convergence bispectrum, peak…

Cosmology and Nongalactic Astrophysics · Physics 2017-01-25 Masato Shirasaki , Takahiro Nishimichi , Baojiu Li , Yuichi Higuchi

Compressive sensing (CS) exploits sparsity to recover sparse or compressible signals from dimensionality reducing, non-adaptive sensing mechanisms. Sparsity is also used to enhance interpretability in machine learning and statistics…

Information Theory · Computer Science 2015-07-21 Anastasios Kyrillidis , Luca Baldassarre , Marwa El-Halabi , Quoc Tran-Dinh , Volkan Cevher

In many applications, one is faced with an inverse problem, where the known signal depends in a bilinear way on two unknown input vectors. Often at least one of the input vectors is assumed to be sparse, i.e., to have only few non-zero…

Information Theory · Computer Science 2018-04-25 Jakob Geppert , Felix Krahmer , Dominik Stöger

The detection of galactic binaries as sources of gravitational waves promises an unprecedented wealth of information about these systems, but also raises several challenges in signal processing. In particular the large number of expected…

General Relativity and Quantum Cosmology · Physics 2020-11-25 A. Blelly , J. Bobin , H. Moutarde

Limited measurement availability at the distribution grid presents challenges for state estimation and situational awareness. This paper combines the advantages of two sparsity-based state estimation approaches (matrix completion and…

Systems and Control · Electrical Eng. & Systems 2021-04-15 Shweta Dahale , Balasubramaniam Natarajan

We present a new cosmological probe for galaxy clusters, the halo sparsity. This characterises halos in terms of the ratio of halo masses measured at two different radii and carries cosmological information encoded in the halo mass profile.…

Cosmology and Nongalactic Astrophysics · Physics 2018-08-08 P. S. Corasaniti , S. Ettori , Y. Rasera , M. Sereno , S. Amodeo , M. -A. Breton , V. Ghirardini , D. Eckert

Binary 0-1 measurement matrices, especially those from coding theory, were introduced to compressed sensing (CS) recently. Good measurement matrices with preferred properties, e.g., the restricted isometry property (RIP) and nullspace…

Information Theory · Computer Science 2013-09-24 Xin-Ji Liu , Shu-Tao Xia

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

In this work, a feature extraction method for offline signature verification is presented that harnesses the power of sparse representation in order to deliver state-of-the-art verification performance in several signature datasets like…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Elias N. Zois , Dimitrios Tsourounis , Ilias Theodorakopoulos , Anastasios Kesidis , George Economou

The problem of compressing a real-valued sparse source using compressive sensing techniques is studied. The rate distortion optimality of a coding scheme in which compressively sensed signals are quantized and then reconstructed is…

Information Theory · Computer Science 2010-11-09 Rajiv Soundararajan , Sriram Vishwanath

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

Expand-and-sparsify representations are a class of theoretical models that capture sparse representation phenomena observed in the sensory systems of many animals. At a high level, these representations map an input $x \in \mathbb{R}^d$ to…

Statistics Theory · Mathematics 2026-03-20 Kaushik Sinha , Christopher Tosh

This work studies the problem of learning appropriate low dimensional image representations. We propose a generic algorithmic framework, which leverages two classic representation learning paradigms, i.e., sparse representation and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Xian Wei , Hao Shen , Martin Kleinsteuber

We propose new compressive parameter estimation algorithms that make use of polar interpolation to improve the estimator precision. Our work extends previous approaches involving polar interpolation for compressive parameter estimation in…

Information Theory · Computer Science 2016-11-17 Karsten Fyhn , Marco F. Duarte , Søren Holdt Jensen

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

Machine Learning · Statistics 2008-05-21 Dapo Omidiran , Martin J. Wainwright