English
Related papers

Related papers: C-HiLasso: A Collaborative Hierarchical Sparse Mod…

200 papers

Recent breakthrough results in compressed sensing (CS) have established that many high dimensional objects can be accurately recovered from a relatively small number of non- adaptive linear projection observations, provided that the objects…

Machine Learning · Statistics 2011-11-30 Akshay Soni , Jarvis Haupt

Standard high-dimensional regression methods assume that the underlying coefficient vector is sparse. This might not be true in some cases, in particular in presence of hidden, confounding variables. Such hidden confounding can be…

Methodology · Statistics 2020-08-19 Domagoj Ćevid , Peter Bühlmann , Nicolai Meinshausen

This paper presents a new Bayesian collaborative sparse regression method for linear unmixing of hyperspectral images. Our contribution is twofold; first, we propose a new Bayesian model for structured sparse regression in which the…

Computation · Statistics 2023-07-19 Yoann Altmann , Marcelo Pereyra , Jose Bioucas-Dias

Sparse coding has been popularly used as an effective data representation method in various applications, such as computer vision, medical imaging and bioinformatics, etc. However, the conventional sparse coding algorithms and its manifold…

Computer Vision and Pattern Recognition · Computer Science 2013-04-04 Jing-Yan Wang

Subspace clustering refers to the problem of segmenting data drawn from a union of subspaces. State-of-the-art approaches for solving this problem follow a two-stage approach. In the first step, an affinity matrix is learned from the data…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Chun-Guang Li , Chong You , René Vidal

This article aims to provide a comprehensive overview of sparse optimization, with a focus on both sparse signal recovery and sparse regularization techniques. We will begin by exploring the foundations of sparse optimization, delving into…

History and Overview · Mathematics 2026-01-13 Jun Lu

Sparse subspace clustering (SSC) is one of the current state-of-the-art methods for partitioning data points into the union of subspaces, with strong theoretical guarantees. However, it is not practical for large data sets as it requires…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Maryam Abdolali , Nicolas Gillis , Mohammad Rahmati

Compressed sensing (CS) shows that a signal having a sparse or compressible representation can be recovered from a small set of linear measurements. In classical CS theory, the sampling matrix and representation matrix are assumed to be…

Information Theory · Computer Science 2015-07-03 Yipeng Liu

This paper investigates a new learning formulation called structured sparsity, which is a natural extension of the standard sparsity concept in statistical learning and compressive sensing. By allowing arbitrary structures on the feature…

Methodology · Statistics 2009-05-05 Junzhou Huang , Tong Zhang , Dimitris Metaxas

This paper develops a theory for group Lasso using a concept called strong group sparsity. Our result shows that group Lasso is superior to standard Lasso for strongly group-sparse signals. This provides a convincing theoretical…

Machine Learning · Statistics 2009-03-17 Junzhou Huang , Tong Zhang

We consider the high-dimensional sparse linear regression problem of accurately estimating a sparse vector using a small number of linear measurements that are contaminated by noise. It is well known that the standard cadre of…

Statistics Theory · Mathematics 2014-02-25 Divyanshu Vats , Richard G. Baraniuk

Cross-correlation is a popular signal processing technique used in numerous location tracking systems for obtaining reliable range information. However, its efficient design and practical implementation has not yet been achieved on mote…

Other Computer Science · Computer Science 2016-06-14 Prasant Misra , Wen Hu , Mingrui Yang , Marco Duarte , Sanjay Jha

Existing hierarchical forecasting techniques scale poorly when the number of time series increases. We propose to learn a coherent forecast for millions of time series with a single bottom-level forecast model by using a sparse loss…

Machine Learning · Computer Science 2024-02-27 Olivier Sprangers , Wander Wadman , Sebastian Schelter , Maarten de Rijke

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

Machine Learning · Statistics 2026-01-05 Bin Luo , Susan Halabi

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requires optimizing one or…

Machine Learning · Computer Science 2023-02-22 Leland Barnard , Farwa Ali , Hugo Botha , David T. Jones

Within a supervised classification framework, labeled data are used to learn classifier parameters. Prior to that, it is generally required to perform dimensionality reduction via feature extraction. These preprocessing steps have motivated…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Adrien Lagrange , Mathieu Fauvel , Stéphane May , Nicolas Dobigeon

The convolutional sparse model has recently gained increasing attention in the signal and image processing communities, and several methods have been proposed for solving the pursuit problem emerging from it -- in particular its convex…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

We introduce a method for learning pairwise interactions in a manner that satisfies strong hierarchy: whenever an interaction is estimated to be nonzero, both its associated main effects are also included in the model. We motivate our…

Methodology · Statistics 2013-08-14 Michael Lim , Trevor Hastie

The problem of wideband massive MIMO channel estimation is considered. Targeting for low complexity algorithms as well as small training overhead, a compressive sensing (CS) approach is pursued. Unfortunately, due to the Kronecker-type…

Information Theory · Computer Science 2018-03-30 Gerhard Wunder , Ingo Roth , Axel Flinth , Mahdi Barzegar , Saeid Haghighatshoar , Giuseppe Caire , Gitta Kutyniok