English
Related papers

Related papers: Computationally Efficient Sparse Signal Recovery v…

200 papers

We propose a Multi-step Screening Procedure (MSP) for the recovery of sparse linear models in high-dimensional data. This method is based on a repeated small penalty strategy that quickly converges to an estimate within a few iterations.…

Methodology · Statistics 2019-12-13 Yuehan Yang , Ji Zhu , Edward I. George

A class of novel STAP algorithms based on sparse recovery technique were presented. Intrinsic sparsity of distribution of clutter and target energy on spatial-frequency plane was exploited from the viewpoint of compressed sensing. The…

Information Theory · Computer Science 2009-04-09 Hao Zhang , Gang Li , Huadong Meng

This paper proposes SplitSGD, a new dynamic learning rate schedule for stochastic optimization. This method decreases the learning rate for better adaptation to the local geometry of the objective function whenever a stationary phase is…

Machine Learning · Statistics 2024-02-20 Matteo Sordello , Niccolò Dalmasso , Hangfeng He , Weijie Su

We consider the problem of recovering elements of a low-dimensional model from linear measurements. From signal and image processing to inverse problems in data science, this question has been at the center of many applications. Lately,…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Yann Traonmilin , Jean François Aujol , Antoine Guennec

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

Machine Learning · Statistics 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

The problem of 1-bit compressive sampling is addressed in this paper. We introduce an optimization model for reconstruction of sparse signals from 1-bit measurements. The model targets a solution that has the least l0-norm among all signals…

Information Theory · Computer Science 2013-02-07 Lixin Shen , Bruce W. Suter

Rate-splitting multiple access (RSMA) has been proven as an effective communication scheme for 5G and beyond. However, current approaches to RSMA resource management require complicated iterative algorithms, which cannot meet the stringent…

Information Theory · Computer Science 2024-11-07 Hanwen Zhang , Mingzhe Chen , Alireza Vahid , Feng Ye , Haijian Sun

Matrix sketching is a powerful tool for reducing the size of large data matrices. Yet there are fundamental limitations to this size reduction when we want to recover an accurate estimator for a task such as least square regression. We show…

Data Structures and Algorithms · Computer Science 2024-05-10 Sachin Garg , Kevin Tan , Michał Dereziński

In compressed sensing (CS), sparse signals can be reconstructed from significantly fewer samples than required by the Nyquist-Shannon sampling theorem. While non-sparse signals can be sparsely represented in appropriate transformation…

Information Theory · Computer Science 2026-03-13 Qi Qi , Abdelhamid Tayebi , Daizhan Cheng , Jun-e Feng

Semidefinite programming (SDP) is a powerful tool for tackling a wide range of computationally hard problems such as clustering. Despite the high accuracy, semidefinite programs are often too slow in practice with poor scalability on large…

Machine Learning · Statistics 2022-02-10 Yubo Zhuang , Xiaohui Chen , Yun Yang

The Transformer has been an indispensable staple in deep learning. However, for real-life applications, it is very challenging to deploy efficient Transformers due to immense parameters and operations of models. To relieve this burden,…

Hardware Architecture · Computer Science 2022-11-01 Chao Fang , Aojun Zhou , Zhongfeng Wang

In this paper, a sparse-based method for the estimation of the parameters of multidimensional ($R$-D) modal (harmonic or damped) complex signals in noise is presented. The problem is formulated as $R$ simultaneous sparse approximations of…

Information Theory · Computer Science 2015-11-02 Souleymen Sahnoun , El-Hadi Djermoune , David Brie , Pierre Comon

Sparse signals can be recovered from a reduced set of samples by using compressive sensing algorithms. In common methods the signal is recovered in the sparse domain. A method for the reconstruction of sparse signal which reconstructs the…

Information Theory · Computer Science 2015-04-28 Ljubisa Stankovic , Milos Dakovic

Non-convex sparsity-inducing penalties have recently received considerable attentions in sparse learning. Recent theoretical investigations have demonstrated their superiority over the convex counterparts in several sparse learning…

Machine Learning · Computer Science 2013-03-20 Pinghua Gong , Changshui Zhang , Zhaosong Lu , Jianhua Huang , Jieping Ye

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Deep unrolling, or unfolding, is an emerging learning-to-optimize method that unrolls a truncated iterative algorithm in the layers of a trainable neural network. However, the convergence guarantees and generalizability of the unrolled…

Machine Learning · Computer Science 2024-12-02 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

Ultrasound computed tomography (USCT) is a promising technique that achieves superior medical imaging reconstruction resolution by fully leveraging waveform information, outperforming conventional ultrasound methods. Despite its advantages,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Yi Sheng , Hanchen Wang , Yipei Liu , Junhuan Yang , Weiwen Jiang , Youzuo Lin , Lei Yang

Compressive sensing is a technique to sample signals well below the Nyquist rate using linear measurement operators. In this paper we present an algorithm for signal reconstruction given such a set of measurements. This algorithm…

Information Theory · Computer Science 2009-06-08 Graeme Pope

We provide a novel statistical perspective on a classical problem at the intersection of computer science and information theory: recovering the empirical frequency of a symbol in a large discrete dataset using only a compressed…

Methodology · Statistics 2025-04-11 Mario Beraha , Stefano Favaro , Matteo Sesia
‹ Prev 1 8 9 10 Next ›