English
Related papers

Related papers: An Efficient Two-Stage SPARC Decoder for Massive M…

200 papers

The sparse dictionary coding framework represents signals as a linear combination of a few predefined dictionary atoms. It has been employed for images, time series, graph signals and recently for 2-way (or 2D) spatio-temporal data…

Machine Learning · Computer Science 2024-06-12 Boya Ma , Maxwell McNeil , Abram Magner , Petko Bogdanov

Linear sketching and recovery of sparse vectors with randomly constructed sparse matrices has numerous applications in several areas, including compressive sensing, data stream computing, graph sketching, and combinatorial group testing.…

Numerical Analysis · Mathematics 2014-02-07 Bubacarr Bah , Luca Baldassarre , Volkan Cevher

Sparse coding is typically solved by iterative optimization techniques, such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Unfolding and learning weights of ISTA using neural networks is a practical way to accelerate estimation.…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Thomas Moreau , Mathurin Massias , Alexandre Gramfort

Subsampled blind deconvolution is the recovery of two unknown signals from samples of their convolution. To overcome the ill-posedness of this problem, solutions based on priors tailored to specific application have been developed in…

Information Theory · Computer Science 2015-11-23 Kiryung Lee , Yanjun Li , Marius Junge , Yoram Bresler

Sparse code multiple access (SCMA) is one of the most promising methods among all the non-orthogonal multiple access techniques in the future 5G communication. Compared with some other non-orthogonal multiple access techniques such as low…

Signal Processing · Electrical Eng. & Systems 2020-02-28 Fan Wei , Wen Chen

In this paper, a derandomized algorithm for sampling decoding is proposed to achieve near-optimal performance in lattice decoding. By setting a probability threshold to sample candidates, the whole sampling procedure becomes deterministic,…

Information Theory · Computer Science 2016-11-17 Zheng Wang , Shuiyin Liu , Cong Ling

In this work, we investigate an efficient numerical approach for solving higher order statistical methods for blind and semi-blind signal recovery from non-ideal channels. We develop numerical algorithms based on convex optimization…

Information Theory · Computer Science 2016-11-17 Huy-Dung Han , Zhi Ding , Muhammad Zia

Unsourced random access (URA) is an increasingly popular communication paradigm attuned to machine driven data transfers in \textit{Internet-of-Things} (IoT) networks. In a typical URA setting, a small subset of active devices within a very…

Information Theory · Computer Science 2021-05-06 Vamsi K. Amalladinne , Jean-Francois Chamberland , Krishna R. Narayanan

The randomized coordinate descent (RCD) method is a classical algorithm with simple, lightweight iterations that is widely used for various optimization problems, including the solution of positive semidefinite linear systems. As a linear…

Numerical Analysis · Mathematics 2026-02-13 Jackie Lok , Elizaveta Rebrova

In a large-scale distributed machine learning system, coded computing has attracted wide-spread attention since it can effectively alleviate the impact of stragglers. However, several emerging problems greatly limit the performance of coded…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-10 Houming Qiu , Kun Zhu , Nguyen Cong Luong , Dusit Niyato

The problem of optimising functions with intractable gradients frequently arise in machine learning and statistics, ranging from maximum marginal likelihood estimation procedures to fine-tuning of generative models. Stochastic approximation…

Machine Learning · Statistics 2026-01-30 James Cuin , Davide Carbone , Yanbo Tang , O. Deniz Akyildiz

Sparse subspace clustering (SSC) is one of the current state-of-the-art methods for partitioning data points into the union of subspaces, with strong theoretical guarantees. However, it is not practical for large data sets as it requires…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Maryam Abdolali , Nicolas Gillis , Mohammad Rahmati

Recovery of arbitrarily positioned samples that are missing in sparse signals recently attracted significant research interest. Sparse signals with heavily corrupted arbitrary positioned samples could be analyzed in the same way as…

Information Theory · Computer Science 2013-09-24 Ljubisa Stankovic , Milos Dakovic , Stefan Vujovic

Application of the turbo principle to multiuser decoding results in an exchange of probability distributions between two sets of constraints. Firstly, constraints imposed by the multiple-access channel, and secondly, individual constraints…

Information Theory · Computer Science 2007-07-13 Adriel Kind , Alex Grant

Sparse dictionary coding represents signals as linear combinations of a few dictionary atoms. It has been applied to images, time series, graph signals and multi-way spatio-temporal data by jointly employing temporal and spatial…

Machine Learning · Computer Science 2025-09-15 Boya Ma , Abram Magner , Maxwell McNeil , Petko Bogdanov

In this paper, we introduce DICOD, a convolutional sparse coding algorithm which builds shift invariant representations for long signals. This algorithm is designed to run in a distributed setting, with local message passing, making it…

Machine Learning · Computer Science 2018-05-15 Thomas Moreau , Laurent Oudre , Nicolas Vayatis

Convolutional sparse coding (CSC) improves sparse coding by learning a shift-invariant dictionary from the data. However, existing CSC algorithms operate in the batch mode and are expensive, in terms of both space and time, on large…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

Sparse coding consists in representing signals as sparse linear combinations of atoms selected from a dictionary. We consider an extension of this framework where the atoms are further assumed to be embedded in a tree. This is achieved…

Machine Learning · Statistics 2011-08-18 Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski , Francis Bach

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as…

Machine Learning · Computer Science 2017-10-31 Jianqiao Wangni , Jialei Wang , Ji Liu , Tong Zhang

We conducted an extensive computational experiment, lasting multiple CPU-years, to optimally select parameters for two important classes of algorithms for finding sparse solutions of underdetermined systems of linear equations. We make the…

Numerical Analysis · Computer Science 2015-05-14 Arian Maleki , David L. Donoho