English
Related papers

Related papers: Capacity-achieving sparse superposition codes with…

200 papers

Sparse code multiple access (SCMA) is a new frequency domain non-orthogonal multiple-access technique which can improve spectral efficiency of wireless radio access. With SCMA, different incoming data streams are directly mapped to…

Information Theory · Computer Science 2016-11-18 Hosein Nikopour , Eric Yi , Alireza Bayesteh , Kelvin Au , Mark Hawryluck , Hadi Baligh , Jianglei Ma

This paper presents a code generator for sparse tensor contraction computations. It leverages a mathematical representation of loop nest computations in the sparse polyhedral framework (SPF), which extends the polyhedral model to support…

Programming Languages · Computer Science 2022-08-26 Tuowen Zhao , Tobi Popoola , Mary Hall , Catherine Olschanowsky , Michelle Mills Strout

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong

This paper addresses spatial programming of sparse matrix computations for productive performance. The challenge is how to express an irregular computation and its optimizations in a regular way. A sparse matrix has (non-zero) values and a…

Mathematical Software · Computer Science 2018-10-18 Hongbo Rong

Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing. However, existing methods have limited scalability. In this paper, instead of convolving with a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

Recursive projection aggregation (RPA) decoding as introduced in [1] is a novel decoding algorithm which performs close to the maximum likelihood decoder for short-length Reed-Muller codes. Recently, an extension to RPA decoding, called…

Information Theory · Computer Science 2022-11-03 Johannes Voigt , Holger Jäkel , Laurent Schmalen

How to improve generative modeling by better exploiting spatial regularities and coherence in images? We introduce a novel neural network for building image generators (decoders) and apply it to variational autoencoders (VAEs). In our…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Đorđe Miladinović , Aleksandar Stanić , Stefan Bauer , Jürgen Schmidhuber , Joachim M. Buhmann

In compressed sensing (CS), sparse signals can be reconstructed from significantly fewer samples than required by the Nyquist-Shannon sampling theorem. While non-sparse signals can be sparsely represented in appropriate transformation…

Information Theory · Computer Science 2026-03-13 Qi Qi , Abdelhamid Tayebi , Daizhan Cheng , Jun-e Feng

In this letter, we introduce the computational-limited (comp-limited) signals, a communication capacity regime in which the signal time computational complexity overhead is the key constraint -- rather than power or bandwidth -- to the…

Information Theory · Computer Science 2024-10-28 Saulo Queiroz , João P. Vilela , Edmundo Monteiro

This paper proposes Bayes-optimal convolutional approximate message-passing (CAMP) for signal recovery in compressed sensing. CAMP uses the same low-complexity matched filter (MF) for interference suppression as approximate message-passing…

Information Theory · Computer Science 2021-04-05 Keigo Takeuchi

Sparse regression codes with approximate message passing (AMP) decoding have gained much attention in recent times. The concepts underlying this coding scheme extend to unsourced random access with coded compressed sensing (CCS), as first…

Information Theory · Computer Science 2020-10-12 Vamsi K. Amalladinne , Asit Kumar Pradhan , Cynthia Rush , Jean-Francois Chamberland , Krishna R. Narayanan

Sparse codes in neuroscience have been suggested to offer certain computational advantages over other neural representations of sensory data. To explore this viewpoint, a sparse code is used to represent natural images in an optimal control…

Machine Learning · Computer Science 2021-01-08 Peter N. Loxley

We consider the high-dimensional sparse linear regression problem of accurately estimating a sparse vector using a small number of linear measurements that are contaminated by noise. It is well known that the standard cadre of…

Statistics Theory · Mathematics 2014-02-25 Divyanshu Vats , Richard G. Baraniuk

In this paper, we propose a learning approach for sparse code multiple access (SCMA) signal detection by using a deep neural network via unfolding the procedure of message passing algorithm (MPA). The MPA can be converted to a sparsely…

Information Theory · Computer Science 2018-08-27 Chao Lu , Wei Xu , Hong Shen , Hua Zhang , Xiaohu You

In existing semantic communication systems for image transmission, some images are generally reconstructed with considerably low quality. As a result, the reliable transmission of each image cannot be guaranteed, bringing significant…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Guangyi Zhang , Qiyu Hu , Yunlong Cai , Guanding Yu

In this paper, we introduce DICOD, a convolutional sparse coding algorithm which builds shift invariant representations for long signals. This algorithm is designed to run in a distributed setting, with local message passing, making it…

Machine Learning · Computer Science 2018-05-15 Thomas Moreau , Laurent Oudre , Nicolas Vayatis

Spatially-coupled (SC) codes are constructed by coupling many regular low-density parity-check codes in a chain. The decoding chain of SC codes stops when facing burst erasures. This problem can not be overcome by increasing coupling…

Information Theory · Computer Science 2013-02-07 Ryunosuke Ohashi , Kenta Kasai , Keigo Takeuchi

Nowadays polar codes are becoming one of the most favorable capacity achieving error correction codes for their low encoding and decoding complexity. However, due to the large code length required by practical applications, the few existing…

Hardware Architecture · Computer Science 2011-11-04 Chuan Zhang , Bo Yuan , Keshab K. Parhi

Convolution operations are foundational to classical image processing and modern deep learning architectures, yet their extension into the quantum domain has remained algorithmically and physically costly due to inefficient data encoding…

Quantum Physics · Physics 2025-07-29 Mohammad Rasoul Roshanshah , Payman Kazemikhah , Hossein Aghababa

Compressive Sensing (CS) theory states that real-world signals can often be recovered from much fewer measurements than those suggested by the Shannon sampling theorem. Nevertheless, recoverability does not only depend on the signal, but…

Information Theory · Computer Science 2017-05-10 Miguel Heredia Conde , Otmar Loffeld