English
Related papers

Related papers: Sparse Superposition Codes with Binomial Dictionar…

200 papers

In this paper, we leverage polar codes and the well-established channel polarization to design capacity-achieving codes with a certain constraint on the weights of all the columns in the generator matrix (GM) while having a low-complexity…

Information Theory · Computer Science 2023-03-17 James Chin-Jen Pang , Hessam Mahdavifar , S. Sandeep Pradhan

A rateless code-i.e., a rate-compatible family of codes-has the property that codewords of the higher rate codes are prefixes of those of the lower rate ones. A perfect family of such codes is one in which each of the codes in the family is…

Information Theory · Computer Science 2011-06-07 Uri Erez , Mitchell D. Trott , Gregory W. Wornell

In this paper, we explore the mystery of synchronous CDMA as applied to wireless and optical communication systems under very general settings for the user symbols and the signature matrix entries. The channel is modeled with real/complex…

Information Theory · Computer Science 2015-03-17 K. Alishahi , S. Dashmiz , P. Pad , F. Marvasti , M. H. Shafinia , M. Mansouri

We develop a systematic approach, based on convex programming and real analysis, for obtaining upper bounds on the capacity of the binary deletion channel and, more generally, channels with i.i.d. insertions and deletions. Other than the…

Information Theory · Computer Science 2018-06-12 Mahdi Cheraghchi

We examine a generalization of the binomial distribution associated with a strictly increasing sequence of numbers and we prove its Poisson-like limit. Such generalizations might be found in quantum optics with imperfect detection. We…

Mathematical Physics · Physics 2015-05-28 E. M. F. Curado , J. P. Gazeau , Ligia M. C. S. Rodrigues

We study relationships between worst-case and random-noise properties of error correcting codes. More concretely, we consider connections between minimum distance, list decoding radius, and block error probability on noisy channels. A…

Information Theory · Computer Science 2026-04-06 Donald Kougang-Yombi , Jan Hązła

We derive a lower bound on the secrecy capacity of the compound wiretap channel with channel state information at the transmitter which matches the general upper bound on the secrecy capacity of general compound wiretap channels given by…

Information Theory · Computer Science 2011-08-10 Igor Bjelaković , Holger Boche , Jochen Sommerfeld

Hyperspectral images have far more spectral bands than ordinary multispectral images. Rich band information provides more favorable conditions for the tremendous applications. However, significant increase in the dimensionality of spectral…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Fei Li , Pingping Zhang , Huchuan Lu

This paper provides a statistical characterization of the individual achievable rates in bits/s/Hz and the spatial throughput of bipolar Poisson wireless networks in bits/s/Hz/m$^2$. We assume that all transmitters have a cognitive ability…

Information Theory · Computer Science 2014-04-29 Pedro H. J. Nardelli , Carlos H. Morais de Lima , Hirley Alves , Paulo Cardieri , Matti Latva-aho

Channels with synchronization errors, such as deletion and insertion errors, are crucial in DNA storage, data reconstruction, and other applications. These errors introduce memory to the channel, complicating its capacity analysis. This…

Information Theory · Computer Science 2025-05-13 Busra Tegin , Tolga M Duman

We address for the first time unsupervised training for a translation task with hundreds of thousands of vocabulary words. We scale up the expectation-maximization (EM) algorithm to learn a large translation table without any parallel text…

Computation and Language · Computer Science 2019-01-08 Yunsu Kim , Julian Schamper , Hermann Ney

Sparse Network Coding (SNC) has been a promising network coding scheme as an improvement for Random Linear Network Coding (RLNC) in terms of the computational complexity. However, in this literature, there has been no analytical expressions…

Information Theory · Computer Science 2019-07-30 Hadi Sehat , Peyman Pahlevani

Image enhancement approaches often assume that the noise is signal independent, and approximate the degradation model as zero-mean additive Gaussian. However, this assumption does not hold for biomedical imaging systems where sensor-based…

Image and Video Processing · Electrical Eng. & Systems 2023-04-10 Calvin-Khang Ta , Abhishek Aich , Akash Gupta , Amit K. Roy-Chowdhury

We consider communication over a noisy network under randomized linear network coding. Possible error mechanism include node- or link- failures, Byzantine behavior of nodes, or an over-estimate of the network min-cut. Building on the work…

Information Theory · Computer Science 2007-11-27 Andrea Montanari , Ruediger Urbanke

We derive bounds on the asymptotic density of parity-check matrices and the achievable rates of binary linear block codes transmitted over memoryless binary-input output-symmetric (MBIOS) channels. The lower bounds on the density of…

Information Theory · Computer Science 2007-07-13 Gil Wiechman , Igal Sason

We present a capacity-achieving coding scheme for unicast or multicast over lossy packet networks. In the scheme, intermediate nodes perform additional coding yet do not decode nor even wait for a block of packets before sending out coded…

Information Theory · Computer Science 2008-04-11 Desmond S. Lun , Muriel Medard , Ralf Koetter , Michelle Effros

We prove that for any additive noise channel over $\mathbb{F}_q$, there exist error-correcting codes approaching channel capacity encodable by arithmetic circuits (with weighted addition gates) over $\mathbb{F}_q$ of size $O(n)$ and depth…

Information Theory · Computer Science 2026-04-21 Yuan Li

The paper introduces new bounds on the asymptotic density of parity-check matrices and the achievable rates under ML decoding of binary linear block codes transmitted over memoryless binary-input output-symmetric channels. The lower bounds…

Information Theory · Computer Science 2007-07-13 Gil Wiechman , Igal Sason

Semantic hashing is an emerging technique for large-scale similarity search based on representing high-dimensional data using similarity-preserving binary codes used for efficient indexing and search. It has recently been shown that…

Machine Learning · Computer Science 2023-08-11 Ricardo Ñanculef , Francisco Mena , Antonio Macaluso , Stefano Lodi , Claudio Sartori

Sparse superposition (SS) codes provide an efficient communication scheme over the Gaussian channel, utilizing the vector approximate message passing (VAMP) decoder for rotational invariant design matrices. Previous work has established…

Information Theory · Computer Science 2025-04-21 Yuhao Liu , Teng Fu , Jie Fan , Panpan Niu , Chaowen Deng , Zhongyi Huang