English
Related papers

Related papers: Exact Exponent for Soft Covering

200 papers

We consider ensembles of channel codes that are partitioned into bins, and focus on analysis of exact random coding error exponents associated with optimum decoding of the index of the bin to which the transmitted codeword belongs. Two main…

Information Theory · Computer Science 2016-11-18 Neri Merhav

This paper studies higher-order inference properties of nonparametric local polynomial regression methods under random sampling. We prove Edgeworth expansions for $t$ statistics and coverage error expansions for interval estimators that (i)…

Econometrics · Economics 2021-07-26 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

We study a quantity called discrete layered entropy, which approximates the Shannon entropy within a logarithmic gap. Compared to the Shannon entropy, the discrete layered entropy is piecewise linear, approximates the expected length of the…

Information Theory · Computer Science 2026-01-27 Cheuk Ting Li

An elementary proof of the attainability of random coding exponent with linear codes for additive channels is presented. The result and proof are from Hamada (Proc. ITW, Chendu, China, 2006), and the present material explains the proof in…

Information Theory · Computer Science 2010-01-13 Mitsuru Hamada

In extension of the bit commitment task and following work initiated by Crepeau and Kilian, we introduce and solve the problem of characterising the optimal rate at which a discrete memoryless channel can be used for bit commitment. It…

Cryptography and Security · Computer Science 2007-05-23 Andreas Winter , Anderson C. A. Nascimento , Hideki Imai

It is well-known that an algorithm exists which approximates the NP-complete problem of Set Cover within a factor of ln(n), and it was recently proven that this approximation ratio is optimal unless P = NP. This optimality result is the…

Computational Complexity · Computer Science 2021-11-30 Erika Melder

We prove Chernoff style exponential concentration bounds for classical quantum soft covering generalising previous works which gave bounds only in expectation. Our first result is an exponential concentration bound for fully smooth…

Quantum Physics · Physics 2025-04-08 Pranab Sen

We consider a generalization of the discrete memoryless channel, in which the channel probability distribution is replaced by a uniform distribution over clouds of channel output sequences. For a random ensemble of such channels, we derive…

Information Theory · Computer Science 2022-09-22 Sergey Tridenski , Anelia Somekh-Baruch

In this paper we obtain a lower bound of exponent of average probability of error for classical quantum multiple access channel, which implies that for all rate pairs in the capacity region is achievable by a code with exponential…

Quantum Physics · Physics 2017-02-08 Masahito Hayashi , Ning Cai

The information bottleneck channel, also known as oblivious relaying, is a two-hop channel where a transmitter sends messages to a remote receiver via an intermediate relay node. A codeword sent by the transmitter passes through a discrete…

Information Theory · Computer Science 2025-12-16 Han Wu , Hamdi Joudeh

This paper shows the strong converse and the dispersion of memoryless channels with cost constraints and performs refined analysis of the third order term in the asymptotic expansion of the maximum achievable channel coding rate, showing…

Information Theory · Computer Science 2015-10-09 Victoria Kostina , Sergio Verdú

Uncertain wiretap channels are introduced. Their zero-error secrecy capacity is defined. If the sensor-estimator channel is perfect, it is also calculated. Further properties are discussed. The problem of estimating a dynamical system with…

Recently, the secrecy capacity of the multi-antenna wiretap channel was characterized by Khisti and Wornell [1] using a Sato-like argument. This note presents an alternative characterization using a channel enhancement argument. This…

Information Theory · Computer Science 2007-10-23 Tie Liu , Shlomo Shamai

When information is to be transmitted over an unknown, possibly unreliable channel, an erasure option at the decoder is desirable. Using constant-composition random codes, we propose a generalization of Csiszar and Korner's Maximum Mutual…

Information Theory · Computer Science 2016-11-17 Pierre Moulin

A fundamental tool in network information theory is the covering lemma, which lower bounds the probability that there exists a pair of random variables, among a give number of independently generated candidates, falling within a given set.…

Information Theory · Computer Science 2019-04-18 Jingbo Liu , Mohammad H. Yassaee , Sergio Verdú

We extend a low-rate improvement of the random coding bound on the reliability of a classical discrete memoryless channel to its quantum counterpart. The key observation that we make is that the problem of bounding below the error exponent…

Quantum Physics · Physics 2007-05-23 Alexander Barg

The error performance of the ensemble of typical LDPC codes transmitted over the binary erasure channel (BEC) is analyzed. In the past, lower bounds on the error exponents were derived. In this paper a probabilistic upper bound on this…

Information Theory · Computer Science 2008-03-18 Idan Goldenberg , David Burshtein

We give a complete solution to an open problem of Thomas Cover in 1987 about the capacity of a relay channel in the general discrete memoryless setting without any additional assumptions. The key step in our approach is to lower bound a…

Information Theory · Computer Science 2022-02-02 Jingbo Liu

We consider the redundancy of the exact channel synthesis problem under an i.i.d. assumption. Existing results provide an upper bound on the unnormalized redundancy that is logarithmic in the block length. We show, via an improved scheme,…

Information Theory · Computer Science 2024-01-31 Sharang M. Sriramu , Aaron B. Wagner

The softmax function is a ubiquitous component at the output of neural networks and increasingly in intermediate layers as well. This paper provides convex lower bounds and concave upper bounds on the softmax function, which are compatible…

Machine Learning · Computer Science 2023-03-06 Dennis Wei , Haoze Wu , Min Wu , Pin-Yu Chen , Clark Barrett , Eitan Farchi