English
Related papers

Related papers: Rejection Sampling is Optimal for Relative Entropy…

200 papers

We consider the problem of encoding a deterministic source sequence (a.k.a.\ individual sequence) for the degraded wiretap channel by means of an encoder and decoder that can both be implemented as finite--state machines. Our first main…

Information Theory · Computer Science 2022-01-05 Neri Merhav

The problem of secure lossy source-channel wiretapping with arbitrarily correlated side informations at both receivers is investigated. This scenario consists of an encoder (referred to as Alice) that wishes to compress a source and send it…

Information Theory · Computer Science 2011-10-11 Joffrey Villard , Pablo Piantanida , Shlomo Shamai

Subword tokenization is a key part of many NLP pipelines. However, little is known about why some tokenizer and hyperparameter combinations lead to better downstream model performance than others. We propose that good tokenizers lead to…

Computation and Language · Computer Science 2023-06-30 Vilém Zouhar , Clara Meister , Juan Luis Gastaldi , Li Du , Mrinmaya Sachan , Ryan Cotterell

This paper considers the problem of soft guessing under a logarithmic loss distortion measure while allowing errors. We find an optimal guessing strategy, and derive single-shot upper and lower bounds for the minimal guessing moments as…

Information Theory · Computer Science 2025-10-13 Shota Saito , Hamdi Joudeh

A computable expression for the rate-distortion (RD) function proposed by Heegard and Berger has eluded information theory for nearly three decades. Heegard and Berger's single-letter achievability bound is well known to be optimal for…

Information Theory · Computer Science 2012-12-12 Roy Timo , Tobias J. Oechtering , Michèle Wigger

As shown by M\'edard, the capacity of fading channels with imperfect channel-state information (CSI) can be lower-bounded by assuming a Gaussian channel input $X$ with power $P$ and by upper-bounding the conditional entropy $h(X|Y,\hat{H})$…

Information Theory · Computer Science 2016-11-15 Adriano Pastore , Tobias Koch , Javier Rodríguez Fonollosa

A statistical cache-aided compression problem with a privacy constraint is studied, where a server has access to a database of $N$ files, $(Y_1,...,Y_N)$, each of size $F$ bits and is linked through a shared channel to $K$ users, where each…

Information Theory · Computer Science 2024-10-01 Amirreza Zamani , Mikael Skoglund

The quality of image encryption is commonly measured by the Shannon entropy over the ciphertext image. However, this measurement does not consider to the randomness of local image blocks and is inappropriate for scrambling based image…

Cryptography and Security · Computer Science 2016-11-27 Yue Wu , Joseph P. Noonan , Sos Agaian

Given an unknown quantum state distributed over two systems, we determine how much quantum communication is needed to transfer the full state to one system. This communication measures the "partial information" one system needs conditioned…

Quantum Physics · Physics 2007-05-23 Michal Horodecki , Jonathan Oppenheim , Andreas Winter

Neural language models often struggle with low-resource languages due to the limited availability of training data, making tokens from these languages rare in the training set. This paper addresses a specific challenge during training: rare…

Computation and Language · Computer Science 2026-02-02 Galim Turumtaev

The concept of attention, numerical weights that emphasize the importance of particular data, has proven to be very relevant in artificial intelligence. Relative entropy (RE, aka Kullback-Leibler divergence) plays a central role in…

Information Theory · Computer Science 2024-01-10 Torsten Enßlin , Carolin Weidinger , Philipp Frank

We study common randomness where two parties have access to i.i.d. samples from a known random source, and wish to generate a shared random key using limited (or no) communication with the largest possible probability of agreement. This…

Computational Complexity · Computer Science 2017-07-26 Badih Ghazi , T. S. Jayram

We derive a lower bound on the smallest output entropy that can be achieved via vector quantization of a $d$-dimensional source with given expected $r$th-power distortion. Specialized to the one-dimensional case, and in the limit of…

Information Theory · Computer Science 2017-03-27 Tobias Koch , Gonzalo Vazquez-Vilar

We consider a monitoring application where sensors periodically report data to a common receiver in a time division multiplex fashion. The sensors are constrained by the limited and unpredictable energy availability provided by Energy…

Information Theory · Computer Science 2017-06-29 Chiara Pielli , Cedomir Stefanovic , Petar Popovski , Michele Zorzi

A new coding scheme for image transmission over noisy channel is proposed. Similar to standard image compression, the scheme includes a linear transform followed by successive refinement scalar quantization. Unlike conventional schemes, in…

Information Theory · Computer Science 2012-10-03 Ozgun Y. Bursalioglu , Giuseppe Caire , Dariush Divsalar

This paper studies the joint data and semantics lossy compression problem, i.e., an extension of the hidden lossy source coding problem that entails recovering both the hidden and observable sources. We aim to study the nonasymptotic and…

Information Theory · Computer Science 2024-08-20 Huiyuan Yang , Yuxuan Shi , Shuo Shao , Xiaojun Yuan

Quantum information decoupling is a fundamental primitive in quantum information theory, underlying various applications in quantum physics. We prove a novel one-shot decoupling theorem formulated in terms of quantum relative entropy…

Quantum Physics · Physics 2026-02-20 Mario Berta , Hao-Chung Cheng , Yongsheng Yao

Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…

Information Theory · Computer Science 2015-01-14 Alexander Schönhuth

In this paper, we present a novel method for computing the relative entropy as well as the expected relative entropy using an MCMC chain. The relative entropy from information theory can be used to quantify differences in posterior…

Cosmology and Nongalactic Astrophysics · Physics 2019-04-29 Ahmad Mehrabi , A. Ahmadi

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger