English
Related papers

Related papers: Strong Converses using Typical Changes of Measures…

200 papers

Semantic maps are increasingly utilized in areas such as robotics, autonomous systems, and extended reality, motivating the investigation of efficient compression methods that preserve structured semantic information. This paper studies…

Image and Video Processing · Electrical Eng. & Systems 2026-03-30 Runyu Yang , Junqi Liao , Hyomin Choi , Fabien Racapé , Ivan V. Bajić

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

In this paper, we consider single- and multi-user Gaussian channels with feedback under expected power constraints and with non-vanishing error probabilities. In the first of two contributions, we study asymptotic expansions for the…

Information Theory · Computer Science 2016-09-22 Lan V. Truong , Silas L. Fong , Vincent Y. F. Tan

This paper establishes several converse bounds on the private transmission capabilities of a quantum channel. The main conceptual development builds firmly on the notion of a private state, which is a powerful, uniquely quantum method for…

Quantum Physics · Physics 2017-02-21 Mark M. Wilde , Marco Tomamichel , Mario Berta

Let $A$ be a transition probability kernel on a finite state space $\Delta^o =\{1, \ldots , d\}$ such that $A(x,y)>0$ for all $x,y \in \Delta^o$. Consider a reinforced chain given as a sequence $\{X_n, \; n \in \mathbb{N}_0\}$ of…

Probability · Mathematics 2022-05-20 Amarjit Budhiraja , Adam Waterbury

In this paper, we revisit the discrete lossy Gray-Wyner problem. In particular, we derive its optimal second-order coding rate region, its error exponent (reliability function) and its moderate deviations constant under mild conditions on…

Information Theory · Computer Science 2017-01-05 Lin Zhou , Vincent Y. F. Tan , Mehul Motani

We study the problem of efficient compression of a stochastic source of probability distributions. It can be viewed as a generalization of Shannon's source coding problem. It has relation to the theory of common randomness, as well as to…

Quantum Physics · Physics 2016-09-08 Andreas Winter

We propose a "decomposition method" to prove non-asymptotic bound for the convergence of empirical measures in various dual norms. The main point is to show that if one measures convergence in duality with sufficiently regular observables,…

Probability · Mathematics 2018-02-13 Benoît Kloeckner

A general method of source coding over expansion is proposed in this paper, which enables one to reduce the problem of compressing an analog (continuous-valued source) to a set of much simpler problems, compressing discrete sources.…

Information Theory · Computer Science 2013-08-13 Hongbo Si , O. Ozan Koyluoglu , Sriram Vishwanath

We study the problem of secure joint source-channel coding for multimodal semantic sources transmitted over noisy wiretap channels. The source model consists of $m$ modalities (e.g., image, audio, and sensor data), all represented as random…

Information Theory · Computer Science 2026-05-26 Denis Kozlov , Mahtab Mirmohseni , Rahim Tafazolli

As conventional communication systems based on classic information theory have closely approached the limits of Shannon channel capacity, semantic communication has been recognized as a key enabling technology for the further improvement of…

Information Theory · Computer Science 2023-06-06 Jiancheng Tang , Qianqian Yang , Zhaoyang Zhang

We revisit the source coding problem for a Markov chain under the assumption that the transmission times and how fast the Markov chain transitions its state happen at the same time-scale. Specifically, we assume that the transmission of…

Information Theory · Computer Science 2025-11-05 Ismail Cosandal , Sennur Ulukus

This paper considers guessing-based decoders with abandonment for discrete memoryless channels in which all codewords have the same composition. This class of decoders rank-orders all input sequences in the codebook's composition class from…

Information Theory · Computer Science 2025-08-11 Vincent Y. F. Tan , Hamdi Joudeh

Effective token compression remains a critical challenge for scaling models to handle increasingly complex and diverse datasets. A novel mechanism based on contextual reinforcement is introduced, dynamically adjusting token importance…

Computation and Language · Computer Science 2025-08-11 Naderdel Piero , Zacharias Cromwell , Nathaniel Wainwright , Matthias Nethercott

We propose a deterministic-statistical method for an inverse source problem using multiple frequency limited aperture far field data. The direct sampling method is used to obtain a disc such that it contains the compact support of the…

Numerical Analysis · Mathematics 2022-09-20 Yanfang Liu , Zhizhang Wu , Jiguang Sun , Zhiwen Zhang

One open problem in source coding is to characterize the limits of representing losslessly a non-identity discrete function of the data encoded independently by the encoders of several correlated sources with memory. This paper investigates…

Information Theory · Computer Science 2013-06-26 Sheng Huang , Mikael Skoglund

This work is motivated by the problem of error correction in bit-shift channels with the so-called $ (d,k) $ input constraints (where successive $ 1 $'s are required to be separated by at least $ d $ and at most $ k $ zeros, $ 0 \leq d < k…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević

Recent years have seen the rise of convolutional neural network techniques in exemplar-based image synthesis. These methods often rely on the minimization of some variational formulation on the image space for which the minimizers are…

Statistics Theory · Mathematics 2019-12-05 Valentin De Bortoli , Agnes Desolneux , Alain Durmus , Bruno Galerne , Arthur Leclaire

We study the inverse source problem for a class of viscoelastic systems from a single boundary measurement in a general spatial dimension. We give specific reconstruction formula and stability estimate for the source in terms of the…

Analysis of PDEs · Mathematics 2020-04-24 Walton Green , Shitao Liu

We study message identification over a q-ary uniform permutation channel, where the transmitted vector is permuted by a permutation chosen uniformly at random. For discrete memoryless channels(DMCs), the number of identifiable messages…

Information Theory · Computer Science 2024-09-23 Abhishek Sarkar , Bikash Kumar Dey