English
Related papers

Related papers: Pointwise Redundancy in One-Shot Lossy Compression…

200 papers

In this paper, we consider a class of multiterminal source coding problems, each subject to distortion constraints computed using a specific, entropy-based, distortion measure. We provide the achievable rate distortion region for two cases…

Information Theory · Computer Science 2011-06-02 Thomas Courtade , Richard Wesel

We study a new class of codes for lossy compression with the squared-error distortion criterion, designed using the statistical framework of high-dimensional linear regression. Codewords are linear combinations of subsets of columns of a…

Information Theory · Computer Science 2015-12-21 Ramji Venkataramanan , Antony Joseph , Sekhar Tatikonda

The exponential strong converse for a coding problem states that, if a coding rate is beyond the theoretical limit, the correct probability converges to zero exponentially. For the lossy source coding with side-information, also known as…

Information Theory · Computer Science 2025-04-24 Shun Watanabe

We consider lossy compression of an information source when decoder-only side information may be absent. This setup, also referred to as the Heegard-Berger or Kaspi problem, is a special case of robust distributed source coding. Building…

Information Theory · Computer Science 2024-05-08 Eyyup Tasci , Ezgi Ozyilkan , Oguzhan Kubilay Ulger , Elza Erkip

We study the effects of finite-precision representation of source's probabilities on the efficiency of classic source coding algorithms, such as Shannon, Gilbert-Moore, or arithmetic codes. In particular, we establish the following simple…

Information Theory · Computer Science 2007-12-04 Yuriy Reznik

We study a one-shot joint source-channel coding setting where the source is encoded once and broadcast to $K$ decoders through independent channels. Success is predicated on at least one decoder recovering the source within a maximum…

Information Theory · Computer Science 2026-04-17 Joseph Rowan , Buu Phan , Ashish Khisti

Most point cloud compression methods operate in the voxel or octree domain which is not the original representation of point clouds. Those representations either remove the geometric information or require high computational power for…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Dat Thanh Nguyen , Andre Kaup

We present a detection problem where several spatially distributed sensors observe Poisson signals emitted from a single source of unknown position. The measurements at each sensor are modeled by independent inhomogeneous Poisson processes.…

Statistics Theory · Mathematics 2018-06-19 Christian Farinetto , Yury A. Kutoyants , Alioune Top

We propose a numerical method for kinetic plasma simulation in which the phase-space distribution function is represented by a low-rank tensor network with an adaptive level of compression. The Vlasov-Poisson system is advanced using Strang…

Computational Physics · Physics 2026-02-16 Erik M. Åsgrim , Luca Pennati , Marco Pasquale , Stefano Markidis

Visual data compression is shifting from human-centered reconstruction to machine-oriented representation coding. In this setting, an image is often mapped to a compact semantic embedding, which is then compressed and transmitted for…

Image and Video Processing · Electrical Eng. & Systems 2026-04-30 Andriy Enttsel , Vincent Corlay

The performance of a lossy data compression scheme for uniformly biased Boolean messages is investigated via methods of statistical mechanics. Inspired by a formal similarity to the storage capacity problem in the research of neural…

Statistical Mechanics · Physics 2009-11-07 T. Hosaka , Y. Kabashima , H. Nishimori

Poisson's equation is fundamental to the study of Markov chains, and arises in connection with martingale representations and central limit theorems for additive functionals, perturbation theory for stationary distributions, and average…

Probability · Mathematics 2025-04-03 Peter W. Glynn , Na Lin , Yuanyuan Liu

In point cloud geometry compression, context models usually use the one-hot encoding of node occupancy as the label, and the cross-entropy between the one-hot encoding and the probability distribution predicted by the context model as the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Chang Sun , Hui Yuan , Shuai Li , Xin Lu , Raouf Hamzaoui

We derive the probability distribution of the link outage duration at a typical receiver in a wireless network with Poisson distributed interferers sending messages with slotted random access over a Rayleigh fading channel. This result is…

Information Theory · Computer Science 2019-11-27 Udo Schilcher , Siddhartha Borkotoky , Jorge F. Schmidt , Christian Bettstetter

The problem of joint universal source coding and modeling, addressed by Rissanen in the context of lossless codes, is generalized to fixed-rate lossy coding of continuous-alphabet memoryless sources. We show that, for bounded distortion…

Information Theory · Computer Science 2016-11-15 Maxim Raginsky

We present a new lossy compressor for discrete sources. For coding a source sequence $x^n$, the encoder starts by assigning a certain cost to each reconstruction sequence. It then finds the reconstruction that minimizes this cost and…

Information Theory · Computer Science 2009-01-19 Shirin Jalali , Andrea Montanari , Tsachy Weissman

The penalty incurred by imposing a finite delay constraint in lossless source coding of a memoryless source is investigated. It is well known that for the so-called block-to-variable and variable-to-variable codes, the redundancy decays at…

Information Theory · Computer Science 2016-11-17 Ofer Shayevitz , Eado Meron , Meir Feder , Ram Zamir

Marton's optimal error exponent for the lossy source coding problem is defined as a non-convex optimization problem. This fact had prevented us to develop an efficient algorithm to compute it. This problem is caused by the fact that the…

Information Theory · Computer Science 2024-09-13 Yutaka Jitsumatsu

We propose two extensions to existing importance sampling based methods for lossy compression. First, we introduce an importance sampling based compression scheme that is a variant of ordered random coding (Theis and Ahmed, 2022) and is…

Information Theory · Computer Science 2024-03-11 Buu Phan , Ashish Khisti , Christos Louizos

This paper studies the performance of sparse regression codes for lossy compression with the squared-error distortion criterion. In a sparse regression code, codewords are linear combinations of subsets of columns of a design matrix. It is…

Information Theory · Computer Science 2017-07-17 Ramji Venkataramanan , Sekhar Tatikonda