English
Related papers

Related papers: Robust Distributed Compression with Learned Heegar…

200 papers

Inspired by mobile satellite communication systems and the important and prevalent applications of computational tasks, we consider a distributed source coding model for compressing vector-linear functions, which consists of multiple…

Information Theory · Computer Science 2025-08-06 Xuan Guang , Xiufang Sun , Ruze Zhang

Lossless image compression is required in various applications to reduce storage or transmission costs of images, while requiring the reconstructed images to have zero information loss compared to the original. Existing lossless image…

Information Theory · Computer Science 2024-09-12 Samar Agnihotri , Renu Rameshan , Ritwik Ghosal

Modern computer vision requires processing large amounts of data, both while training the model and/or during inference, once the model is deployed. Scenarios where images are captured and processed in physically separated locations are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sudeep Katakol , Basem Elbarashy , Luis Herranz , Joost van de Weijer , Antonio M. Lopez

Transmission of a Gaussian source over a time-varying Gaussian channel is studied in the presence of time-varying correlated side information at the receiver. A block fading model is considered for both the channel and the side information,…

Information Theory · Computer Science 2015-05-27 Iñaki Estella Aguerri , Deniz Gündüz

We consider the problem of distributed binary hypothesis testing of two sequences that are generated by an i.i.d. doubly-binary symmetric source. Each sequence is observed by a different terminal. The two hypotheses correspond to different…

Information Theory · Computer Science 2018-01-03 Eli Haim , Yuval Kochman

The relay channel, consisting of a source-destination pair and a relay, is a fundamental component of cooperative communications. While the capacity of a general relay channel remains unknown, various relaying strategies, including…

Information Theory · Computer Science 2024-04-24 Ezgi Ozyilkan , Fabrizio Carpi , Siddharth Garg , Elza Erkip

We consider the problem of distributed compression for correlated quantum sources. The classical version of this problem was solved by Slepian and Wolf, who showed that distributed compression could take full advantage of redundancy in the…

Quantum Physics · Physics 2007-05-23 Charlene Ahn , Andrew Doherty , Patrick Hayden , Andreas Winter

Two ubiquitous aspects of large-scale data analysis are that the data often have heavy-tailed properties and that diffusion-based or spectral-based methods are often used to identify and extract structure of interest. Perhaps surprisingly,…

Machine Learning · Computer Science 2010-05-11 Michael W. Mahoney , Hariharan Narayanan

The relay channel, consisting of a source-destination pair along with a relay, is a fundamental component of cooperative communications. While the capacity of a general relay channel remains unknown, various relaying strategies, including…

Information Theory · Computer Science 2025-02-14 Ezgi Ozyilkan , Fabrizio Carpi , Siddharth Garg , Elza Erkip

A noisy network coding scheme for sending multiple sources over a general noisy network is presented. For multi-source multicast networks, the scheme naturally extends both network coding over noiseless networks by Ahlswede, Cai, Li, and…

Information Theory · Computer Science 2015-03-13 Sung Hoon Lim , Young-Han Kim , Abbas El Gamal , Sae-Young Chung

Let (S1,i, S2,i), distributed according to i.i.d p(s1, s2), i = 1, 2, . . . be a memoryless, correlated partial side information sequence. In this work we study channel coding and source coding problems where the partial side information…

Information Theory · Computer Science 2013-04-12 Avihay Shirazi , Uria Basher , Haim Permuter

Efficient compression of correlated data is essential to minimize communication overload in multi-sensor networks. In such networks, each sensor independently compresses the data and transmits them to a central node due to limited…

We draw a certain analogy between the classical information-theoretic problem of lossy data compression (source coding) of memoryless information sources and the statistical mechanical behavior of a certain model of a chain of connected…

Statistical Mechanics · Physics 2015-05-20 Neri Merhav

In this work we focus our attention on distributed optimization problems in the context where the communication time between the server and the workers is non-negligible. We obtain novel methods supporting bidirectional compression (both…

Optimization and Control · Mathematics 2023-05-23 Kaja Gruntkowska , Alexander Tyurin , Peter Richtárik

This paper offers a characterization of fundamental limits on the classification and reconstruction of high-dimensional signals from low-dimensional features, in the presence of side information. We consider a scenario where a decoder has…

Many computer vision tasks share substantial overlapping information, yet conventional codecs tend to ignore this, leading to redundant and inefficient representations. The Gray-Wyner network, a classical concept from information theory,…

Machine Learning · Computer Science 2026-05-11 Anderson de Andrade , Alon Harell , Ivan V. Bajić

This paper considers the joint compression of a pair of correlated sources, where the encoder is allowed to access only one of the sources. The objective is to recover both sources under separate distortion constraints for each source while…

Information Theory · Computer Science 2024-11-07 Huiyuan Yang , Yuxuan Shi , Shuo Shao , Xiaojun Yuan

We present a new lossy compressor for discrete-valued sources. For coding a sequence $x^n$, the encoder starts by assigning a certain cost to each possible reconstruction sequence. It then finds the one that minimizes this cost and…

Information Theory · Computer Science 2016-11-18 Shirin Jalali , Andrea Montanari , Tsachy Weissman

Distributed Image Compression (DIC) is crucial for multi-view transmission, especially when operating at extremely low bitrates (< 0.1 bpp). Its core challenge is effectively utilizing side information to achieve high-quality reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Guojun Xu , Mingyang Zhang , Jianwen Xiang , Cheng Tan , Yanchao Yang , Junwei Zhou

Likelihood-based generative models are the backbones of lossless compression due to the guaranteed existence of codes with lengths close to negative log likelihood. However, there is no guaranteed existence of computationally efficient…

Machine Learning · Computer Science 2020-01-07 Jonathan Ho , Evan Lohn , Pieter Abbeel
‹ Prev 1 8 9 10 Next ›