English
Related papers

Related papers: A Compression Algorithm Using Mis-aligned Side-inf…

200 papers

Source coding is the canonical problem of data compression in information theory. In a locally encodable source coding, each compressed bit depends on only few bits of the input. In this paper, we show that a recently popular model of…

Machine Learning · Statistics 2020-11-10 Arya Mazumdar , Soumyabrata Pal

In the context of compressed sensing (CS), this paper considers the problem of reconstructing sparse signals with the aid of other given correlated sources as multiple side information. To address this problem, we theoretically study a…

Information Theory · Computer Science 2017-01-19 Huynh Van Luong , Jurgen Seiler , Andre Kaup , Soren Forchhammer , Nikos Deligiannis

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

This paper presents new solutions for Private Information Retrieval (PIR) with side information. This problem is motivated by PIR settings in which a client has side information about the data held by the servers and would like to leverage…

Information Theory · Computer Science 2024-01-31 Ningze Wang , Anoosheh Heidarzadeh , Alex Sprintson

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each…

Optimization and Control · Mathematics 2023-03-07 Mohammadreza Chamanbaz , Roland Bouffanais

We consider lossy source compression of a binary symmetric source using polar codes and the low-complexity successive encoding algorithm. It was recently shown by Arikan that polar codes achieve the capacity of arbitrary symmetric…

Information Theory · Computer Science 2009-03-03 Satish Babu Korada , Rudiger Urbanke

We present a new lossy compressor for discrete-valued sources. For coding a sequence $x^n$, the encoder starts by assigning a certain cost to each possible reconstruction sequence. It then finds the one that minimizes this cost and…

Information Theory · Computer Science 2016-11-18 Shirin Jalali , Andrea Montanari , Tsachy Weissman

This paper proposes a novel achievable scheme for the index problem and applies it to the caching problem. Index coding and caching are noiseless broadcast channel problems where receivers have message side information.In the index coding…

Information Theory · Computer Science 2017-02-24 Kai Wan , Daniela Tuninetti , Pablo Piantanida

We consider a rate-distortion problem with side information at multiple decoders. Several upper and lower bounds have been proposed for this general problem or special cases of it. We provide an upper bound for general instances of this…

Information Theory · Computer Science 2016-12-13 Sinem Unal , Aaron B. Wagner

This work provides an algebraic framework for source coding with decoder side information and its dual problem, channel coding with encoder side information, showing that nested concatenated codes can achieve the corresponding…

Information Theory · Computer Science 2012-04-25 Felipe Cinelli Barbosa , Joerg Kliewer , Max H. M. Costa

This paper considers the problem of distributed source coding for a large network. A major obstacle that poses an existential threat to practical deployment of conventional approaches to distributed coding is the exponential growth of the…

Information Theory · Computer Science 2013-01-08 Kumar Viswanatha , Sharadh Ramaswamy , Ankur Saxena , Emrah Akyol , Kenneth Rose

Many services today massively and continuously produce log files of different and varying formats. These logs are important since they contain information about the application activities, which is necessary for improvements by analyzing…

Information Retrieval · Computer Science 2023-04-11 Igor Cherepanov , Jonathan Geraldi Joewono , Arjan Kuijper , Jörn Kohlhammer

Compression algorithms are widely used as they save memory without losing data. However, elimination of redundant symbols and sequences in data leads to a compression side channel. So far, compression attacks have only focused on the…

Cryptography and Security · Computer Science 2021-11-17 Martin Schwarzl , Pietro Borrello , Gururaj Saileshwar , Hanna Müller , Michael Schwarz , Daniel Gruss

Compression aims to reduce the size of an input, while maintaining its relevant properties. For multi-parameter persistent homology, compression is a necessary step in any computational pipeline, since standard constructions lead to large…

Algebraic Topology · Mathematics 2022-08-17 Ulderico Fugacci , Michael Kerber , Alexander Rolle

Atomic norm minimization is a convex optimization framework to recover point sources from a subset of their low-pass observations, or equivalently the underlying frequencies of a spectrally-sparse signal. When the amplitudes of the sources…

Information Theory · Computer Science 2021-02-24 Maxime Ferreira Da Costa , Yuejie Chi

Universal source coding at short blocklengths is considered for an exponential family of distributions. The \emph{Type Size} code has previously been shown to be optimal up to the third-order rate for universal compression of all memoryless…

Information Theory · Computer Science 2016-12-21 Nematollah Iri , Oliver Kosut

We study the zero-error source coding problem in which an encoder with Side Information (SI) $g(Y)$ transmits source symbols $X$ to a decoder. The decoder has SI $Y$ and wants to recover $f(X,Y)$ where $f,g$ are deterministic. We exhibit a…

Information Theory · Computer Science 2022-12-19 Nicolas Charpenay , Maël le Treust , Aline Roumy

Data compression has been widely applied in many data processing areas. Compression methods use variable-size codes with the shorter codes assigned to symbols or groups of symbols that appear in the data frequently. Fibonacci coding, as a…

Performance · Computer Science 2007-12-19 R. Baca , V. Snasel , J. Platos , M. Kratky , E. El-Qawasmeh

We consider the problem of the optimal compression rate in the case of the source producing mixed signal states within the {\it visible} scheme (where Alice, who is to compress the signal, can know the identities of the produced states). We…

Quantum Physics · Physics 2009-10-31 Michal Horodecki

This paper presents a new approach to statistical similarity assessment based on sequence alignment. The algorithm performs mutual matching of two random sequences by successively searching for common elements and by applying sequence…

Signal Processing · Electrical Eng. & Systems 2021-06-09 Jakub Nikonowicz , Łukasz Matuszewski , Paweł Kubczak