English
Related papers

Related papers: Lossless Data Compression with Error Detection usi…

200 papers

Traditional image and video compression algorithms rely on hand-crafted encoder/decoder pairs (codecs) that lack adaptability and are agnostic to the data being compressed. Here we describe the concept of generative compression, the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Shibani Santurkar , David Budden , Nir Shavit

We consider a Shannon cipher system for memoryless sources, in which distortion is allowed at the legitimate decoder. The source is compressed using a rate distortion code secured by a shared key, which satisfies a constraint on the…

Information Theory · Computer Science 2016-11-17 Nir Weinberger , Neri Merhav

Consider a generalized multiterminal source coding system, where $\ell\choose m$ encoders, each observing a distinct size-$m$ subset of $\ell$ ($\ell\geq 2$) zero-mean unit-variance symmetrically correlated Gaussian sources with correlation…

Information Theory · Computer Science 2017-10-16 Jun Chen , Li Xie , Yameng Chang , Jia Wang , Yizhong Wang

To leverage the full potential of quantum error-correcting stabilizer codes it is crucial to have an efficient and accurate decoder. Accurate, maximum likelihood, decoders are computationally very expensive whereas decoders based on more…

Modern applications are driving demand for ultra-reliable low-latency communications, rekindling interest in the performance of short, high-rate error correcting codes. To that end, here we introduce a soft-detection variant of Guessing…

Information Theory · Computer Science 2021-06-16 Ken R. Duffy

We propose Deep Lossless Image Coding (DLIC), a full resolution learned lossless image compression algorithm. Our algorithm is based on a neural network combined with an entropy encoder. The neural network performs a density estimation on…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Benjamin Lukas Cajus Barzen , Fedor Glazov , Jonas Geistert , Thomas Sikora

Lossless image compression is an important task in the field of multimedia communication. Traditional image codecs typically support lossless mode, such as WebP, JPEG2000, FLIF. Recently, deep learning based approaches have started to show…

Image and Video Processing · Electrical Eng. & Systems 2020-02-06 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Fountain codes like LT or Raptor codes, also known as rateless erasure codes, allow to encode a message as some number of packets, such that any large enough subset of these packets is sufficient to fully reconstruct the message. It…

Information Theory · Computer Science 2015-08-19 Jarek Duda

Recent learning-based lossless image compression methods encode an image in the unit of subimages and achieve comparable performances to conventional non-learning algorithms. However, these methods do not consider the performance drop in…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hochang Rhee , Yeong Il Jang , Seyun Kim , Nam Ik Cho

Image compression is a fundamental research field and many well-known compression standards have been developed for many decades. Recently, learned compression methods exhibit a fast development trend with promising results. However, there…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Regenerating codes provide an efficient way to recover data at failed nodes in distributed storage systems. It has been shown that regenerating codes can be designed to minimize the per-node storage (called MSR) or minimize the…

Information Theory · Computer Science 2014-06-26 Yunghsiang Han , Hung-Ta Pai , Rong Zheng , Pramod K. Varshney

It was recently shown that the lossless compression of a single source $X^n$ is achievable with a notion of strong locality; any $X_i$ can be decoded from a constant number of compressed bits, with a vanishing in $n$ probability of error.…

Information Theory · Computer Science 2022-09-28 Shashank Vatedka , Venkat Chandar , Aslan Tchamkerten

Guessing Random Additive Noise Decoding (GRAND) is a universal decoding algorithm that can be used to perform maximum likelihood decoding. It attempts to find the errors introduced by the channel by generating a sequence of possible error…

Information Theory · Computer Science 2022-07-26 Carlo Condo

Conventional compressed sensing theory assumes signals have sparse representations in a known, finite dictionary. Nevertheless, in many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the…

Information Theory · Computer Science 2014-12-19 Jun Fang , Huiping Duan , Jing Li , Hongbin Li , Rick S. Blum

We consider a transmitter that encodes data packets using network coding and broadcasts coded packets. A receiver employing network decoding recovers the data packets if a sufficient number of error-free coded packets are gathered. The…

Information Theory · Computer Science 2024-02-13 Ioannis Chatzigeorgiou , Dmitry Savostyanov

Existing work on prompt compression for Large Language Models (LLM) focuses on lossy methods that try to maximize the retention of semantic information that is relevant to downstream tasks while significantly reducing the sequence length.…

Computation and Language · Computer Science 2025-08-22 John Harvill , Ziwei Fan , Hao Wang , Luke Huan , Anoop Deoras , Yizhou Sun , Hao Ding

We introduce a stop-code tolerant (SCT) approach to training recurrent convolutional neural networks for lossy image compression. Our methods introduce a multi-pass training method to combine the training goals of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Michele Covell , Nick Johnston , David Minnen , Sung Jin Hwang , Joel Shor , Saurabh Singh , Damien Vincent , George Toderici

In this work, a deep learning-based method for log-likelihood ratio (LLR) lossy compression and quantization is proposed, with emphasis on a single-input single-output uncorrelated fading communication setting. A deep autoencoder network is…

Machine Learning · Computer Science 2021-05-11 Marius Arvinte , Ahmed H. Tewfik , Sriram Vishwanath

Learning-based probabilistic models can be combined with an entropy coder for data compression. However, due to the high complexity of learning-based models, their practical application as text compressors has been largely overlooked. To…

Computation and Language · Computer Science 2024-12-25 Junxuan Zhang , Zhengxue Cheng , Yan Zhao , Shihao Wang , Dajiang Zhou , Guo Lu , Li Song

We consider universal variable-to-fixed length compression of memoryless sources with a fidelity criterion. We design a dictionary codebook over the reproduction alphabet which is used to parse the source stream. Once a source subsequence…

Information Theory · Computer Science 2022-11-24 Nematollah Iri