English
Related papers

Related papers: Bit-Swap: Recursive Bits-Back Coding for Lossless …

200 papers

We propose a novel neural waveform compression method to catalyze emerging speech semantic communications. By introducing nonlinear transform and variational modeling, we effectively capture the dependencies within speech frames and…

Sound · Computer Science 2022-12-14 Shengshi Yao , Zixuan Xiao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

Recent AI applications such as Collaborative Intelligence with neural networks involve transferring deep feature tensors between various computing devices. This necessitates tensor compression in order to optimize the usage of…

Machine Learning · Computer Science 2020-02-18 Hyomin Choi , Robert A. Cohen , Ivan V. Bajic

This work develops a rate-distortion-based approach to stochastic Chase decoding of algebraic codes over binary memoryless symmetric (BMS) channels, replacing the heuristics traditionally used to determine flip probabilities with…

Information Theory · Computer Science 2026-05-20 Amit Berman , Ariel Doubchak , Uri Erez , Tal Philosof , Ilya Shapir

Predictive coding is attractive for compression of hyperspecral images onboard of spacecrafts in light of the excellent rate-distortion performance and low complexity of recent schemes. In this letter we propose a rate control algorithm and…

Information Theory · Computer Science 2017-01-31 Diego Valsesia , Enrico Magli

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang

Many common types of data can be represented as functions that map coordinates to signal values, such as pixel locations to RGB values in the case of an image. Based on this view, data can be compressed by overfitting a compact neural…

Machine Learning · Computer Science 2023-10-31 Zongyu Guo , Gergely Flamich , Jiajun He , Zhibo Chen , José Miguel Hernández-Lobato

Beyond its widespread application in signal and image processing, \emph{compressed sensing} principles have been greatly applied to secure information transmission (often termed 'compressive security'). In this scenario, the measurement…

Cryptography and Security · Computer Science 2025-10-20 Axel Flinth , Hubert Orlicki , Semira Einsele , Gerhard Wunder

Despite extensive progress on image generation, common deep generative model architectures are not easily applied to lossless compression. For example, VAEs suffer from a compression cost overhead due to their latent variables. This…

Machine Learning · Computer Science 2022-03-17 Anji Liu , Stephan Mandt , Guy Van den Broeck

Conventional model quantization methods use a fixed quantization scheme to different data samples, which ignores the inherent "recognition difficulty" differences between various samples. We propose to feed different data samples with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chen Tang , Haoyu Zhai , Kai Ouyang , Zhi Wang , Yifei Zhu , Wenwu Zhu

Modern data compression methods are slowly reaching their limits after 80 years of research, millions of papers, and wide range of applications. Yet, the extravagant 6G communication speed requirement raises a major open question for…

Information Theory · Computer Science 2025-05-01 Ziguang Li , Chao Huang , Xuliang Wang , Haibo Hu , Cole Wyeth , Dongbo Bu , Quan Yu , Wen Gao , Xingwu Liu , Ming Li

In this paper, we target the practical implementation issues of quantum multicast networks. First, we design a recursive lossless compression that allows us to control the trade-off between the circuit complexity and the dimension of the…

Quantum Physics · Physics 2010-11-11 Yi-Chang Shih , Min-Hsiu Hsieh , Hung-Yu Wei

We propose a new method, {\it binary fused compressive sensing} (BFCS), to recover sparse piece-wise smooth signals from 1-bit compressive measurements. The proposed algorithm is a modification of the previous {\it binary iterative hard…

Computer Vision and Pattern Recognition · Computer Science 2014-02-21 Xiangrong Zeng , Mário A. T. Figueiredo

We propose an approach to lossy source coding, utilizing ideas from Gibbs sampling, simulated annealing, and Markov Chain Monte Carlo (MCMC). The idea is to sample a reconstruction sequence from a Boltzmann distribution associated with an…

Information Theory · Computer Science 2016-11-17 Shirin Jalali , Tsachy Weissman

In this paper, we propose to enhance learned image compression systems with a richer probability model for the latent variables. Previous works model the latents with a Gaussian or a Laplace distribution. Inspired by binary arithmetic…

Image and Video Processing · Electrical Eng. & Systems 2020-02-24 Théo Ladune , Pierrick Philippe , Wassim Hamidouche , Lu Zhang , Olivier Deforges

Analog-to-Digital Converters (ADCs) are essential components in modern data acquisition systems. A key design challenge is accommodating high dynamic range (DR) input signals without clipping. Existing solutions, such as oversampling,…

Signal Processing · Electrical Eng. & Systems 2024-12-18 Shaik Basheeruddin Shah , Satish Mulleti , Yonina C. Eldar

Network pruning and quantization are proven to be effective ways for deep model compression. To obtain a highly compact model, most methods first perform network pruning and then conduct network quantization based on the pruned model.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Jing Liu , Bohan Zhuang , Peng Chen , Chunhua Shen , Jianfei Cai , Mingkui Tan

We propose a context-adaptive entropy model for use in end-to-end optimized image compression. Our model exploits two types of contexts, bit-consuming contexts and bit-free contexts, distinguished based upon whether additional bit…

Image and Video Processing · Electrical Eng. & Systems 2019-05-07 Jooyoung Lee , Seunghyun Cho , Seung-Kwon Beack

In this work, we use path integral techniques to predict the switching rate in a single-mode bistable open quantum system. While analytical expressions are well-known to be accessible for systems subject to Gaussian noise obeying classical…

As they become more capable, large language models (LLMs) have continued to rapidly increase in size. This has exacerbated the difficulty in running state of the art LLMs on small, edge devices. Standard techniques advocate solving this…

Learned progressive image compression is gaining momentum as it allows improved image reconstruction as more bits are decoded at the receiver. We propose a progressive image compression method in which an image is first represented as a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Alberto Presta , Enzo Tartaglione , Attilio Fiandrotti , Marco Grangetto , Pamela Cosman