English
Related papers

Related papers: Context-Tree-Based Lossy Compression and Its Appli…

200 papers

In deep learning inference, model parameters are pruned and quantized to reduce the model size. Compression methods and common subexpression (CSE) elimination algorithms are applied on sparse constant matrices to deploy the models on…

Machine Learning · Computer Science 2023-03-29 Emre Bilgili , Arda Yurdakul

In a resource-constrained Wireless Sensor Networks (WSNs), the optimization of the sampling and the transmission rates of each individual node is a crucial issue. A high volume of redundant data transmitted through the network will result…

Networking and Internet Architecture · Computer Science 2019-04-16 Gaby Bou Tayeh , Abdallah Makhoul , Charith Perera , Jacques Demerjian

Lossy image compression networks aim to minimize the latent entropy of images while adhering to specific distortion constraints. However, optimizing the neural network can be challenging due to its nature of learning quantized latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingwen Zhang , Meng Wang , Xihua Sheng , Peilin Chen , Junru Li , Li Zhang , Shiqi Wang

This work proposes to reduce visibility data volume using a baseline-dependent lossy compression technique that preserves smearing at the edges of the field-of-view. We exploit the relation of the rank of a matrix and the fact that a…

Instrumentation and Methods for Astrophysics · Physics 2023-04-17 M Atemkeng , S Perkins , E Seck , S Makhathini , O Smirnov , L Bester , B Hugo

This paper presents a context key/value compression method for Transformer language models in online scenarios, where the context continually expands. As the context lengthens, the attention process demands increasing memory and…

Machine Learning · Computer Science 2024-02-07 Jang-Hyun Kim , Junyoung Yeom , Sangdoo Yun , Hyun Oh Song

This paper proposes the use of deep autoencoders to compress the channel information in a \review{massive} multiple input and multiple output (MIMO) system. Although autoencoders perform lossy compression, they still have adequate…

Networking and Internet Architecture · Computer Science 2024-10-07 Faris B. Mismar , Aliye Özge Kaya

The Bayesian Context Trees (BCT) framework is a recently introduced, general collection of statistical and algorithmic tools for modelling, analysis and inference with discrete-valued time series. The foundation of this development is built…

Information Theory · Computer Science 2023-09-06 Ioannis Kontoyiannis

Sampling is a popular method for approximate inference when exact inference is impractical. Generally, sampling algorithms do not exploit context-specific independence (CSI) properties of probability distributions. We introduce…

Artificial Intelligence · Computer Science 2021-03-02 Nitesh Kumar , Ondřej Kuželka

Wireless tomography is a technique for inferring a physical environment within a monitored region by analyzing RF signals traversed across the region. In this paper, we consider wireless tomography in a two and higher dimensionally…

Information Theory · Computer Science 2014-07-10 Kazushi Takemoto , Takahiro Matsuda , Shinsuke Hara , Kenichi Takizawa , Fumie Ono , Ryu Miura

Modern fronthaul links in wireless systems must transport high-dimensional signals under stringent bandwidth and latency constraints, which makes compression indispensable. Traditional strategies such as compressed sensing, scalar…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Keqin Zhang

Rate-distortion optimization through neural networks has accomplished competitive results in compression efficiency and image quality. This learning-based approach seeks to minimize the compromise between compression rate and reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

Compressed sensing (CS) demonstrates that a sparse, or compressible signal can be acquired using a low rate acquisition process below the Nyquist rate, which projects the signal onto a small set of vectors incoherent with the sparsity…

Information Theory · Computer Science 2014-02-25 Yuli Sun , Jinxu Tao

A Bayesian compressive sensing framework is developed for video reconstruction based on the color coded aperture compressive temporal imaging (CACTI) system. By exploiting the three dimension (3D) tree structure of the wavelet and Discrete…

Computer Vision and Pattern Recognition · Computer Science 2014-10-14 Xin Yuan , Patrick Llull , David J. Brady , Lawrence Carin

This work introduces Semantically Masked Vector Quantized Generative Adversarial Network (SQ-GAN), a novel approach integrating semantically driven image coding and vector quantization to optimize image compression for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Francesco Pezone , Sergio Barbarossa , Giuseppe Caire

In this work, we developed and tested 3 techniques for vector quantization (VQ) based model weight compression. To mitigate codebook collapse and enable end-to-end training, we adopted cosine similarity-based assignment. Building on ideas…

Machine Learning · Computer Science 2026-04-28 Terry Gou , Puneet Gupta

Time series account for a large proportion of the data stored in financial, medical and scientific databases. The efficient storage of time series is important in practical applications. In this paper, we propose a novel compression scheme…

Neural and Evolutionary Computing · Computer Science 2017-08-17 Daniel Hsu

With distributed machine learning being a prominent technique for large-scale machine learning tasks, communication complexity has become a major bottleneck for speeding up training and scaling up machine numbers. In this paper, we propose…

Machine Learning · Computer Science 2023-09-26 Pengyun Yue , Hanzhen Zhao , Cong Fang , Di He , Liwei Wang , Zhouchen Lin , Song-chun Zhu

We consider the problem of using sentence compression techniques to facilitate query-focused multi-document summarization. We present a sentence-compression-based framework for the task, and design a series of learning-based compression…

Computation and Language · Computer Science 2016-06-27 Lu Wang , Hema Raghavan , Vittorio Castelli , Radu Florian , Claire Cardie

Entropy modeling is a key component for high-performance image compression algorithms. Recent developments in autoregressive context modeling helped learning-based methods to surpass their classical counterparts. However, the performance of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 A. Burakhan Koyuncu , Han Gao , Atanas Boev , Georgii Gaikov , Elena Alshina , Eckehard Steinbach

This work proposes lossless and near-lossless compression algorithms for multi-channel biomedical signals. The algorithms are sequential and efficient, which makes them suitable for low-latency and low-power signal transmission…

Information Theory · Computer Science 2016-05-17 Ignacio Capurro , Federico Lecumberry , Álvaro Martín , Ignacio Ramírez , Eugenio Rovira , Gadiel Seroussi