English
Related papers

Related papers: Compressing Images by Encoding Their Latent Repres…

200 papers

In recent deep image compression neural networks, the entropy model plays a critical role in estimating the prior distribution of deep image encodings. Existing methods combine hyperprior with local context in the entropy estimation…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Yichen Qian , Zhiyu Tan , Xiuyu Sun , Ming Lin , Dongyang Li , Zhenhong Sun , Hao Li , Rong Jin

This paper studies cross-domain lossy compression through the lens of minimum entropy coupling (MEC) with rate and classification constraints. In this setting, an encoder observes samples from a degraded source domain, while the decoder is…

Information Theory · Computer Science 2026-05-12 Nam Nguyen , Hassan Tavakoli , An Vuong , Thinh Nguyen , Bella Bose

Traditional Variational Autoencoders (VAEs) are constrained by the limitations of the Evidence Lower Bound (ELBO) formulation, particularly when utilizing simplistic, non-analytic, or unknown prior distributions. These limitations inhibit…

Machine Learning · Computer Science 2024-07-10 Fotios Lygerakis , Elmar Rueckert

While existing speech audio codecs designed for compression exploit limited forms of temporal redundancy and allow for multi-scale representations, they tend to represent all features of audio in the same way. In contrast, generative voice…

Sound · Computer Science 2025-09-22 Ryan Collette , Ross Greenwood , Serena Nicoll

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

Machine Learning · Statistics 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

Referring Expression Comprehension (REC) is a foundational cross-modal task that evaluates the interplay of language understanding, image comprehension, and language-to-image grounding. It serves as an essential testing ground for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Xuzheng Yang , Junzhuo Liu , Peng Wang , Guoqing Wang , Yang Yang , Heng Tao Shen

Video Coding for Machines (VCM) is committed to bridging to an extent separate research tracks of video/image compression and feature compression, and attempts to optimize compactness and efficiency jointly from a unified perspective of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Wenhan Yang , Haofeng Huang , Yueyu Hu , Ling-Yu Duan , Jiaying Liu

We propose a novel neural waveform compression method to catalyze emerging speech semantic communications. By introducing nonlinear transform and variational modeling, we effectively capture the dependencies within speech frames and…

Sound · Computer Science 2022-12-14 Shengshi Yao , Zixuan Xiao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

This paper presents a novel convolutional neural network (CNN) based image compression framework via scalable auto-encoder (SAE). Specifically, our SAE based deep image codec consists of hierarchical coding layers, each of which is an…

Multimedia · Computer Science 2019-04-02 Chuanmin Jia , Zhaoyi Liu , Yao Wang , Siwei Ma , Wen Gao

Decoding remote sensing images to achieve high perceptual quality, particularly at low bitrates, remains a significant challenge. To address this problem, we propose the invertible neural network-based remote sensing image compression…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Junhui Li , Xingsong Hou

In contrast to traditional compression techniques performing linear transforms, the latent space of popular compressive autoencoders is obtained from a learned nonlinear mapping and hard to interpret. In this paper, we explore a promising…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Anna Meyer , André Kaup

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

Recently, many deep image compression methods have been proposed and achieved remarkable performance. However, these methods are dedicated to optimizing the compression performance and speed at medium and high bitrates, while research on…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhiyuan Li , Chenyang Ge , Shun Li

Transformer architectures rely on position encodings to model the spatial structure of input data. Rotary Position Encoding (RoPE) is a widely used method in language models that encodes relative positions through fixed, block-diagonal,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Sophie Ostmeier , Brian Axelrod , Maya Varma , Michael E. Moseley , Akshay Chaudhari , Curtis Langlotz

Lossy compression algorithms aim to compactly encode images in a way which enables to restore them with minimal error. We show that a key limitation of existing algorithms is that they rely on error measures that are extremely sensitive to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Tamar Rott Shaham , Tomer Michaeli

Conceptual coding has been an emerging research topic recently, which encodes natural images into disentangled conceptual representations for compression. However, the compression performance of the existing methods is still sub-optimal due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jianhui Chang , Zhenghui Zhao , Lingbo Yang , Chuanmin Jia , Jian Zhang , Siwei Ma

Positional encodings are employed to capture the high frequency information of the encoded signals in implicit neural representation (INR). In this paper, we propose a novel positional encoding method which improves the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Bharath Bhushan Damodaran , Francois Schnitzler , Anne Lambert , Pierre Hellier

COMpression with Bayesian Implicit NEural Representations (COMBINER) is a recent data compression method that addresses a key inefficiency of previous Implicit Neural Representation (INR)-based approaches: it avoids quantization and enables…

Machine Learning · Computer Science 2024-03-08 Jiajun He , Gergely Flamich , Zongyu Guo , José Miguel Hernández-Lobato

Learned image compression (LIC) methods have exhibited promising progress and superior rate-distortion performance compared with classical image compression standards. Most existing LIC methods are Convolutional Neural Networks-based…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Jinming Liu , Heming Sun , Jiro Katto

Compressing images at extremely low bitrates (< 0.1 bpp) has always been a challenging task since the quality of reconstruction significantly reduces due to the strong imposed constraint on the number of bits allocated for the compressed…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Suraj Kiran Raman , Aditya Ramesh , Vijayakrishna Naganoor , Shubham Dash , Giridharan Kumaravelu , Honglak Lee