English
Related papers

Related papers: Characterizing Generalized Rate-Distortion Perform…

200 papers

This paper studies the rate-distortion-perception (RDP) tradeoff for a Gaussian vector source coding problem where the goal is to compress the multi-component source subject to distortion and perception constraints. Specifically, the RDP…

Information Theory · Computer Science 2025-03-18 Jingjing Qian , Sadaf Salehkalaibar , Jun Chen , Ashish Khisti , Wei Yu , Wuxian Shi , Yiqun Ge , Wen Tong

Living organisms rely on internal models of the world to act adaptively. These models, because of resource limitations, cannot encode every detail and hence need to compress information. From a cognitive standpoint, information compression…

Neurons and Cognition · Quantitative Biology 2025-02-18 Leo D'Amato , Gian Luca Lancia , Giovanni Pezzulo

This work proposes a new computational framework for learning a structured generative model for real-world datasets. In particular, we propose to learn a closed-loop transcription between a multi-class multi-dimensional data distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Xili Dai , Shengbang Tong , Mingyang Li , Ziyang Wu , Michael Psenka , Kwan Ho Ryan Chan , Pengyuan Zhai , Yaodong Yu , Xiaojun Yuan , Heung Yeung Shum , Yi Ma

Recent work has shown that Variational Autoencoders (VAEs) can be used to upper-bound the information rate-distortion (R-D) function of images, i.e., the fundamental limit of lossy image compression. In this paper, we report an improved…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Zhihao Duan , Jack Ma , Jiangpeng He , Fengqing Zhu

Sequential rate-distortion (SRD) theory provides a framework for studying the fundamental trade-off between data-rate and data-quality in real-time communication systems. In this paper, we consider the SRD problem for multi-dimensional…

Optimization and Control · Mathematics 2018-01-16 Takashi Tanaka , Kwang-Ki K. Kim , Pablo A. Parrilo , Sanjoy K. Mitter

Despite a short history, neural image codecs have been shown to surpass classical image codecs in terms of rate-distortion performance. However, most of them suffer from significantly longer decoding times, which hinders the practical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Yixin Gao , Runsen Feng , Zongyu Guo , Zhibo Chen

In this paper we analyze the joint rate distortion function (RDF), for a tuple of correlated sources taking values in abstract alphabet spaces (i.e., continuous) subject to two individual distortion criteria. First, we derive structural…

Information Theory · Computer Science 2021-05-11 Evagoras Stylianou , Charalambos D. Charalambous , Themistoklis Charalambous

3D Gaussian Splatting (3DGS) has substantial potential for enabling photorealistic Free-Viewpoint Video (FVV) experiences. However, the vast number of Gaussians and their associated attributes poses significant challenges for storage and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qiang Hu , Zihan Zheng , Houqiang Zhong , Sihua Fu , Li Song , XiaoyunZhang , Guangtao Zhai , Yanfeng Wang

The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, reconstruction fidelity, and perceptual quality. While recent neural compression methods have improved…

Information Theory · Computer Science 2026-05-25 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang

Most neural compression models are trained on large datasets of images or videos in order to generalize to unseen data. Such generalization typically requires large and expressive architectures with a high decoding complexity. Here we…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Hyunjik Kim , Matthias Bauer , Lucas Theis , Jonathan Richard Schwarz , Emilien Dupont

Large language models and deep neural networks achieve strong performance but suffer from reliability issues and high computational cost. This thesis proposes a unified framework based on spectral geometry and random matrix theory to…

Machine Learning · Computer Science 2026-01-27 Davide Ettori

The field of deep generative modeling has succeeded in producing astonishingly realistic-seeming images and audio, but quantitative evaluation remains a challenge. Log-likelihood is an appealing metric due to its grounding in statistics and…

Machine Learning · Computer Science 2020-08-18 Sicong Huang , Alireza Makhzani , Yanshuai Cao , Roger Grosse

A new source model, which consists of an intrinsic state part and an extrinsic observation part, is proposed and its information-theoretic characterization, namely its rate-distortion function, is defined and analyzed. Such a source model…

Information Theory · Computer Science 2022-06-02 Jiakun Liu , Shuo Shao , Wenyi Zhang , H. Vincent Poor

Video super-resolution (VSR) techniques, especially deep-learning-based algorithms, have drastically improved over the last few years and shown impressive performance on synthetic data. However, their performance on real-world video data…

Image and Video Processing · Electrical Eng. & Systems 2023-05-05 Mehran Jeelani , Sadbhawna , Noshaba Cheema , Klaus Illgner-Fehns , Philipp Slusallek , Sunil Jaiswal

We consider the semantic rate-distortion problem motivated by task-oriented video compression. The semantic information corresponding to the task, which is not observable to the encoder, shows impacts on the observations through a joint…

Information Theory · Computer Science 2022-08-15 Tao Guo , Yizhu Wang , Jie Han , Huihui Wu , Bo Bai , Wei Han

Visual images corrupted by various types and levels of degradations are commonly encountered in practical image compression. However, most existing image compression methods are tailored for clean images, therefore struggling to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Huimin Zeng , Jiacheng Li , Ziqiang Zheng , Zhiwei Xiong

Video compression has been investigated by means of analysis-synthesis, and more particularly by means of inpainting. The first part of our approach has been to develop the inpainting of DCT coefficients in an image. This has shown good…

Information Theory · Computer Science 2014-04-17 Matthieu Moinard , Isabelle Amonou , Pierre Duhamel , Patrice Brault

The nascent field of Rate-Distortion-Perception (RDP) theory is seeing a surge of research interest due to the application of machine learning techniques in the area of lossy compression. The information RDP function characterizes the…

Information Theory · Computer Science 2023-05-01 Chunhui Chen , Xueyan Niu , Wenhao Ye , Shitong Wu , Bo Bai , Weichao Chen , Sian-Jheng Lin

We derive fundamental accuracy limits for distributed localization when a fusion center has access only to independently rate-distortion (RD)-optimally compressed versions of multi-sensor observations, under a line-of-sight propagation…

Information Theory · Computer Science 2026-03-31 Amir Weiss

Computed Tomography (CT) enables detailed cross-sectional imaging but continues to face challenges in balancing reconstruction quality and computational efficiency. While deep learning-based methods have significantly improved image quality…

Image and Video Processing · Electrical Eng. & Systems 2025-10-23 Shaokai Wu , Yuxiang Lu , Yapan Guo , Wei Ji , Suizhi Huang , Fengyu Yang , Shalayiding Sirejiding , Qichen He , Jing Tong , Yanbiao Ji , Yue Ding , Hongtao Lu