English
Related papers

Related papers: Lossy Compression with Gaussian Diffusion

200 papers

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Current video captioning methods usually use an encoder-decoder structure to generate text autoregressively. However, autoregressive methods have inherent limitations such as slow generation speed and large cumulative error. Furthermore,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junbo Wang , Liangyu Fu , Yuke Li , Yining Zhu , Ya Jing , Xuecheng Wu , Jiangbin Zheng

Diffusion-based image compression methods have achieved notable progress, delivering high perceptual quality at low bitrates. However, their practical deployment is hindered by significant inference latency and heavy computational overhead,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yiwen Jia , Hao Wei , Yanhui Zhou , Chenyang Ge

Consider a lossy compression system with $\ell$ distributed encoders and a centralized decoder. Each encoder compresses its observed source and forwards the compressed data to the decoder for joint reconstruction of the target signals under…

Information Theory · Computer Science 2018-07-19 Yizhong Wang , Li Xie , Xuan Zhang , Jun Chen

We consider the image transmission problem over a noisy wireless channel via deep learning-based joint source-channel coding (DeepJSCC) along with a denoising diffusion probabilistic model (DDPM) at the receiver. Specifically, we are…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Selim F. Yilmaz , Xueyan Niu , Bo Bai , Wei Han , Lei Deng , Deniz Gunduz

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

For learned image representations, basic autoencoders often produce blurry results. Reconstruction quality can be improved by incorporating additional penalties such as adversarial (GAN) and perceptual losses. Arguably, these approaches…

Machine Learning · Computer Science 2025-09-25 Vighnesh Birodkar , Gabriel Barcik , James Lyon , Sergey Ioffe , David Minnen , Joshua V. Dillon

Reliable image transmission over wireless channels is particularly challenging at extremely low transmission rates, where conventional compression and channel coding schemes fail to preserve adequate visual quality. To address this issue,…

Information Theory · Computer Science 2025-10-27 Shengkang Chen , Tong Wu , Zhiyong Chen , Feng Yang , Meixia Tao , Wenjun Zhang

Although there have been significant advancements in image compression techniques, such as standard and learned codecs, these methods still suffer from severe quality degradation at extremely low bits per pixel. While recent diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Chanung Park , Joo Chan Lee , Jong Hwan Ko

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output,…

This paper proposes a new compression paradigm -- Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) -- for lossy scientific data compression. The framework is based on recent conditional diffusion (CD) generative models, and…

Machine Learning · Computer Science 2025-02-19 Jaemoon Lee , Xiao Li , Liangji Zhu , Sanjay Ranka , Anand Rangarajan

We extensively study how to combine Generative Adversarial Networks and learned compression to obtain a state-of-the-art generative lossy compression system. In particular, we investigate normalization layers, generator and discriminator…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Fabian Mentzer , George Toderici , Michael Tschannen , Eirikur Agustsson

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises"…

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

We propose and study the problem of distribution-preserving lossy compression. Motivated by recent advances in extreme image compression which allow to maintain artifact-free reconstructions even at very low bitrates, we propose to optimize…

Machine Learning · Computer Science 2018-10-30 Michael Tschannen , Eirikur Agustsson , Mario Lucic

Image denoising aims to remove noise while preserving structural details and perceptual realism, yet distortion-driven methods often produce over-smoothed reconstructions, especially under strong noise and distribution shift. This paper…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nam Nguyen , Thinh Nguyen , Bella Bose

End-to-end visual communication systems typically optimize a trade-off between channel bandwidth costs and signal-level distortion metrics. However, under challenging physical conditions, this traditional coding and transmission paradigm…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Sixian Wang , Jincheng Dai , Kailin Tan , Xiaoqi Qin , Kai Niu , Ping Zhang

In spite of the fact that efficient compression methods for dense two-dimensional flow fields would be very useful for modern video codecs, hardly any research has been performed in this area so far. Our paper addresses this problem by…

Image and Video Processing · Electrical Eng. & Systems 2020-04-30 Ferdinand Jost , Pascal Peter , Joachim Weickert