English
Related papers

Related papers: Advances in Diffusion-Based Generative Compression

200 papers

Traditional image codecs emphasize signal fidelity and human perception, often at the expense of machine vision tasks. Deep learning methods have demonstrated promising coding performance by utilizing rich semantic embeddings optimized for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Sha Guo , Zhuo Chen , Yang Zhao , Ning Zhang , Xiaotong Li , Lingyu Duan

Robust invisible watermarking aims to embed hidden messages into images such that they survive various manipulations while remaining imperceptible. However, powerful diffusion-based image generation and editing models now enable realistic…

Cryptography and Security · Computer Science 2025-11-11 Wenkai Fu , Finn Carter , Yue Wang , Emily Davis , Bo Zhang

Image restoration (IR) has been an indispensable and challenging task in the low-level vision field, which strives to improve the subjective quality of images distorted by various forms of degradation. Recently, the diffusion model has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xin Li , Yulin Ren , Xin Jin , Cuiling Lan , Xingrui Wang , Wenjun Zeng , Xinchao Wang , Zhibo Chen

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

Machine Learning · Computer Science 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jun Han , Salvator Lombardo , Christopher Schroers , Stephan Mandt

This paper explores the use of score-based diffusion models for Bayesian image reconstruction. Diffusion models are an efficient tool for generative modeling. Diffusion models can also be used for solving image reconstruction problems. We…

Image and Video Processing · Electrical Eng. & Systems 2025-10-06 Michael T. McCann , Hyungjin Chung , Jong Chul Ye , Marc L. Klasky

Many applications from camera arrays to sensor networks require efficient compression and processing of correlated data, which in general is collected in a distributed fashion. While information-theoretic foundations of distributed…

Information Theory · Computer Science 2024-02-14 Ezgi Ozyilkan , Elza Erkip

Can continuous diffusion models bring the same performance breakthrough on natural language they did for image generation? To circumvent the discrete nature of text data, we can simply project tokens in a continuous space of embeddings, as…

Diffusion probabilistic models have recently achieved remarkable success in generating high-quality images. However, balancing high perceptual quality and low distortion remains challenging in application of diffusion models in image…

Image and Video Processing · Electrical Eng. & Systems 2025-12-23 Juan Song , Jiaxiang He , Lijie Yang , Mingtao Feng , Keyan Wang

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

We consider the image transmission problem over a noisy wireless channel via deep learning-based joint source-channel coding (DeepJSCC) along with a denoising diffusion probabilistic model (DDPM) at the receiver. Specifically, we are…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Selim F. Yilmaz , Xueyan Niu , Bo Bai , Wei Han , Lei Deng , Deniz Gunduz

Image compression at extremely low bitrates (below 0.1 bits per pixel (bpp)) is a significant challenge due to substantial information loss. In this work, we propose a novel two-stage extreme image compression framework that exploits the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Zhiyuan Li , Yanhui Zhou , Hao Wei , Chenyang Ge , Jingwen Jiang

Recent advances in deep learning have enabled the generation of realistic data by training generative models on large datasets of text, images, and audio. While these models have demonstrated exceptional performance in generating novel and…

Materials Science · Physics 2024-06-17 Izumi Takahara , Kiyou Shibata , Teruyasu Mizoguchi

In recent deep image compression neural networks, the entropy model plays a critical role in estimating the prior distribution of deep image encodings. Existing methods combine hyperprior with local context in the entropy estimation…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Yichen Qian , Zhiyu Tan , Xiuyu Sun , Ming Lin , Dongyang Li , Zhenhong Sun , Hao Li , Rong Jin

Cross-Modal learning tasks have picked up pace in recent times. With plethora of applications in diverse areas, generation of novel content using multiple modalities of data has remained a challenging problem. To address the same, various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Nikhil Verma

Generative AI has seen remarkable growth over the past few years, with diffusion models being state-of-the-art for image generation. This study investigates the use of diffusion models in generating artificial data generation for electronic…

Machine Learning · Computer Science 2023-10-18 Prasha Srivastava , Pawan Kumar , Zia Abbas

Diffusion models are rising as a powerful solution for high-fidelity image generation, which exceeds GANs in quality in many circumstances. However, their slow training and inference speed is a huge bottleneck, blocking them from being used…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Hao Phung , Quan Dao , Anh Tran