English
Related papers

Related papers: Lossy Compression with Pretrained Diffusion Models

200 papers

Diffusion models have proven to be highly effective in generating high-quality images. However, adapting large pre-trained diffusion models to new domains remains an open challenge, which is critical for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Enze Xie , Lewei Yao , Han Shi , Zhili Liu , Daquan Zhou , Zhaoqiang Liu , Jiawei Li , Zhenguo Li

This research presents a novel framework for the compression and decompression of medical images utilizing the Latent Diffusion Model (LDM). The LDM represents advancement over the denoising diffusion probabilistic model (DDPM) with a…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 InChan Hwang , MinJae Woo

Image compression under ultra-low bitrates remains challenging for both conventional learned image compression (LIC) and generative vector-quantized (VQ) modeling. Conventional LIC suffers from severe artifacts due to heavy quantization,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Lei Lu , Yize Li , Yanzhi Wang , Wei Wang , Wei Jiang

We introduce a novel, training-free method for sampling differentiable representations (diffreps) using pretrained diffusion models. Rather than merely mode-seeking, our method achieves sampling by "pulling back" the dynamics of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yash Savani , Marc Finzi , J. Zico Kolter

We propose the first practical learned lossless image compression system, L3C, and show that it outperforms the popular engineered codecs, PNG, WebP and JPEG 2000. At the core of our method is a fully parallelizable hierarchical…

Image and Video Processing · Electrical Eng. & Systems 2020-03-09 Fabian Mentzer , Eirikur Agustsson , Michael Tschannen , Radu Timofte , Luc Van Gool

With the increasing popularity of deep learning in image processing, many learned lossless image compression methods have been proposed recently. One group of algorithms that have shown good performance are based on learned pixel-based…

Image and Video Processing · Electrical Eng. & Systems 2022-12-27 Fatih Kamisli

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

Diffusion models have become a successful approach for solving various image inverse problems by providing a powerful diffusion prior. Many studies tried to combine the measurement into diffusion by score function replacement, matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Hanyu Chen , Zhixiu Hao , Liying Xiao

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Diffusion models have gained significant attention for high-fidelity image generation. Our work investigates the potential of exploiting diffusion models for adversarial robustness in image classification and object detection. Adversarial…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Mika Yagoda , Shady Abu-Hussein , Raja Giryes

As generative technologies advance, visual content has evolved into a complex mix of natural and AI-generated images, driving the need for more efficient coding techniques that prioritize perceptual quality. Traditional codecs and learned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jianhui Chang

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

Transformer-based diffusion models offer superior scalability and performance but suffer from high computational overhead due to the iterative nature and quadratic complexity of self-attention at high resolutions. In this paper, we propose…

Hardware Architecture · Computer Science 2026-05-26 Jieon Yoon , Hangyeol Lee , Jaehoon Heo , Joo-Young Kim

While diffusion models have achieved great success in the field of video generation, this progress is accompanied by a rapidly escalating computational burden. Among the existing acceleration methods, Feature Caching is popular due to its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chang Zou , Changlin Li , Yang Li , Patrol Li , Jianbing Wu , Xiao He , Songtao Liu , Zhao Zhong , Kailin Huang , Linfeng Zhang

Lossy compression introduces complex compression artifacts, particularly the blocking artifacts, ringing effects and blurring. Existing algorithms either focus on removing blocking artifacts and produce blurred output, or restores sharpened…

Computer Vision and Pattern Recognition · Computer Science 2015-04-28 Chao Dong , Yubin Deng , Chen Change Loy , Xiaoou Tang

Diffusion models have demonstrated their effectiveness across various generative tasks. However, when applied to medical image segmentation, these models encounter several challenges, including significant resource and time requirements.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Lin , Zhiguang Chen , Zhonghao Yan , Weijiang Yu , Fudan Zheng

Compressive sensing(CS) has drawn much attention in recent years due to its low sampling rate as well as high recovery accuracy. As an important procedure, reconstructing a sparse signal from few measurement data has been intensively…

Information Theory · Computer Science 2018-06-25 Yicong He , Fei Wang , Shiyuan Wang , Badong Chen