English
Related papers

Related papers: Steering One-Step Diffusion Model with Fidelity-Ri…

200 papers

Denoising diffusion models achieved impressive results on several image generation tasks often outperforming GAN based models. Recently, the generative capabilities of diffusion models have been employed for perceptual image compression,…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Jonas Brenig , Radu Timofte

Diffusion Model (DM) based Semantic Image Communication (SIC) systems face significant challenges, such as slow inference speed and generation randomness, that limit their reliability and practicality. To overcome these issues, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Bilal Khalid , Pedro Freire , Sergei K. Turitsyn , Jaroslaw E. Prilepsky

Diffusion models have demonstrated exceptional success in video super-resolution (VSR), exhibiting powerful capabilities for generating fine-grained details. However, their potential for space-time video super-resolution (STVSR), which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Shuoyan Wei , Feng Li , Chen Zhou , Runmin Cong , Yao Zhao , Huihui Bai

Pre-trained diffusion models have shown great potential in real-world image super-resolution (Real-ISR) tasks by enabling high-resolution reconstructions. While one-step diffusion (OSD) methods significantly improve efficiency compared to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zongliang Wu , Siming Zheng , Peng-Tao Jiang , Xin Yuan

Video frame prediction extrapolates future frames from previous frames, but suffers from prediction errors in dynamic scenes due to the lack of information about the next frame. Event cameras address this limitation by capturing per-pixel…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Jiyun Kong , Jun-Hyuk Kim , Jong-Seok Lee

Real-world image super-resolution (Real-ISR) aims to reconstruct high-resolution images from low-resolution inputs degraded by complex, unknown processes. While many Stable Diffusion (SD)-based Real-ISR methods have achieved remarkable…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Bin Chen , Gehui Li , Rongyuan Wu , Xindong Zhang , Jie Chen , Jian Zhang , Lei Zhang

Diffusion models have achieved remarkable performance on a wide range of generative tasks, yet training them from scratch is notoriously resource-intensive, typically requiring millions of training images and many GPU days. Motivated by a…

Machine Learning · Computer Science 2026-03-16 Rui Huang , Shitong Shao , Zikai Zhou , Pukun Zhao , Hangyu Guo , Tian Ye , Lichen Bai , Shuo Yang , Zeke Xie

Recent work showed that large diffusion models can be reused as highly precise monocular depth estimators by casting depth estimation as an image-conditional image generation task. While the proposed model achieved state-of-the-art results,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Gonzalo Martin Garcia , Karim Knaebel , Christian Schmidt , Daan de Geus , Alexander Hermans , Bastian Leibe

Diffusion-based models have been widely used in various visual generation tasks, showing promising results in image super-resolution (SR), while typically being limited by dozens or even hundreds of sampling steps. Although existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Xue Wu , Jingwei Xin , Zhijun Tu , Jie Hu , Jie Li , Nannan Wang , Xinbo Gao

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

Text-to-image diffusion models can create stunning images from natural language descriptions that rival the work of professional artists and photographers. However, these models are large, with complex network architectures and tens of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yanyu Li , Huan Wang , Qing Jin , Ju Hu , Pavlo Chemerys , Yun Fu , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Diffusion models excel at image restoration via probabilistic modeling of forward noise addition and reverse denoising, and their ability to handle complex noise while preserving fine details makes them well-suited for Low-Light Image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Ying Liu , Junchao Zhang , Caiyun Wu

Diffusion models have been demonstrated as strong priors for solving general inverse problems. Most existing Diffusion model-based Inverse Problem Solvers (DIS) employ a plug-and-play approach to guide the sampling trajectory with either…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiankun Zhao , Bowen Song , Liyue Shen

The emergence of diffusion models has significantly advanced generative AI, improving the quality, realism, and creativity of image and video generation. Among them, Stable Diffusion (StableDiff) stands out as a key model for text-to-image…

Hardware Architecture · Computer Science 2025-07-03 Zhican Wang , Guanghui He , Hongxiang Fan

Recent advances in multimodal models highlight the pivotal role of image tokenization in high-resolution image generation. By compressing images into compact latent representations, tokenizers enable generative models to operate in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Qihang Rao , Borui Zhang , Wenzhao Zheng , Jie Zhou , Jiwen Lu

The recent use of diffusion prior, enhanced by pre-trained text-image models, has markedly elevated the performance of image super-resolution (SR). To alleviate the huge computational cost required by pixel-based diffusion SR, latent-based…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Feng Luo , Jinxi Xiang , Jun Zhang , Xiao Han , Wei Yang

Diffusion models demonstrate outstanding performance in image generation, but their multi-step inference mechanism requires immense computational cost. Previous works accelerate inference by leveraging layer or token cache techniques to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haowei Zhu , Ji Liu , Ziqiong Liu , Dong Li , Junhai Yong , Bin Wang , Emad Barsoum

Diffusion models have shown strong performance in speech enhancement, but their real-time applicability has been limited by multi-step iterative sampling. Consistency distillation has recently emerged as a promising alternative by…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-19 Liang Xu , Longfei Felix Yan , W. Bastiaan Kleijn

Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ce Wang , Zhenyu Hu , Wanjie Sun

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel