English
Related papers

Related papers: RFSR: Improving ISR Diffusion Models via Reward Fe…

200 papers

While super-resolution (SR) methods based on diffusion models exhibit promising results, their practical application is hindered by the substantial number of required inference steps. Recent methods utilize degraded images in the initial…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yufei Wang , Wenhan Yang , Xinyuan Chen , Yaohui Wang , Lanqing Guo , Lap-Pui Chau , Ziwei Liu , Yu Qiao , Alex C. Kot , Bihan Wen

While diffusion-based image restoration (IR) methods have achieved remarkable success, they are still limited by the low inference speed attributed to the necessity of executing hundreds or even thousands of sampling steps. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Deep learning techniques have been applied in the context of image super-resolution (SR), achieving remarkable advances in terms of reconstruction performance. Existing techniques typically employ highly complex model structures which…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Yuxuan Jiang , Jakub Nawala , Fan Zhang , David Bull

Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ce Wang , Zhenyu Hu , Wanjie Sun

Learning rewards from expert videos offers an affordable and effective solution to specify the intended behaviors for reinforcement learning (RL) tasks. In this work, we propose Diffusion Reward, a novel framework that learns rewards from…

Machine Learning · Computer Science 2024-08-12 Tao Huang , Guangqi Jiang , Yanjie Ze , Huazhe Xu

Diffusion-based approaches have recently driven remarkable progress in real-world image super-resolution (SR). However, existing methods still struggle to simultaneously preserve fine details and ensure high-fidelity reconstruction, often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Aro Kim , Myeongjin Jang , Chaewon Moon , Youngjin Shin , Jinwoo Jeong , Sang-hyo Park

Deformable image registration aims to precisely align medical images from different modalities or times. Traditional deep learning methods, while effective, often lack interpretability, real-time observability and adjustment capacity during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yongtai Zhuo , Yiqing Shen

Diffusion models have shown impressive performance in many domains. However, the model's capability to follow natural language instructions (e.g., spatial relationships between objects, generating complex scenes) is still unsatisfactory. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Xinyan Chen , Jiaxin Ge , Tianjun Zhang , Jiaming Liu , Shanghang Zhang

A low-resolution digital surface model (DSM) features distinctive attributes impacted by noise, sensor limitations and data acquisition conditions, which failed to be replicated using simple interpolation methods like bicubic. This causes…

Image and Video Processing · Electrical Eng. & Systems 2024-04-08 Daniel Panangian , Ksenia Bittner

Diffusion models achieve remarkable quality in image generation, but at a cost. Iterative denoising requires many time steps to produce high fidelity images. We argue that the denoising process is crucially limited by an accumulation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Hui Lu , Albert ali Salah , Ronald Poppe

Iterative denoising-based generation, also known as denoising diffusion models, has recently been shown to be comparable in quality to other classes of generative models, and even surpass them. Including, in particular, Generative…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Yaniv Benny , Lior Wolf

Diffusion probabilistic models (DPM) have been widely adopted in image-to-image translation to generate high-quality images. Prior attempts at applying the DPM to image super-resolution (SR) have shown that iteratively refining a pure…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Axi Niu , Kang Zhang , Trung X. Pham , Jinqiu Sun , Yu Zhu , In So Kweon , Yanning Zhang

Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generating realistic details, and ensuring pixel-level consistency.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xinqi Lin , Fanghua Yu , Jinfan Hu , Zhiyuan You , Wu Shi , Jimmy S. Ren , Jinjin Gu , Chao Dong

Single-image super-resolution (SISR) typically focuses on restoring various degraded low-resolution (LR) images to a single high-resolution (HR) image. However, during SISR tasks, it is often challenging for models to simultaneously…

Image and Video Processing · Electrical Eng. & Systems 2023-11-10 Xin Wang , Jing-Ke Yan , Jing-Ye Cai , Jian-Hua Deng , Qin Qin , Yao Cheng

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

Machine Learning · Computer Science 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Despite strong image-generation performance, diffusion models' reconstruction objectives limit alignment with human preferences. RL enables such alignment through explicit rewards. However, most studies apply RL to the full denoising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Renye Yan , Jikang Cheng , Shikun Sun , Yi Sun , You Wu , Wei Peng , Zongwei Wang , Ling Liang , Junliang Xing , Yimao Cai

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub

Benefiting from pre-trained text-to-image (T2I) diffusion models, real-world image super-resolution (Real-ISR) methods can synthesize rich and realistic details. However, due to the inherent stochasticity of T2I models, different noise…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Rongyuan Wu , Lingchen Sun , Zhengqiang Zhang , Shihao Wang , Tianhe Wu , Qiaosi Yi , Shuai Li , Lei Zhang

Real-world image super-resolution (Real-ISR) must handle complex degradations and inherent reconstruction ambiguities. While generative models have improved perceptual quality, a key trade-off remains with computational cost. One-step…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yun Kai Zhuang

Masked Generative Models (MGM)s demonstrate strong capabilities in generating high-fidelity images. However, they need many sampling steps to create high-quality generations, resulting in slow inference speed. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Pranav Subbaraman , Shufan Li , Siyan Zhao , Aditya Grover