English
Related papers

Related papers: ControlSR: Taming Diffusion Models for Consistent …

200 papers

Diffusion models (DMs) have shown promising results on single-image super-resolution and other image-to-image translation tasks. Benefiting from more computational resources and longer inference times, they are able to yield more realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yuanting Fan , Chengxu Liu , Nengzhong Yin , Changlong Gao , Xueming Qian

Denoising diffusion models have recently shown impressive results in generative tasks. By learning powerful priors from huge collections of training images, such models are able to gradually modify complete noise to a clean natural image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Naama Pearl , Yaron Brodsky , Dana Berman , Assaf Zomet , Alex Rav Acha , Daniel Cohen-Or , Dani Lischinski

With the rapid advancement of remote sensing technology, super-resolution image reconstruction is of great research and practical significance. Existing deep learning methods have made progress but still face limitations in handling complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Shijie Lyu

Generating realistic animated videos from static images is an important area of research in computer vision. Methods based on physical simulation and motion prediction have achieved notable advances, but they are often limited to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qiang Wang , Minghua Liu , Junjun Hu , Fan Jiang , Mu Xu

Self-supervised learning is crucial for super-resolution because ground-truth images are usually unavailable for real-world settings. Existing methods derive self-supervision from low-resolution images by creating pseudo-pairs or by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yuehan Zhang , Angela Yao

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

Clean images are crucial for visual tasks such as small object detection, especially at high resolutions. However, real-world images are often degraded by adverse weather, and weather restoration methods may sacrifice high-frequency details…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Wenjie Li , Jinglei Shi , Jin Han , Heng Guo , Zhanyu Ma

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

Recently, diffusion models have shown remarkable results in image synthesis by gradually removing noise and amplifying signals. Although the simple generative process surprisingly works well, is this the best way to generate image data? For…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Sangyun Lee , Hyungjin Chung , Jaehyeon Kim , Jong Chul Ye

This paper presents a novel method for exerting fine-grained lighting control during text-driven diffusion-based image generation. While existing diffusion models already have the ability to generate images under any lighting condition,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Chong Zeng , Yue Dong , Pieter Peers , Youkang Kong , Hongzhi Wu , Xin Tong

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Diffusion models have demonstrated high-quality performance in conditional text-to-image generation, particularly with structural cues such as edges, layouts, and depth. However, lighting conditions have received limited attention and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Ryugo Morita , Stanislav Frolov , Brian Bernhard Moser , Ko Watanabe , Riku Takahashi , Andreas Dengel

To prevent unauthorized use of text in images, Scene Text Removal (STR) has become a crucial task. It focuses on automatically removing text and replacing it with a natural, text-less background while preserving significant details such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanhita Pathak , Vinay Kaushik , Brejesh Lall

Single image super-resolution (SISR), which aims to reconstruct a high-resolution (HR) image from a low-resolution (LR) observation, has been an active research topic in the area of image processing in recent decades. Particularly, deep…

Image and Video Processing · Electrical Eng. & Systems 2021-03-04 Honggang Chen , Xiaohai He , Linbo Qing , Yuanyuan Wu , Chao Ren , Ce Zhu

Recently, generative diffusion priors have made huge strides as inverse problem solvers, including the ability to be adapted for inference on out-of-distribution data. Concurrently, implicit neural representations (INRs) have emerged as…

Image and Video Processing · Electrical Eng. & Systems 2026-03-12 Maliha Hossain , Haley Duba-Sullivan , Amirkoushyar Ziabari

Diffusion models for super-resolution (SR) produce high-quality visual results but require expensive computational costs. Despite the development of several methods to accelerate diffusion-based SR models, some (e.g., SinSR) fail to produce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Daniil Selikhanovych , David Li , Aleksei Leonov , Nikita Gushchin , Sergei Kushneriuk , Alexander Filippov , Evgeny Burnaev , Iaroslav Koshelev , Alexander Korotin

We present a novel method for diffusion-guided frameworks for view-consistent super-resolution (SR) in neural rendering. Our approach leverages existing 2D SR models in conjunction with advanced techniques such as Variational Score…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Shrey Vishen , Jatin Sarabu , Saurav Kumar , Chinmay Bharathulwar , Rithwick Lakshmanan , Vishnu Srinivas

Despite significant progress in text-to-image diffusion models, achieving precise spatial control over generated outputs remains challenging. ControlNet addresses this by introducing an auxiliary conditioning module, while ControlNet++…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Nina Konovalova , Maxim Nikolaev , Andrey Kuznetsov , Aibek Alanov

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

Text-to-image generation has witnessed great progress, especially with the recent advancements in diffusion models. Since texts cannot provide detailed conditions like object appearance, reference images are usually leveraged for the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhiqi Huang , Huixin Xiong , Haoyu Wang , Longguang Wang , Zhiheng Li