English
Related papers

Related papers: SPIRE: Semantic Prompt-Driven Image Restoration

200 papers

Benefiting from their powerful generative capabilities, pretrained diffusion models have garnered significant attention for real-world image super-resolution (Real-SR). Existing diffusion-based SR approaches typically utilize semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jiangang Wang , Qingnan Fan , Jinwei Chen , Hong Gu , Feng Huang , Wenqi Ren

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Text-to-image diffusion models have recently received a lot of interest for their astonishing ability to produce high-fidelity images from text only. However, achieving one-shot generation that aligns with the user's intent is nearly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Manuel Brack , Felix Friedrich , Dominik Hintersdorf , Lukas Struppek , Patrick Schramowski , Kristian Kersting

Selecting an appropriate prior to compensate for information loss due to the measurement operator is a fundamental challenge in imaging inverse problems. Implicit priors based on denoising neural networks have become central to widely-used…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Matthieu Terris , Ulugbek S. Kamilov , Thomas Moreau

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

The computer vision community has developed numerous techniques for digitally restoring true scene information from single-view degraded photographs, an important yet extremely ill-posed task. In this work, we tackle image restoration from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yucheng Mao , Boyang Wang , Nilesh Kulkarni , Jeong Joon Park

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Image restoration aims to recover the high-quality images from their degraded observations. Since most existing methods have been dedicated into single degradation removal, they may not yield optimal results on other types of degradations,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Hu Gao , Depeng Dang

Text-conditioned image editing has emerged as a powerful tool for editing images. However, in many situations, language can be ambiguous and ineffective in describing specific image edits. When faced with such challenges, visual prompts can…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Thao Nguyen , Yuheng Li , Utkarsh Ojha , Yong Jae Lee

In dynamic scenes, images often suffer from dynamic blur due to superposition of motions or low signal-noise ratio resulted from quick shutter speed when avoiding motions. Recovering sharp and clean results from the captured images heavily…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Cheng Zhang , Shaolin Su , Yu Zhu , Qingsen Yan , Jinqiu Sun , Yanning Zhang

Text-guided image inpainting endeavors to generate new content within specified regions of images using textual prompts from users. The primary challenge is to accurately align the inpainted areas with the user-provided prompts while…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Chao Gong , Dong Li , Yingwei Pan , Jingjing Chen , Ting Yao , Tao Mei

Subject-driven image generation (SDIG) aims to manipulate specific subjects within images while adhering to textual instructions, a task crucial for advancing text-to-image diffusion models. SDIG requires reconciling the tension between…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jibai Lin , Bo Ma , Yating Yang , Xi Zhou , Rong Ma , Turghun Osman , Ahtamjan Ahmat , Rui Dong , Lei Wang

Recent progress in text-guided image inpainting, based on the unprecedented success of text-to-image diffusion models, has led to exceptionally realistic and visually plausible results. However, there is still significant potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hayk Manukyan , Andranik Sargsyan , Barsegh Atanyan , Zhangyang Wang , Shant Navasardyan , Humphrey Shi

Most existing image restoration methods use neural networks to learn strong image-level priors from huge data to estimate the lost information. However, these works still struggle in cases when images have severe information deficits.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yunpeng Bai , Cairong Wang , Shuzhao Xie , Chao Dong , Chun Yuan , Zhi Wang

In recent years, the demand of image compression models for machine vision has increased dramatically. However, the training frameworks of image compression still focus on the vision of human, maintaining the excessive perceptual details,…

Image and Video Processing · Electrical Eng. & Systems 2025-12-24 Hyeonjin Lee , Jun-Hyuk Kim , Jong-Seok Lee

Denoising diffusion models have recently achieved remarkable success in image generation, capturing rich information about natural image statistics. This makes them highly promising for image reconstruction, where the goal is to recover a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Shady Abu-Hussein , Tom Tirer , Raja Giryes

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

Composed Image Retrieval (CIR) uses a reference image plus a natural-language edit to retrieve images that apply the requested change while preserving other relevant visual content. Classic fusion pipelines typically rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guoyizhe Wei , Yang Jiao , Nan Xi , Zhishen Huang , Jingjing Meng , Rama Chellappa , Yan Gao