English
Related papers

Related papers: Diffusion-based Blind Text Image Super-Resolution

200 papers

Diffusion models have recently received a surge of interest due to their impressive performance for image restoration, especially in terms of noise robustness. However, existing diffusion-based methods are trained on a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuchun Miao , Lefei Zhang , Liangpei Zhang , Dacheng Tao

While burst LR images are useful for improving the SR image quality compared with a single LR image, prior SR networks accepting the burst LR images are trained in a deterministic manner, which is known to produce a blurry SR image. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

Volumetric optical microscopy using non-diffracting beams enables rapid imaging of 3D volumes by projecting them axially to 2D images but lacks crucial depth information. Addressing this, we introduce MicroDiffusion, a pioneering tool…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Mude Hui , Zihao Wei , Hongru Zhu , Fei Xia , Yuyin Zhou

Diffusion models (DM) have achieved remarkable promise in image super-resolution (SR). However, most of them are tailored to solving non-blind inverse problems with fixed known degradation settings, limiting their adaptability to real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Feng Li , Yixuan Wu , Zichao Liang , Runmin Cong , Huihui Bai , Yao Zhao , Meng Wang

Recently, the strong latent Diffusion Probabilistic Model (DPM) has been applied to high-quality Text-to-Image (T2I) generation (e.g., Stable Diffusion), by injecting the encoded target text prompt into the gradually denoised diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Mingyang Yi , Aoxue Li , Yi Xin , Zhenguo Li

Diffusion models have gained significant popularity in the field of image-to-image translation. Previous efforts applying diffusion models to image super-resolution (SR) have demonstrated that iteratively refining pure Gaussian noise using…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Axi Niu , Pham Xuan Trung , Kang Zhang , Jinqiu Sun , Yu Zhu , In So Kweon , Yanning Zhang

Diffusion probabilistic models (DPMs) have exhibited exceptional proficiency in generating visual media of outstanding quality and realism. Nonetheless, their potential in non-generative domains, such as face recognition, has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Bowen Sun , Shibao Zheng

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

In this paper, we present DesignDiffusion, a simple yet effective framework for the novel task of synthesizing design images from textual descriptions. A primary challenge lies in generating accurate and style-consistent textual and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zhendong Wang , Jianmin Bao , Shuyang Gu , Dong Chen , Wengang Zhou , Houqiang Li

Diffusion models have achieved remarkable success in the domain of text-guided image generation and, more recently, in text-guided image editing. A commonly adopted strategy for editing real images involves inverting the diffusion process…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Wonjun Kang , Kevin Galim , Hyung Il Koo

Garment restoration, the inverse of virtual try-on task, focuses on restoring standard garment from a person image, requiring accurate capture of garment details. However, existing methods often fail to preserve the identity of the garment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Le Shen , Rong Huang , Zhijie Wang

This study introduces an efficient and effective method, MeDM, that utilizes pre-trained image Diffusion Models for video-to-video translation with consistent temporal flow. The proposed framework can render videos from scene position…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ernie Chu , Tzuhsuan Huang , Shuo-Yen Lin , Jun-Cheng Chen

Diffusion-based text-to-image generation models trade latency for quality: small models are fast but generate lower-quality images, while large models produce better images but are slow. We present MoDM, a novel caching-based serving system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Yuchen Xia , Divyam Sharma , Yichao Yuan , Souvik Kundu , Nishil Talati

Large-scale, pre-trained Text-to-Image (T2I) diffusion models have gained significant popularity in image generation tasks and have shown unexpected potential in image Super-Resolution (SR). However, most existing T2I diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Brian B. Moser , Stanislav Frolov , Tobias C. Nauen , Federico Raue , Andreas Dengel

Though diffusion models have been successfully applied to various image restoration (IR) tasks, their performance is sensitive to the choice of training datasets. Typically, diffusion models trained in specific datasets fail to recover…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Large-scale pre-trained diffusion models are becoming increasingly popular in solving the Real-World Image Super-Resolution (Real-ISR) problem because of their rich generative priors. The recent development of diffusion transformer (DiT)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheng-Peng Duan , Jiawei Zhang , Xin Jin , Ziheng Zhang , Zheng Xiong , Dongqing Zou , Jimmy S. Ren , Chun-Le Guo , Chongyi Li

Infrared imaging is essential for autonomous driving and robotic operations as a supportive modality due to its reliable performance in challenging environments. Despite its popularity, the limitations of infrared cameras, such as low…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xingyuan Li , Zirui Wang , Yang Zou , Zhixin Chen , Jun Ma , Zhiying Jiang , Long Ma , Jinyuan Liu

Diffusion models have recently shown the ability to generate high-quality images. However, controlling its generation process still poses challenges. The image style transfer task is one of those challenges that transfers the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Kento Masui , Mayu Otani , Masahiro Nomura , Hideki Nakayama

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Diffusion distillation represents a highly promising direction for achieving faithful text-to-image generation in a few sampling steps. However, despite recent successes, existing distilled models still do not provide the full spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Nikita Starodubcev , Mikhail Khoroshikh , Artem Babenko , Dmitry Baranchuk