English
Related papers

Related papers: Unified Diffusion Transformer for High-fidelity Te…

200 papers

The recovery of high-quality images from images corrupted by lens flare presents a significant challenge in low-level vision. Contemporary deep learning methods frequently entail training a lens flare removing model from scratch. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Tianwen Zhou , Qihao Duan , Zitong Yu

Starting from flow- and diffusion-based transformers, Multi-modal Diffusion Transformers (MM-DiTs) have reshaped text-to-vision generation, gaining acclaim for exceptional visual fidelity. As these models advance, users continually push the…

Artificial Intelligence · Computer Science 2025-10-07 Seil Kang , Woojung Han , Dayun Ju , Seong Jae Hwang

Many image restoration (IR) tasks require both pixel-level fidelity and high-level semantic understanding to recover realistic photos with fine-grained details. However, previous approaches often struggle to effectively leverage both the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Cuixin Yang , Rongkang Dong , Kin-Man Lam

Diffusion models are widely recognized for their ability to generate high-fidelity images. Despite the excellent performance and scalability of the Diffusion Transformer (DiT) architecture, it applies fixed compression across different…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Weinan Jia , Mengqi Huang , Nan Chen , Lei Zhang , Zhendong Mao

Text-to-Image (T2I) diffusion models have made remarkable advancements in generative modeling; however, they face a trade-off between inference speed and image quality, posing challenges for efficient deployment. Existing distilled T2I…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Senmao Li , Lei Wang , Kai Wang , Tao Liu , Jiehang Xie , Joost van de Weijer , Fahad Shahbaz Khan , Shiqi Yang , Yaxing Wang , Jian Yang

Diffusion Transformers (DiTs) have exhibited robust capabilities in image generation tasks. However, accurate text-guided image editing for multimodal DiTs (MM-DiTs) still poses a significant challenge. Unlike UNet-based structures that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yu Xu , Fan Tang , Juan Cao , Yuxin Zhang , Xiaoyu Kong , Jintao Li , Oliver Deussen , Tong-Yee Lee

We introduce a diffusion-transformer (DiT) framework for single-image reflection removal that leverages the generalization strengths of foundation diffusion models in the restoration setting. Rather than relying on task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Daniyar Zakarin , Thiemo Wandel , Anton Obukhov , Dengxin Dai

Recent advances in diffusion-based Large Restoration Models (LRMs) have significantly improved photo-realistic image restoration by leveraging the internal knowledge embedded within model weights. However, existing LRMs often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hang Guo , Tao Dai , Zhihao Ouyang , Taolin Zhang , Yaohua Zha , Bin Chen , Shu-tao Xia

Discrete Wavelet Transform (DWT) has been widely explored to enhance the performance of image superresolution (SR). Despite some DWT-based methods improving SR by capturing fine-grained frequency signals, most existing approaches neglect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Peng Du , Hui Li , Han Xu , Paul Barom Jeon , Dongwook Lee , Daehyun Ji , Ran Yang , Feng Zhu

Image super-resolution pursuits reconstructing high-fidelity high-resolution counterpart for low-resolution image. In recent years, diffusion-based models have garnered significant attention due to their capabilities with rich prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aiwen Jiang , Zhi Wei , Long Peng , Feiqiang Liu , Wenbo Li , Mingwen Wang

Image-to-image translation aims to learn a mapping between a source and a target domain, enabling tasks such as style transfer, appearance transformation, and domain adaptation. In this work, we explore a diffusion-based framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qiang Zhu , Kuan Lu , Menghao Huo , Yuxiao Li

While recent advancements in Image Super-Resolution (SR) using diffusion models have shown promise in improving overall image quality, their application to scene text images has revealed limitations. These models often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Keren Ye , Ignacio Garcia Dorado , Michalis Raptis , Mauricio Delbracio , Irene Zhu , Peyman Milanfar , Hossein Talebi

Multi-reference image generation aims to synthesize images from textual instructions while faithfully preserving subject identities from multiple reference images. Existing VLM-enhanced diffusion models commonly rely on decoupled visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yiyan Xu , Qiulin Wang , Wenjie Wang , Yunyao Mao , Xintao Wang , Pengfei Wan , Kun Gai , Fuli Feng

Realistic image restoration is a crucial task in computer vision, and diffusion-based models for image restoration have garnered significant attention due to their ability to produce realistic results. Restoration can be seen as a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Yuhong Zhang , Hengsheng Zhang , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Deep learning has led to considerable advances in text-to-speech synthesis. Most recently, the adoption of Score-based Generative Models (SGMs), also known as Diffusion Probabilistic Models (DPMs), has gained traction due to their ability…

Face video restoration (FVR) is a challenging but important problem where one seeks to recover a perceptually realistic face videos from a low-quality input. While diffusion probabilistic models (DPMs) have been shown to achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zihao Zou , Jiaming Liu , Shirin Shoushtari , Yubo Wang , Weijie Gan , Ulugbek S. Kamilov

Motion blur in scene text images severely impairs readability and hinders the reliability of computer vision tasks, including autonomous driving, document digitization, and visual information retrieval. Conventional deblurring approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Umar Rashid , Muhammad Arslan Arshad , Ghulam Ahmad , Muhammad Zeeshan Anjum , Rizwan Khan , Muhammad Akmal

Diffusion Transformer (DiT) faces challenges when generating images with higher resolution compared at training resolution, causing especially structural degradation due to attention dilution. Previous approaches attempt to mitigate this by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yihua Liu , Fanjiang Ye , Bowen Lin , Rongyu Fang , Chengming Zhang

All-in-One Image Restoration (AiOIR) faces the fundamental challenge in reconciling conflicting optimization objectives across heterogeneous degradations. Existing methods are often constrained by coarse-grained control mechanisms or fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Luwei Tu , Jiawei Wu , Xing Luo , Zhi Jin

Text-guided image generation and editing using diffusion models have achieved remarkable advancements. Among these, tuning-free methods have gained attention for their ability to perform edits without extensive model adjustments, offering…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen