English
Related papers

Related papers: SDiT: Semantic Region-Adaptive for Diffusion Trans…

200 papers

Diffusion Transformers (DiTs) achieve state-of-the-art generation quality but require long sequential denoising trajectories, leading to high inference latency. Recent speculative inference methods enable lossless parallel sampling in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xinwan Wen , Bowen Li , Jiajun Luo , Ye Li , Zhi Wang

Diffusion Transformer (DiT) has driven significant progress in image generation tasks. However, DiT inferencing is notoriously compute-intensive and incurs long latency even on datacenter-scale GPUs, primarily due to its iterative nature…

Hardware Architecture · Computer Science 2025-04-14 Daeun Kim , Jinwoo Hwang , Changhun Oh , Jongse Park

Recently, Transformers have gained significant popularity in image restoration tasks such as image super-resolution and denoising, owing to their superior performance. However, balancing performance and computational burden remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Leheng Zhang , Wei Long , Yawei Li , Xingyu Zhou , Xiaorui Zhao , Shuhang Gu

While diffusion models excel at image synthesis, useful representations have been shown to emerge from generative pre-training, suggesting a path towards unified generative and discriminative learning. However, suboptimal semantic flow…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Weilai Xiang , Hongyu Yang , Di Huang , Yunhong Wang

Diffusion models dominate image editing, yet their global denoising mechanism entangles edited regions with surrounding context, causing modifications to propagate into areas that should remain intact. We propose a fundamentally different…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Wei Chow , Linfeng Li , Xian Sun , Lingdong Kong , Zefeng Li , Qi Xu , Hang Song , Tian Ye , Xian Wang , Jinbin Bai , Shilin Xu , Xiangtai Li , Junting Pan , Shaoteng Liu , Ran Zhou , Tianshu Yang , Songhua Liu

Pre-trained stable diffusion models (SD) have shown great advances in visual correspondence. In this paper, we investigate the capabilities of Diffusion Transformers (DiTs) for accurate dense correspondence. Distinct from SD, DiTs exhibit a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chaofan Gan , Yuanpeng Tu , Xi Chen , Tieyuan Chen , Yuxi Li , Mehrtash Harandi , Weiyao Lin

Recent breakthroughs of transformer-based diffusion models, particularly with Multimodal Diffusion Transformers (MMDiT) driven models like FLUX and Qwen Image, have facilitated thrilling experiences in text-to-image generation and editing.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

Nature is infinitely resolution-free. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zeyu Lu , Zidong Wang , Di Huang , Chengyue Wu , Xihui Liu , Wanli Ouyang , Lei Bai

Diffusion models have shown strong capabilities in generating high-quality images from text prompts. However, these models often require large-scale training data and significant computational resources to train, or suffer from heavy…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Tong Shen , Jingai Yu , Dong Zhou , Dong Li , Emad Barsoum

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

Diffusion-based video editing has emerged as an important paradigm for high-quality and flexible content generation. However, despite their generality and strong modeling capacity, Diffusion Transformers (DiT) remain computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Tianyi Liu , Ye Lu , Linfeng Zhang , Chen Cai , Jianjun Gao , Yi Wang , Kim-Hui Yap , Lap-Pui Chau

Recent multimodal face generation models address the spatial control limitations of text-to-image diffusion models by augmenting text-based conditioning with spatial priors such as segmentation masks, sketches, or edge maps. This multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bharath Krishnamurthy , Ajita Rattani

This paper explores image modeling from the frequency space and introduces DCTdiff, an end-to-end diffusion generative paradigm that efficiently models images in the discrete cosine transform (DCT) space. We investigate the design space of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Mang Ning , Mingxiao Li , Jianlin Su , Haozhe Jia , Lanmiao Liu , Martin Beneš , Wenshuo Chen , Albert Ali Salah , Itir Onal Ertugrul

Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-quality image and video generation, yet their iterative denoising process incurs substantial computational cost during inference. Existing caching methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Guandong Li

Current text-to-image (T2I) generation models struggle to align spatial composition with the input text, especially in complex scenes. Even layout-based approaches yield suboptimal spatial control, as their generation process is decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheyuan Liu , Munan Ning , Qihui Zhang , Shuo Yang , Zhongrui Wang , Yiwei Yang , Xianzhe Xu , Yibing Song , Weihua Chen , Fan Wang , Li Yuan

We present the Hourglass Diffusion Transformer (HDiT), an image generative model that exhibits linear scaling with pixel count, supporting training at high-resolution (e.g. $1024 \times 1024$) directly in pixel-space. Building on the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Katherine Crowson , Stefan Andreas Baumann , Alex Birch , Tanishq Mathew Abraham , Daniel Z. Kaplan , Enrico Shippole

Diffusion Transformers (DiTs) have recently gained substantial attention in both industrial and academic fields for their superior visual generation capabilities, outperforming traditional diffusion models that use U-Net. However,the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenxuan Liu , Sai Qian Zhang

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

Image-to-image translation has been revolutionized with GAN-based methods. However, existing methods lack the ability to preserve the identity of the source domain. As a result, synthesized images can often over-adapt to the reference…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Mu Cai , Hong Zhang , Huijuan Huang , Qichuan Geng , Yixuan Li , Gao Huang

Personalized image generation aims to produce images of user-specified concepts while enabling flexible editing. Recent training-free approaches, while exhibit higher computational efficiency than training-based methods, struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Haoran Feng , Zehuan Huang , Lin Li , Hairong Lv , Lu Sheng