English
Related papers

Related papers: CoReDiT: Spatial Coherence-Guided Token Pruning an…

200 papers

Vision Transformers (ViTs) have demonstrated outstanding performance in computer vision tasks, yet their high computational complexity prevents their deployment in computing resource-constrained environments. Various token pruning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Xuwei Xu , Changlin Li , Yudong Chen , Xiaojun Chang , Jiajun Liu , Sen Wang

Diffusion Transformers (DiTs) have proven effective in generating high-quality videos but are hindered by high computational costs. Existing video DiT sampling acceleration methods often rely on costly fine-tuning or exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Wenhao Sun , Rong-Cheng Tu , Jingyi Liao , Zhao Jin , Dacheng Tao

Diffusion Transformer (DiT) has driven significant progress in image generation tasks. However, DiT inferencing is notoriously compute-intensive and incurs long latency even on datacenter-scale GPUs, primarily due to its iterative nature…

Hardware Architecture · Computer Science 2025-04-14 Daeun Kim , Jinwoo Hwang , Changhun Oh , Jongse Park

Recently, Diffusion Transformers (DiTs) have emerged in Real-World Image Super-Resolution (Real-ISR) to generate high-quality textures, yet their heavy inference burden hinders real-world deployment. While Post-Training Quantization (PTQ)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Xun Zhang , Kaicheng Yang , Hongliang Lu , Haotong Qin , Yong Guo , Yulun Zhang

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Diffusion Transformers (DiTs) have demonstrated remarkable generative capabilities, particularly benefiting from Transformer architectures that enhance visual and artistic fidelity. However, their inherently sequential denoising process…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Hanqi Chen , Xu Zhang , Xiaoliu Guan , Lielin Jiang , Guanzhong Wang , Zeyu Chen , Yi Liu

Diffusion models have shown strong capabilities in generating high-quality images from text prompts. However, these models often require large-scale training data and significant computational resources to train, or suffer from heavy…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Tong Shen , Jingai Yu , Dong Zhou , Dong Li , Emad Barsoum

Diffusion Transformers (DiTs) achieve state-of-the-art results in text-to-image, text-to-video generation, and editing. However, their large model size and the quadratic cost of spatial-temporal attention over multiple denoising steps make…

Machine Learning · Computer Science 2025-09-24 Muhammad Adnan , Nithesh Kurella , Akhil Arunkumar , Prashant J. Nair

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

Diffusion transformers (DiTs) combine transformer architectures with diffusion models. However, their computational complexity imposes significant limitations on real-time applications and sustainability of AI systems. In this study, we aim…

Machine Learning · Computer Science 2025-02-07 Younghye Hwang , Hyojin Lee , Joonhyuk Kang

Recent advancements in diffusion models, particularly the architectural transformation from UNet-based models to Diffusion Transformers (DiTs), significantly improve the quality and scalability of image and video generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Lei Chen , Yuan Meng , Chen Tang , Xinzhu Ma , Jingyan Jiang , Xin Wang , Zhi Wang , Wenwu Zhu

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in generative modeling, yet their high computational cost hinders real-time deployment. While feature caching offers a promising training-free acceleration solution by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Fanpu Cao , Yaofo Chen , Zeng You , Wei Luo

Video diffusion models have recently enabled high-quality video generation with ViT-based architectures, but remain computationally intensive because generation requires attention computation over long spatiotemporal sequences. Token…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Sheng Li , Yang Sui , Junhao Ran , Bo Yuan , Yue Dai , Xulong Tang

This paper explores image modeling from the frequency space and introduces DCTdiff, an end-to-end diffusion generative paradigm that efficiently models images in the discrete cosine transform (DCT) space. We investigate the design space of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Mang Ning , Mingxiao Li , Jianlin Su , Haozhe Jia , Lanmiao Liu , Martin Beneš , Wenshuo Chen , Albert Ali Salah , Itir Onal Ertugrul

Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising structure. While prior methods accelerate sampling by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Dong Liu , Yanxuan Yu , Ben Lengerich , Ying Nian Wu

Recent breakthroughs in Diffusion Transformers (DiTs) have revolutionized the field of visual synthesis due to their superior scalability. To facilitate DiTs' capability of capturing meaningful internal representations, recent works such as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Mengping Yang , Zhiyu Tan , Binglei Li , Xiaomeng Yang , Hesen Chen , Hao Li

Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion transformer models (DiTs). Among diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xudong Lu , Aojun Zhou , Ziyi Lin , Qi Liu , Yuhui Xu , Renrui Zhang , Xue Yang , Junchi Yan , Peng Gao , Hongsheng Li

The Text-to-Video (T2V) model aims to generate dynamic and expressive videos from textual prompts. The generation pipeline typically involves multiple modules, such as language encoder, Diffusion Transformer (DiT), and Variational…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-17 Heyang Huang , Cunchen Hu , Jiaqi Zhu , Ziyuan Gao , Liangliang Xu , Yizhou Shan , Yungang Bao , Sun Ninghui , Tianwei Zhang , Sa Wang

Vision Transformers (ViTs) deliver state-of-the-art accuracy but their quadratic attention cost and redundant computations severely hinder deployment on latency and resource-constrained platforms. Existing pruning approaches treat either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Mohammad Helal Uddin , Liam Seymour , Sabur Baidya

Low-dose computed tomography (LDCT) reduces radiation exposure but suffers from image artifacts and loss of detail due to quantum and electronic noise, potentially impacting diagnostic accuracy. Transformer combined with diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Qiqing Liu , Guoquan Wei , Zekun Zhou , Yiyang Wen , Liu Shi , Qiegen Liu