English
Related papers

Related papers: AsymRnR: Video Diffusion Transformers Acceleration…

200 papers

Diffusion Transformers (DiTs) have demonstrated remarkable generative capabilities, particularly benefiting from Transformer architectures that enhance visual and artistic fidelity. However, their inherently sequential denoising process…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Hanqi Chen , Xu Zhang , Xiaoliu Guan , Lielin Jiang , Guanzhong Wang , Zeyu Chen , Yi Liu

Diffusion Transformers (DiT)-based video generation models with 3D full attention exhibit strong generative capabilities. Trajectory control represents a user-friendly task in the field of controllable video generation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Cheng Lei , Jiayu Zhang , Yue Ma , Xinyu Wang , Long Chen , Liang Tang , Yiqiang Yan , Fei Su , Zhicheng Zhao

Diffusion Transformers (DiT) have revolutionized high-fidelity image and video synthesis, yet their computational demands remain prohibitive for real-time applications. To solve this problem, feature caching has been proposed to accelerate…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jiacheng Liu , Chang Zou , Yuanhuiyi Lyu , Junjie Chen , Linfeng Zhang

Diffusion models have achieved outstanding image generation by reversing a forward noising process to approximate true data distributions. During training, these models predict diffusion scores from noised versions of true samples in a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Dazhong Shen , Guanglu Song , Yi Zhang , Bingqi Ma , Lujundong Li , Dongzhi Jiang , Zhuofan Zong , Yu Liu

Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion transformer models (DiTs). Among diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xudong Lu , Aojun Zhou , Ziyi Lin , Qi Liu , Yuhui Xu , Renrui Zhang , Xue Yang , Junchi Yan , Peng Gao , Hongsheng Li

Many existing video inpainting algorithms utilize optical flows to construct the corresponding maps and then propagate pixels from adjacent frames to missing areas by mapping. Despite the effectiveness of the propagation mechanism, they…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xian Wu , Chang Liu

Diffusion Transformers (DiTs) excel at generation, but their global self-attention makes controllable, reference-image-based editing a distinct challenge. Unlike U-Nets, naively injecting local appearance into a DiT can disrupt its holistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shengrong Gu , Ye Wang , Song Wu , Rui Ma , Qian Wang , Lanjun Wang , Zili Yi

Images captured in challenging environments often experience various forms of degradation, including noise, color cast, blur, and light scattering. These effects significantly reduce image quality, hindering their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Abbas Anwar , Mohammad Shullar , Ali Arshad Nasir , Mudassir Masood , Saeed Anwar

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

Diffusion Transformer (DiT) has driven significant progress in image generation tasks. However, DiT inferencing is notoriously compute-intensive and incurs long latency even on datacenter-scale GPUs, primarily due to its iterative nature…

Hardware Architecture · Computer Science 2025-04-14 Daeun Kim , Jinwoo Hwang , Changhun Oh , Jongse Park

Diffusion Transformers (DiTs) with billions of model parameters form the backbone of popular image and video generation models like DALL.E, Stable-Diffusion and SORA. Though these models are necessary in many low-latency applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Vignesh Sundaresha

Recent state-of-the-art image restoration methods mostly adopt latent diffusion models with U-Net backbones, yet still facing challenges in achieving high-quality restoration due to their limited capabilities. Diffusion transformers (DiTs),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Dehong Kong , Fan Li , Zhixin Wang , Jiaqi Xu , Renjing Pei , Wenbo Li , WenQi Ren

Diffusion transformers (DiTs) offer excellent scalability for high-fidelity generation, but their computational overhead poses a great challenge for practical deployment. Existing acceleration methods primarily exploit the temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Wongi Jeong , Kyungryeol Lee , Hoigi Seo , Se Young Chun

Diffusion Transformers (DiTs) can generate short photorealistic videos, yet directly training and sampling longer videos with full attention across the video remains computationally challenging. Alternative methods break long videos down…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Bhishma Dedhia , David Bourgin , Krishna Kumar Singh , Yuheng Li , Yan Kang , Zhan Xu , Niraj K. Jha , Yuchen Liu

Diffusion models (DMs) have shown promising results on single-image super-resolution and other image-to-image translation tasks. Benefiting from more computational resources and longer inference times, they are able to yield more realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yuanting Fan , Chengxu Liu , Nengzhong Yin , Changlong Gao , Xueming Qian

Diffusion models have revolutionized video generation, becoming essential tools in creative content generation and physical simulation. Transformer-based architectures (DiTs) and classifier-free guidance (CFG) are two cornerstones of this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhiye Song , Steve Dai , Ben Keller , Brucek Khailany

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

Image restoration faces challenges including ineffective feature fusion, computational bottlenecks and inefficient diffusion processes. To address these, we propose DiffRWKVIR, a novel framework unifying Test-Time Training (TTT) with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Rongchang Lu , Tianduo Luo , Yunzhi Jiang , Conghan Yue , Pei Yang , Guibao Liu , Changyang Gu

Diffusion Transformers (DiT) have emerged as a powerful architecture for image and video generation, offering superior quality and scalability. However, their practical application suffers from inherent dynamic feature instability, leading…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guanjie Chen , Xinyu Zhao , Yucheng Zhou , Xiaoye Qu , Tianlong Chen , Yu Cheng

Leveraging the diffusion transformer (DiT) architecture, models like Sora, CogVideoX and Wan have achieved remarkable progress in text-to-video, image-to-video, and video editing tasks. Despite these advances, diffusion-based video…