English
Related papers

Related papers: DDiT: Dynamic Resource Allocation for Diffusion Tr…

200 papers

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

Fine-grained and efficient controllability on video diffusion transformers has raised increasing desires for the applicability. Recently, In-context Conditioning emerged as a powerful paradigm for unified conditional video generation, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xuanhua He , Quande Liu , Zixuan Ye , Weicai Ye , Qiulin Wang , Xintao Wang , Qifeng Chen , Pengfei Wan , Di Zhang , Kun Gai

Diffusion Transformers (DiTs) achieve superior image generation quality but suffer from quadratic computational complexity relative to token count. While various token reduction (TR) methods have been proposed to mitigate this cost, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Hangyeol Lee , Hyojeong Lee , Joo-Young Kim

Recent Diffusion Transformers (DiTs) have shown impressive capabilities in generating high-quality single-modality content, including images, videos, and audio. However, it is still under-explored whether the transformer-based diffuser can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Kai Wang , Shijian Deng , Jing Shi , Dimitrios Hatzinakos , Yapeng Tian

Diffusion transformers (DiTs) achieve high generative quality but lock FLOPs to image resolution, limiting principled latency-quality trade-offs, and allocate computation uniformly across input spatial tokens, wasting resource allocation to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Dogyun Park , Anil Kag , Michael Vasilkovsky , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

Diffusion Transformers (DiTs) have recently improved video generation quality. However, their heavy computational cost makes real-time or on-device generation infeasible. In this work, we introduce S2DiT, a Streaming Sandwich Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Lin Zhao , Yushu Wu , Aleksei Lebedev , Dishani Lahiri , Meng Dong , Arpit Sahni , Michael Vasilkovsky , Hao Chen , Ju Hu , Aliaksandr Siarohin , Sergey Tulyakov , Yanzhi Wang , Anil Kag , Yanyu Li

Recent advances in video generation models has significantly accelerated video generation and related downstream tasks. Among these, video stylization holds important research value in areas such as immersive applications and artistic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Hengye Lyu , Zisu Li , Yue Hong , Yueting Weng , Jiaxin Shi , Hanwang Zhang , Chen Liang

Sora has unveiled the immense potential of the Diffusion Transformer (DiT) architecture in single-scene video generation. However, the more challenging task of multi-scene video generation, which offers broader applications, remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Tianhao Qi , Jianlong Yuan , Wanquan Feng , Shancheng Fang , Jiawei Liu , SiYu Zhou , Qian He , Hongtao Xie , Yongdong Zhang

Diffusion Transformers rely on static patchify tokenization, assigning the same token budget to smooth backgrounds, detailed object regions, noisy early timesteps, and late-stage refinements. We introduce the Dynamic Chunking Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Akash Haridas , Utkarsh Saxena , Parsa Ashrafi Fashi , Mehdi Rezagholizadeh , Vikram Appia , Emad Barsoum

Diffusion models with their powerful expressivity and high sample quality have achieved State-Of-The-Art (SOTA) performance in the generative domain. The pioneering Vision Transformer (ViT) has also demonstrated strong modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ali Hatamizadeh , Jiaming Song , Guilin Liu , Jan Kautz , Arash Vahdat

Diffusion Transformer(DiT)-based generation models have achieved remarkable success in video generation. However, their inherent computational demands pose significant efficiency challenges. In this paper, we exploit the inherent temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Zhihang Yuan , Rui Xie , Yuzhang Shang , Hanling Zhang , Siyuan Wang , Shengen Yan , Guohao Dai , Yu Wang

Diffusion Transformer (DiT) has emerged as the new trend of generative diffusion models on image generation. In view of extremely slow convergence in typical DiT, recent breakthroughs have been driven by mask strategy that significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Rui Zhu , Yingwei Pan , Yehao Li , Ting Yao , Zhenglong Sun , Tao Mei , Chang Wen Chen

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Diffusion models have revolutionized video generation, becoming essential tools in creative content generation and physical simulation. Transformer-based architectures (DiTs) and classifier-free guidance (CFG) are two cornerstones of this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhiye Song , Steve Dai , Ben Keller , Brucek Khailany

Diffusion Transformers (DiT) have achieved milestones in synthesizing financial time-series data, such as stock prices and order flows. However, their performance in synthesizing treasury futures data is still underexplored. This work…

Machine Learning · Computer Science 2026-01-21 Yingxiao Zhang , Jiaxin Duan , Junfu Zhang , Ke Feng

Sounding Video Generation (SVG) remains a challenging task due to the inherent structural misalignment between audio and video, as well as the high computational cost of multimodal data processing. In this paper, we introduce ProAV-DiT, a…

Multimedia · Computer Science 2025-11-18 Jiahui Sun , Weining Wang , Mingzhen Sun , Yirong Yang , Xinxin Zhu , Jing Liu

Diffusion Transformers (DiTs) can generate short photorealistic videos, yet directly training and sampling longer videos with full attention across the video remains computationally challenging. Alternative methods break long videos down…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Bhishma Dedhia , David Bourgin , Krishna Kumar Singh , Yuheng Li , Yan Kang , Zhan Xu , Niraj K. Jha , Yuchen Liu

Collecting multi-view driving scenario videos to enhance the performance of 3D visual perception tasks presents significant challenges and incurs substantial costs, making generative models for realistic data an appealing alternative. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Junpeng Jiang , Gangyi Hong , Miao Zhang , Hengtong Hu , Kun Zhan , Rui Shao , Liqiang Nie

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in image and video generation, but their success comes at the cost of heavy computation. This inefficiency is largely due to the fixed tokenization process, which uses…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Dahye Kim , Deepti Ghadiyaram , Raghudeep Gadde

Layout generation is a foundation task of graphic design, which requires the integration of visual aesthetics and harmonious expression of content delivery. However, existing methods still face challenges in generating precise and visually…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yu Li , Yifan Chen , Gongye Liu , Fei Yin , Qingyan Bai , Jie Wu , Hongfa Wang , Ruihang Chu , Yujiu Yang