English
Related papers

Related papers: Grouping First, Attending Smartly: Training-Free A…

200 papers

Diffusion models have recently achieved remarkable results for video generation. Despite the encouraging performances, the generated videos are typically constrained to a small number of frames, resulting in clips lasting merely a few…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhenxiong Tan , Xingyi Yang , Songhua Liu , Xinchao Wang

The most advanced text-to-image (T2I) models require significant training costs (e.g., millions of GPU hours), seriously hindering the fundamental innovation for the AIGC community while increasing CO2 emissions. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junsong Chen , Jincheng Yu , Chongjian Ge , Lewei Yao , Enze Xie , Yue Wu , Zhongdao Wang , James Kwok , Ping Luo , Huchuan Lu , Zhenguo Li

This paper introduces EasyAnimate, an efficient and high quality video generation framework that leverages diffusion transformers to achieve high-quality video production, encompassing data processing, model training, and end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Jiaqi Xu , Kunzhe Huang , Xinyi Zou , Yunkuo Chen , Bo Liu , MengLi Cheng , Jun Huang , Xing Shi

Nature is infinitely resolution-free. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zeyu Lu , Zidong Wang , Di Huang , Chengyue Wu , Xihui Liu , Wanli Ouyang , Lei Bai

The point cloud learning community witnesses a modeling shift from CNNs to Transformers, where pure Transformer architectures have achieved top accuracy on the major learning benchmarks. However, existing point Transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zhang Cheng , Haocheng Wan , Xinyi Shen , Zizhao Wu

This paper presents a novel approach to address the challenges of understanding the prediction process and debugging prediction errors in Vision Transformers (ViT), which have demonstrated superior performance in various computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Seok-Yong Byun , Wonju Lee

Diffusion Transformers have established a new state-of-the-art in image synthesis, but the high computational cost of iterative sampling severely hampers their practical deployment. While existing acceleration methods often focus on the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Wenhao Sun , Ji Li , Zhaoqiang Liu

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

Video diffusion Transformer (DiT) models excel in generative quality but hit major computational bottlenecks when producing high-resolution, long-duration videos. The quadratic complexity of full attention leads to prohibitively high…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Chenlu Zhan , Wen Li , Chuyu Shen , Jun Zhang , Suhui Wu , Hao Zhang

Recent advancements in diffusion-based generative priors have enabled visually plausible image compression at extremely low bit rates. However, existing approaches suffer from slow sampling processes and suboptimal bit allocation due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yichong Xia , Yimin Zhou , Jinpeng Wang , Bin Chen

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Predicting the effect of amino acid mutations on enzyme thermodynamic stability (DDG) is fundamental to protein engineering and drug design. While recent deep learning approaches have shown promise, they often process sequence and structure…

Machine Learning · Computer Science 2025-11-10 Abigail Lin

Diffusion models have demonstrated remarkable performance in image generation, particularly within the domain of style transfer. Prevailing style transfer approaches typically leverage pre-trained diffusion models' robust feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yeqi He , Liang Li , Zhiwen Yang , Xichun Sheng , Zhidong Zhao , Chenggang Yan

Recent work has shown that inference-time reasoning and reflection can improve text-to-image generation without retraining. However, existing approaches often rely on implicit, holistic critiques or unconstrained prompt rewrites, making…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 V. Kovalev , A. Kuvshinov , A. Buzovkin , D. Pokidov , D. Timonin

Video generation has been advancing rapidly, and diffusion transformer (DiT) based models have demonstrated remark- able capabilities. However, their practical deployment is of- ten hindered by slow inference speeds and high memory con-…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Sijie Wang , Qiang Wang , Shaohuai Shi

Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition training limit its use in few-step regimes. Attention-space guidance has emerged as a complementary…

Machine Learning · Computer Science 2026-05-19 Kwanyoung Kim

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Diffusion transformers (DiTs) achieve high generative quality but lock FLOPs to image resolution, limiting principled latency-quality trade-offs, and allocate computation uniformly across input spatial tokens, wasting resource allocation to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Dogyun Park , Anil Kag , Michael Vasilkovsky , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

Transformers are slow and memory-hungry on long sequences, since the time and memory complexity of self-attention are quadratic in sequence length. Approximate attention methods have attempted to address this problem by trading off model…

Machine Learning · Computer Science 2022-06-24 Tri Dao , Daniel Y. Fu , Stefano Ermon , Atri Rudra , Christopher Ré

Pre-trained diffusion models excel at generating high-quality images but remain inherently limited by their native training resolution. Recent training-free approaches have attempted to overcome this constraint by introducing interventions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hong-Phuc Lai , Phong Nguyen , Anh Tran