English
Related papers

Related papers: EDT: An Efficient Diffusion Transformer Framework …

200 papers

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

Machine Learning · Computer Science 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Diffusion Transformers (DiTs) have emerged as the state-of-the-art backbone for high-fidelity image and video generation. However, their massive computational cost and memory footprint hinder deployment on edge devices. While post-training…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Shaoqiu Zhang , Zizhong Ding , Kaicheng Yang , Junyi Wu , Xianglong Yan , Xi Li , Bingnan Duan , Jianping Fang , Yulun Zhang

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

Recent learning-based methods for event-based optical flow estimation utilize cost volumes for pixel matching but suffer from redundant computations and limited scalability to higher resolutions for flow refinement. In this work, we take…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Daikun Liu , Lei Cheng , Teng Wang , changyin Sun

Large-scale vision generative models, including diffusion and flow models, have demonstrated remarkable performance in visual generation tasks. However, transferring these pre-trained models to downstream tasks often results in significant…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Changlin Li , Jiawei Zhang , Zeyi Shi , Zongxin Yang , Zhihui Li , Xiaojun Chang

Decision Transformer (DT) has recently demonstrated strong generalizability in dynamic resource allocation within unmanned aerial vehicle (UAV) networks, compared to conventional deep reinforcement learning (DRL). However, its performance…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Chi Lu , Yiyang Ni , Zhe Wang , Xiaoli Shi , Jun Li , Shi Jin

Recent progress in diffusion models has significantly advanced the field of human image animation. While existing methods can generate temporally consistent results for short or regular motions, significant challenges remain, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Shen Zheng , Jiaran Cai , Yuansheng Guan , Shenneng Huang , Xingpei Ma , Junjie Cao , Hanfeng Zhao , Qiang Zhang , Shunsi Zhang , Xiao-Ping Zhang

It has been recognized that the data generated by the denoising diffusion probabilistic model (DDPM) improves adversarial training. After two years of rapid development in diffusion models, a question naturally arises: can better diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zekai Wang , Tianyu Pang , Chao Du , Min Lin , Weiwei Liu , Shuicheng Yan

Large-scale latent diffusion models (LDMs) excel in content generation across various modalities, but their reliance on phonemes and durations in text-to-speech (TTS) limits scalability and access from other fields. While recent studies…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-18 Keon Lee , Dong Won Kim , Jaehyeon Kim , Seungjun Chung , Jaewoong Cho

While large language models (LLMs) have revolutionized natural language processing with their task-agnostic capabilities, visual generation tasks such as image translation, style transfer, and character customization still rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Lianghua Huang , Wei Wang , Zhi-Fan Wu , Huanzhang Dou , Yupeng Shi , Yutong Feng , Chen Liang , Yu Liu , Jingren Zhou

Diffusion Transformers (DiTs) achieve state-of-the-art performance in text-to-image synthesis but remain computationally expensive due to the iterative nature of denoising and the quadratic cost of global attention. In this work, we observe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Bowen Lin , Fanjiang Ye , Yihua Liu , Zhenghui Guo , Boyuan Zhang , Weijian Zheng , Yufan Xu , Tiancheng Xing , Yuke Wang , Chengming Zhang

Diffusion language models have emerged as a promising approach for text generation. One would naturally expect this method to be an efficient replacement for autoregressive models since multiple tokens can be sampled in parallel during each…

Machine Learning · Computer Science 2025-06-10 Guhao Feng , Yihan Geng , Jian Guan , Wei Wu , Liwei Wang , Di He

Diffusion models have achieved remarkable performance on a wide range of generative tasks, yet training them from scratch is notoriously resource-intensive, typically requiring millions of training images and many GPU days. Motivated by a…

Machine Learning · Computer Science 2026-03-16 Rui Huang , Shitong Shao , Zikai Zhou , Pukun Zhao , Hangyu Guo , Tian Ye , Lichen Bai , Shuo Yang , Zeke Xie

The increased model capacity of Diffusion Transformers (DiTs) and the demand for generating higher resolutions of images and videos have led to a significant rise in inference latency, impacting real-time performance adversely. While prior…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Xibo Sun , Jiarui Fang , Aoyu Li , Jinzhe Pan

Efficient inference is a critical challenge in deep generative modeling, particularly as diffusion models grow in capacity and complexity. While increased complexity often improves accuracy, it raises compute costs, latency, and memory…

Machine Learning · Computer Science 2025-09-24 Siu Hang Ho , Prasad Ganesan , Nguyen Duong , Daniel Schlabig

Molecular understanding is central to advancing areas such as scientific discovery, yet Large Language Models (LLMs) struggle to understand molecular graphs effectively. Existing graph-LLM bridges often adapt the Q-Former-style connector…

Machine Learning · Computer Science 2026-03-03 Zihao Jing , Qiuhao Zeng , Ruiyi Fang , Yan Sun , Boyu Wang , Pingzhao Hu

The ensemble of deep neural networks has been shown, both theoretically and empirically, to improve generalization accuracy on the unseen test set. However, the high training cost hinders its efficiency since we need a sufficient number of…

Machine Learning · Computer Science 2021-12-28 Wentao Zhang , Jiawei Jiang , Yingxia Shao , Bin Cui

Diffusion models have demonstrated strong capabilities in generating high-fidelity 3D human poses, yet their iterative nature and multi-hypothesis requirements incur substantial computational cost. In this paper, we propose an Efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yuquan Bi , Hongsong Wang , Xinli Shi , Zhipeng Gui , Jie Gui , Yuan Yan Tang

Pretrained models have become standard in both vision and language, yet they typically do not provide reliable measures of confidence. Existing uncertainty estimation methods, such as deep ensembles and MC dropout, are often too…

Machine Learning · Computer Science 2026-04-13 Yongchan Chun , Chanhee Park , Jeongho Yoon , Jaehyung Seo , Heuiseok Lim