English
Related papers

Related papers: EDT: An Efficient Diffusion Transformer Framework …

200 papers

Implicit policies parameterized by generative models, such as Diffusion Policy, have become the standard for policy learning and Vision-Language-Action (VLA) models in robotics. However, these approaches often suffer from high computational…

Robotics · Computer Science 2025-11-03 Travis Davies , Yiqi Huang , Alexi Gladstone , Yunxin Liu , Xiang Chen , Heng Ji , Huxian Liu , Luhui Hu

Diffusion models demonstrate outstanding performance in image generation, but their multi-step inference mechanism requires immense computational cost. Previous works accelerate inference by leveraging layer or token cache techniques to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haowei Zhu , Ji Liu , Ziqiong Liu , Dong Li , Junhai Yong , Bin Wang , Emad Barsoum

Diffusion Transformers (DiT) are renowned for their impressive generative performance; however, they are significantly constrained by considerable computational costs due to the quadratic complexity in self-attention and the extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Shuning Chang , Pichao Wang , Jiasheng Tang , Fan Wang , Yi Yang

Training frontier-scale diffusion models often requires substantial computational resources concentrated in tightly coupled clusters, limiting participation to well-resourced institutions. While Decentralized Diffusion Models (DDM) enable…

Machine Learning · Computer Science 2026-03-10 Zhiying Jiang , Raihan Seraj , Marcos Villagra , Bidhan Roy

Transfer learning paradigm has driven substantial advancements in various vision tasks. However, as state-of-the-art models continue to grow, classical full fine-tuning often becomes computationally impractical, particularly in multi-task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Seungmin Baek , Soyul Lee , Hayeon Jo , Hyesong Choi , Dongbo Min

Offline reinforcement learning (RL) aims to learn optimal policies from offline datasets, where the parameterization of policies is crucial but often overlooked. Recently, Diffsuion-QL significantly boosts the performance of offline RL by…

Machine Learning · Computer Science 2023-10-27 Bingyi Kang , Xiao Ma , Chao Du , Tianyu Pang , Shuicheng Yan

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

Diffusion and flow-based models have become the de facto approaches for generating continuous data, e.g., in domains such as images and videos. Their success has attracted growing interest in applying them to language modeling. Unlike their…

Computation and Language · Computer Science 2026-05-12 Keya Hu , Linlu Qiu , Yiyang Lu , Hanhong Zhao , Tianhong Li , Yoon Kim , Jacob Andreas , Kaiming He

Event cameras are novel sensors that perceive the per-pixel intensity changes and output asynchronous event streams with high dynamic range and less motion blur. It has been shown that events alone can be used for end-task learning, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Lin Wang , Yujeong Chae , Kuk-Jin Yoon

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

Machine Learning · Computer Science 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

The growing relevance of multi-agent systems has drawn increasing focus on communication-efficient filters for collaborative perception to alleviate the system's communication burden. While the event-triggered (ET) mechanism can improve…

Multiagent Systems · Computer Science 2026-05-05 Jirong Zha , Chenyu Zhao , Nan Zhou , Zhenyu Liu , Tao Sun , Bin Zhang , Xiaochun Zhang , Xinlei Chen

Continuous Conditional Diffusion Model (CCDM) is a diffusion-based framework designed to generate high-quality images conditioned on continuous regression labels. Although CCDM has demonstrated clear advantages over prior approaches across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Ding , Yun Chen , Sen Zhang , Kao Zhang , Nenglun Chen , Peibei Cao , Yongwei Wang , Fei Wu

The increased demand for data privacy and security in machine learning (ML) applications has put impetus on effective edge training on Internet-of-Things (IoT) nodes. Edge training aims to leverage speed, energy efficiency and adaptability…

Hardware Architecture · Computer Science 2025-04-29 Gang Mao , Tousif Rahman , Sidharth Maheshwari , Bob Pattison , Zhuang Shao , Rishad Shafik , Alex Yakovlev

Diffusion-based methods have been acknowledged as a powerful paradigm for end-to-end visuomotor control in robotics. Most existing approaches adopt a Diffusion Policy in U-Net architecture (DP-U), which, while effective, suffers from…

Robotics · Computer Science 2025-09-30 Linzhi Wu , Aoran Mei , Xiyue Wang , Guo-Niu Zhu , Zhongxue Gan

Computed tomography (CT) serves as an effective tool for lung cancer screening, diagnosis, treatment, and prognosis, providing a rich source of features to quantify temporal and spatial tumor changes. Nonetheless, the diversity of CT…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Md Selim , Jie Zhang , Faraneh Fathi , Michael A. Brooks , Ge Wang , Guoqiang Yu , Jin Chen

Transformer architectures, particularly Diffusion Transformers (DiTs), have become widely used in diffusion and flow-matching models due to their strong performance compared to convolutional UNets. However, the isotropic design of DiTs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quan Dao , Dimitris Metaxas

Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu

Although the diffusion model has achieved remarkable performance in the field of image generation, its high inference delay hinders its wide application in edge devices with scarce computing resources. Therefore, many training-free sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Weilun Feng , Chuanguang Yang , Zhulin An , Libo Huang , Boyu Diao , Fei Wang , Yongjun Xu

Diffusion models have achieved remarkable success in the domain of text-guided image generation and, more recently, in text-guided image editing. A commonly adopted strategy for editing real images involves inverting the diffusion process…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Wonjun Kang , Kevin Galim , Hyung Il Koo

Speculative decoding accelerates LLM inference but suffers from performance degradation when target models are fine-tuned for specific domains. A naive solution is to retrain draft models for every target model, which is costly and…

Machine Learning · Computer Science 2026-03-11 Luxi Lin , Zhihang Lin , Zhanpeng Zeng , Yuhao Chen , Qingyu Zhang , Jixiang Luo , Xuelong Li , Rongrong Ji