English
Related papers

Related papers: Layer- and Timestep-Adaptive Differentiable Token …

200 papers

Recent advancements in video diffusion models based on Diffusion Transformers (DiTs) have achieved remarkable success in generating temporally coherent videos. Yet, a fundamental question persists: how do these models internally establish…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jisu Nam , Soowon Son , Dahyun Chung , Jiyoung Kim , Siyoon Jin , Junhwa Hur , Seungryong Kim

Diffusion models have significantly reshaped the field of generative artificial intelligence and are now increasingly explored for their capacity in discriminative representation learning. Diffusion Transformer (DiT) has recently gained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Changyu Liu , James Chenhao Liang , Wenhao Yang , Yiming Cui , Jinghao Yang , Tianyang Wang , Qifan Wang , Dongfang Liu , Cheng Han

The Diffusion Transformer (DiT) architecture is the state-of-the-art paradigm for high-fidelity image generation, underpinning models like Stable Diffusion-3 and FLUX.1. However, deploying these models on resource-constrained mobile devices…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Kunpeng Du , Haizhen Xie , Sen Lu , Lei Yu , Binglei Bao , Huaao Tang , Chuntao Liu , Hao Wu , Yang Zhao , Zhicai Huang , Heyuan Gao , Zhijun Tu , Jie Hu , Xinghao Chen

Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ce Wang , Zhenyu Hu , Wanjie Sun

Recent advances in one-step text-to-image generation have enabled real-time synthesis with remarkable efficiency and quality. Previous reinforcement learning methods for one-step generators combine image-space reward optimization with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Junyi Wu , Weijian Luo , Haoyang Zheng , Ruizhe Zhang , Guang Lin

Diffusion Transformers (DiTs) have proven effective in generating high-quality videos but are hindered by high computational costs. Existing video DiT sampling acceleration methods often rely on costly fine-tuning or exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Wenhao Sun , Rong-Cheng Tu , Jingyi Liao , Zhao Jin , Dacheng Tao

In this paper, we propose a novel diffusion-decision transformer (D2T) architecture to optimize the beamforming strategies for intelligent reflecting surface (IRS)-assisted multiple-input single-output (MISO) communication systems. The…

Signal Processing · Electrical Eng. & Systems 2024-07-01 Jie Zhang , Jun Li , Zhe Wang , Yu Han , Long Shi , Bin Cao

Diffusion Transformers (DiTs) have significantly enhanced text-to-image (T2I) generation quality, enabling high-quality personalized content creation. However, fine-tuning these models requires substantial computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sunghyun Park , Jeongho Kim , Hyoungwoo Park , Debasmit Das , Sungrack Yun , Munawar Hayat , Jaegul Choo , Fatih Porikli , Seokeon Choi

Recent advances in powerful pre-trained diffusion models encourage the development of methods to improve the sampling performance under well-trained diffusion models. This paper introduces Diffusion Rejection Sampling (DiffRS), which uses a…

Machine Learning · Computer Science 2024-05-29 Byeonghu Na , Yeongmin Kim , Minsang Park , Donghyeok Shin , Wanmo Kang , Il-Chul Moon

Diffusion transformer (DiT) models have achieved remarkable success in image generation, thanks for their exceptional generative capabilities and scalability. Nonetheless, the iterative nature of diffusion models (DMs) results in high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Zhiyuan Chen , Keyi Li , Yifan Jia , Le Ye , Yufei Ma

Diffusion models (DMs) have become the leading choice for generative tasks across diverse domains. However, their reliance on multiple sequential forward passes significantly limits real-time performance. Previous acceleration methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Ziming Liu , Yifan Yang , Chengruidong Zhang , Yiqi Zhang , Lili Qiu , Yang You , Yuqing Yang

Diffusion transformer (DiT) achieves remarkable performance in visual generation, but its iterative denoising process combined with larger capacity leads to a high inference cost. Recent works have demonstrated that the iterative denoising…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yonglak Son , Suhyeok Kim , Seungryong Kim , Young Geun Kim

The increased model capacity of Diffusion Transformers (DiTs) and the demand for generating higher resolutions of images and videos have led to a significant rise in inference latency, impacting real-time performance adversely. While prior…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Xibo Sun , Jiarui Fang , Aoyu Li , Jinzhe Pan

Diffusion Transformers (DiTs) achieve state-of-the-art image generation quality but incur substantial memory and computational costs at inference. While aggressive Post-Training Quantization (PTQ) to 4-bit precision offers significant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Sayeh Sharify , Mahsa Salmani , Hesham Mostafa

Diffusion Transformers (DiT) have revolutionized high-fidelity image and video synthesis, yet their computational demands remain prohibitive for real-time applications. To solve this problem, feature caching has been proposed to accelerate…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jiacheng Liu , Chang Zou , Yuanhuiyi Lyu , Junjie Chen , Linfeng Zhang

In the realm of high-resolution (HR), fine-grained image segmentation, the primary challenge is balancing broad contextual awareness with the precision required for detailed object delineation, capturing intricate details and the finest…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Qian Yu , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Bo Li , Lihe Zhang , Huchuan Lu

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

Diffusion transformers have gained significant attention in recent years for their ability to generate high-quality images and videos, yet still suffer from a huge computational cost due to their iterative denoising process. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Zhixin Zheng , Xinyu Wang , Chang Zou , Shaobo Wang , Linfeng Zhang

Diffusion models with their powerful expressivity and high sample quality have achieved State-Of-The-Art (SOTA) performance in the generative domain. The pioneering Vision Transformer (ViT) has also demonstrated strong modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ali Hatamizadeh , Jiaming Song , Guilin Liu , Jan Kautz , Arash Vahdat

Diffusion models have achieved remarkable success in the image and video generation tasks. Nevertheless, they often require a large amount of memory and time overhead during inference, due to the complex network architecture and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Haocheng Huang , Jiaxin Chen , Jinyang Guo , Ruiyi Zhan , Yunhong Wang