English
Related papers

Related papers: Rethinking Cross-Layer Information Routing in Diff…

200 papers

Recent works such as REPA have shown that guiding diffusion models with external semantic features (e.g., DINO) can significantly accelerate the training of diffusion transformers (DiTs). However, the use of pretrained external features as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lingchen Sun , Rongyuan Wu , Zhengqiang Zhang , Ruibin Li , Yujing Sun , Shuaizheng Liu , Lei Zhang

Diffusion Transformers (DiT) have attracted significant attention in research. However, they suffer from a slow convergence rate. In this paper, we aim to accelerate DiT training without any architectural modification. We identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jingfeng Yao , Wang Cheng , Wenyu Liu , Xinggang Wang

Text-to-image (T2I) diffusion models lack an efficient mechanism for early quality assessment, leading to costly trial-and-error in multi-generation scenarios such as prompt iteration, agent-based generation, and flow-grpo. We reveal a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Benlei Cui , Bukun Huang , Zhizeng Ye , Xuemei Dong , Tuo Chen , Hui Xue , Dingkang Yang , Longtao Huang , Jingqun Tang , Haiwen Hong

Cross-Domain Recommendation (CDR) have received widespread attention due to their ability to utilize rich information across domains. However, most existing CDR methods assume an ideal static condition that is not practical in industrial…

Information Retrieval · Computer Science 2024-10-16 Heyuan Huang , Xingyu Lou , Chaochao Chen , Pengxiang Cheng , Yue Xin , Chengwei He , Xiang Liu , Jun Wang

We present DARTS, a transformer model for reference-based image super-resolution. DARTS learns joint representations of two image distributions to enhance the content of low-resolution input images through matching correspondences learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Masoomeh Aslahishahri , Jordan Ubbens , Ian Stavness

The computational burden of the iterative sampling process remains a major challenge in diffusion-based Low-Light Image Enhancement (LLIE). Current acceleration methods, whether training-based or training-free, often lead to significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Guanzhou Lan , Qianli Ma , Yuqi Yang , Zhigang Wang , Dong Wang , Xuelong Li , Bin Zhao

Diffusion Transformers (DiTs) have demonstrated exceptional capabilities in text-to-image synthesis. However, in the domain of controllable text-to-image generation using DiTs, most existing methods still rely on the ControlNet paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Shanyuan Liu , Jian Zhu , Junda Lu , Yue Gong , Liuzhuozheng Li , Bo Cheng , Yuhang Ma , Liebucha Wu , Xiaoyu Wu , Dawei Leng , Yuhui Yin

While Diffusion Transformers (DiTs) have achieved breakthroughs in video generation, this long sequence generation task remains constrained by the quadratic complexity of attention mechanisms, resulting in significant inference latency.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Pengtao Chen , Xianfang Zeng , Maosen Zhao , Peng Ye , Mingzhu Shen , Wei Cheng , Gang Yu , Tao Chen

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Recent advancements in video diffusion models based on Diffusion Transformers (DiTs) have achieved remarkable success in generating temporally coherent videos. Yet, a fundamental question persists: how do these models internally establish…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jisu Nam , Soowon Son , Dahyun Chung , Jiyoung Kim , Siyoon Jin , Junhwa Hur , Seungryong Kim

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

A novel reconfigurable intelligent surface (RIS)-aided hybrid reflection/transmitter design is proposed for achieving information exchange in cross-media communications. In pursuit of the balance between energy efficiency and low-cost…

Signal Processing · Electrical Eng. & Systems 2022-11-08 Mingming Wu , Yue Xiao , Yulan Gao , Ming Xiao

The Text-to-Video (T2V) model aims to generate dynamic and expressive videos from textual prompts. The generation pipeline typically involves multiple modules, such as language encoder, Diffusion Transformer (DiT), and Variational…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-17 Heyang Huang , Cunchen Hu , Jiaqi Zhu , Ziyuan Gao , Liangliang Xu , Yizhou Shan , Yungang Bao , Sun Ninghui , Tianwei Zhang , Sa Wang

Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Existing methods update the source model by (re-)training on each target domain. While effective,…

Machine Learning · Computer Science 2023-06-22 Jin Gao , Jialing Zhang , Xihui Liu , Trevor Darrell , Evan Shelhamer , Dequan Wang

Diffusion models (DMs) have significantly advanced the development of real-world image super-resolution (Real-ISR), but the computational cost of multi-step diffusion models limits their application. One-step diffusion models generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Jianze Li , Jiezhang Cao , Yong Guo , Wenbo Li , Yulun Zhang

Deep Text-to-Image Synthesis (TIS) models such as Stable Diffusion have recently gained significant popularity for creative Text-to-image generation. Yet, for domain-specific scenarios, tuning-free Text-guided Image Editing (TIE) is of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Bingyan Liu , Chengyu Wang , Tingfeng Cao , Kui Jia , Jun Huang

Removing degradation from document images not only improves their visual quality and readability, but also enhances the performance of numerous automated document analysis and recognition tasks. However, existing regression-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Zongyuan Yang , Baolin Liu , Yongping Xiong , Lan Yi , Guibin Wu , Xiaojun Tang , Ziqi Liu , Junjie Zhou , Xing Zhang

Diffusion Transformers (DiT)-based video generation models with 3D full attention exhibit strong generative capabilities. Trajectory control represents a user-friendly task in the field of controllable video generation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Cheng Lei , Jiayu Zhang , Yue Ma , Xinyu Wang , Long Chen , Liang Tang , Yiqiang Yan , Fei Su , Zhicheng Zhao

Layerwise offloading reduces the GPU memory footprint of large diffusion transformer (DiT) inference by prefetching upcoming layers from host memory, but its effectiveness hinges on hiding prefetch latency behind per-layer computation. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Han Meng , Danny Willow Liu , Dong Li

Diffusion models have emerged as powerful generative tools, rivaling GANs in sample quality and mirroring the likelihood scores of autoregressive models. A subset of these models, exemplified by DDIMs, exhibit an inherent asymmetry: they…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yixuan Wang , Shuangyin Li