English
Related papers

Related papers: Effective Diffusion Transformer Architecture for I…

200 papers

Recent Diffusion Transformers (e.g., DiT) have demonstrated their powerful effectiveness in generating high-quality 2D images. However, it is still being determined whether the Transformer architecture performs equally well in 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Shentong Mo , Enze Xie , Ruihang Chu , Lewei Yao , Lanqing Hong , Matthias Nießner , Zhenguo Li

Diffusion Transformer (DiT), an emerging diffusion model for visual generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs primarily stem from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Hao Luo , Yibing Song , Gao Huang , Fan Wang , Yang You

Light field (LF) image super-resolution (SR) is a challenging problem due to its inherent ill-posed nature, where a single low-resolution (LR) input LF image can correspond to multiple potential super-resolved outcomes. Despite this…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Wentao Chao , Fuqing Duan , Xuechun Wang , Yingqian Wang , Guanghui Wang

Diffusion-based image super-resolution (SR) has recently attracted significant attention by leveraging the expressive power of large pre-trained text-to-image diffusion models (DMs). A central practical challenge is resolving the trade-off…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Maxence Noble , Gonzalo Iñaki Quintana , Benjamin Aubin , Clément Chadebec

There is a prevalent opinion that diffusion-based models outperform GAN-based counterparts in the Image Super Resolution (ISR) problem. However, in most studies, diffusion-based ISR models employ larger networks and are trained longer than…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Denis Kuznedelev , Valerii Startsev , Daniil Shlenskii , Sergey Kastryulin

Super-resolution remains a promising technique to enhance the quality of low-resolution images. This study introduces CATformer (Contrastive Adversarial Transformer), a novel neural network integrating diffusion-inspired feature refinement…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qinyi Tian , Spence Cox , Laura E. Dalton

In this work, we empirically study Diffusion Transformers (DiTs) for text-to-image generation, focusing on architectural choices, text-conditioning strategies, and training protocols. We evaluate a range of DiT-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chen Chen , Rui Qian , Wenze Hu , Tsu-Jui Fu , Jialing Tong , Xinze Wang , Lezhi Li , Bowen Zhang , Alex Schwing , Wei Liu , Yinfei Yang

Diffusion models have recently achieved outstanding results in the field of image super-resolution. These methods typically inject low-resolution (LR) images via ControlNet.In this paper, we first explore the temporal dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Qinwei Lin , Xiaopeng Sun , Yu Gao , Yujie Zhong , Dengjie Li , Zheng Zhao , Haoqian Wang

In this study, we explore Transformer-based diffusion models for image and video generation. Despite the dominance of Transformer architectures in various fields due to their flexibility and scalability, the visual generative domain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shoufa Chen , Mengmeng Xu , Jiawei Ren , Yuren Cong , Sen He , Yanping Xie , Animesh Sinha , Ping Luo , Tao Xiang , Juan-Manuel Perez-Rua

\textit{Nature is infinitely resolution-free}. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To address…

Machine Learning · Computer Science 2024-10-21 ZiDong Wang , Zeyu Lu , Di Huang , Cai Zhou , Wanli Ouyang , and Lei Bai

Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion transformer models (DiTs). Among diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xudong Lu , Aojun Zhou , Ziyi Lin , Qi Liu , Yuhui Xu , Renrui Zhang , Xue Yang , Junchi Yan , Peng Gao , Hongsheng Li

Diffusion-based image super-resolution (SR) methods are mainly limited by the low inference speed due to the requirements of hundreds or even thousands of sampling steps. Existing acceleration sampling techniques inevitably sacrifice…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Utilizing pre-trained Text-to-Image (T2I) diffusion models to guide Blind Super-Resolution (BSR) has become a predominant approach in the field. While T2I models have traditionally relied on U-Net architectures, recent advancements have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haizhen Xie , Kunpeng Du , Qiangyu Yan , Sen Lu , Jianhong Han , Hanting Chen , Hailin Hu , Jie Hu

Recent years have witnessed the prosperity of reference-based image super-resolution (Ref-SR). By importing the high-resolution (HR) reference images into the single image super-resolution (SISR) approach, the ill-posed nature of this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Zihan Wang , Ziliang Xiong , Hongying Tang , Xiaobing Yuan

Diffusion-based methods have been acknowledged as a powerful paradigm for end-to-end visuomotor control in robotics. Most existing approaches adopt a Diffusion Policy in U-Net architecture (DP-U), which, while effective, suffers from…

Robotics · Computer Science 2025-09-30 Linzhi Wu , Aoran Mei , Xiyue Wang , Guo-Niu Zhu , Zhongxue Gan

Recent advances have significantly improved the training efficiency of diffusion transformers. However, these techniques have largely been studied in isolation, leaving unexplored the potential synergies from combining multiple approaches.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Swayam Bhanded

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

Diffusion-based image super-resolution (SR) methods have shown promise in reconstructing high-resolution images with fine details from low-resolution counterparts. However, these approaches typically require tens or even hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiao He , Huaao Tang , Zhijun Tu , Junchao Zhang , Kun Cheng , Hanting Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Diffusion Transformer (DiT), a promising diffusion model for visual generation, demonstrates impressive performance but incurs significant computational overhead. Intriguingly, analysis of pre-trained DiT models reveals that global…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yuang Ai , Qihang Fan , Xuefeng Hu , Zhenheng Yang , Ran He , Huaibo Huang

Color-guided depth map super-resolution (CDSR) improve the spatial resolution of a low-quality depth map with the corresponding high-quality color map, benefiting various applications such as 3D reconstruction, virtual reality, and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Yuan Shi , Bin Xia , Rui Zhu , Qingmin Liao , Wenming Yang