English
Related papers

Related papers: Effective Diffusion Transformer Architecture for I…

200 papers

General-purpose super-resolution models, particularly Vision Transformers, have achieved remarkable success but exhibit fundamental inefficiencies in common infrared imaging scenarios like surveillance and autonomous driving, which operate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Youngwan Jin , Incheol Park , Yagiz Nalcakan , Hyeongjin Ju , Sanghyeop Yeo , Shiho Kim

Diffusion Transformer (DiT) models excel at generating high-quality images through iterative denoising steps, but serving them under strict Service Level Objectives (SLOs) is challenging due to their high computational cost, particularly at…

Machine Learning · Computer Science 2026-01-19 Runyu Lu , Shiqi He , Wenxuan Tan , Shenggui Li , Ruofan Wu , Jeff J. Ma , Ang Chen , Mosharaf Chowdhury

Recent advancements in diffusion-based generative priors have enabled visually plausible image compression at extremely low bit rates. However, existing approaches suffer from slow sampling processes and suboptimal bit allocation due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yichong Xia , Yimin Zhou , Jinpeng Wang , Bin Chen

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors. However, these methods still face two challenges: the requirement for dozens of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Aiping Zhang , Zongsheng Yue , Renjing Pei , Wenqi Ren , Xiaochun Cao

Recent advances in diffusion-based real-world image super-resolution (Real-ISR) have demonstrated remarkable perceptual quality, yet the balance between fidelity and controllability remains a problem: multi-step diffusion-based methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yushun Fang , Yuxiang Chen , Shibo Yin , Qiang Hu , Jiangchao Yao , Ya Zhang , Xiaoyun Zhang , Yanfeng Wang

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

Recently, diffusion transformers have gained wide attention with its excellent performance in text-to-image and text-to-vidoe models, emphasizing the need for transformers as backbone for diffusion models. Transformer-based models have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M. Patel

Transformers have catalyzed advancements in computer vision and natural language processing (NLP) fields. However, substantial computational complexity poses limitations for their application in long-context tasks, such as high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhengcong Fei , Mingyuan Fan , Changqian Yu , Debang Li , Junshi Huang

Performing super-resolution of a depth image using the guidance from an RGB image is a problem that concerns several fields, such as robotics, medical imaging, and remote sensing. While deep learning methods have achieved good results in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Nando Metzger , Rodrigo Caye Daudt , Konrad Schindler

Diffusion transformers (DiT) have become the de facto choice for generating high-quality images and videos, largely due to their scalability, which enables the construction of larger models for enhanced performance. However, the increased…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Pratheba Selvaraju , Tianyu Ding , Tianyi Chen , Ilya Zharkov , Luming Liang

Diffusion models represent the state-of-the-art in generative modeling. Due to their high training costs, many works leverage pre-trained diffusion models' powerful representations for downstream tasks, such as face super-resolution (FSR),…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jiarui Yang , Tao Dai , Yufei Zhu , Naiqi Li , Jinmin Li , Shutao Xia

Scene Text Image Super-Resolution (STISR) aims to restore high-resolution details in low-resolution text images, which is crucial for both human readability and machine recognition. Existing methods, however, often depend on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Axi Niu , Kang Zhang , Qingsen Yan , Hao Jin , Jinqiu Sun , Yanning Zhang

Transformers have demonstrated promising performance in computer vision tasks, including image super-resolution (SR). The quadratic computational complexity of window self-attention mechanisms in many transformer-based SR methods forces the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fayaz Ali , Muhammad Zawish , Steven Davy , Radu Timofte

We introduce native-resolution image synthesis, a novel generative modeling paradigm that enables the synthesis of images at arbitrary resolutions and aspect ratios. This approach overcomes the limitations of conventional fixed-resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zidong Wang , Lei Bai , Xiangyu Yue , Wanli Ouyang , Yiyuan Zhang

In this paper, we present Diffusion-4K, a novel framework for direct ultra-high-resolution image synthesis using text-to-image diffusion models. The core advancements include: (1) Aesthetic-4K Benchmark: addressing the absence of a publicly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Jinjin Zhang , Qiuyu Huang , Junjie Liu , Xiefan Guo , Di Huang

High-resolution computed tomography (CT) imaging is essential for medical diagnosis but requires increased radiation exposure, creating a critical trade-off between image quality and patient safety. While deep learning methods have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Chunlei Li , Yilei Shi , Haoxi Hu , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Reference-based super-resolution (RefSR) has the potential to build bridges across spatial and temporal resolutions of remote sensing images. However, existing RefSR methods are limited by the faithfulness of content reconstruction and the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Runmin Dong , Shuai Yuan , Bin Luo , Mengxuan Chen , Jinxiao Zhang , Lixian Zhang , Weijia Li , Juepeng Zheng , Haohuan Fu

Applying diffusion models to image-to-image translation (I2I) has recently received increasing attention due to its practical applications. Previous attempts inject information from the source image into each denoising step for an iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mengfei Xia , Yu Zhou , Ran Yi , Yong-Jin Liu , Wenping Wang

Synthetic Aperture Radar (SAR) provides all-weather, high-resolution imaging capabilities, but its unique imaging mechanism often requires expert interpretation, limiting its widespread applicability. Translating SAR images into more easily…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xinyu Bai , Feng Xu