中文
相关论文

相关论文: Scaling Diffusion Transformers Efficiently via $\m…

200 篇论文

Diffusion Transformers (DiT) are renowned for their impressive generative performance; however, they are significantly constrained by considerable computational costs due to the quadratic complexity in self-attention and the extensive…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Shuning Chang , Pichao Wang , Jiasheng Tang , Fan Wang , Yi Yang

We introduce Vision Bridge Transformer (ViBT), a large-scale instantiation of Brownian Bridge Models designed for conditional generation. Unlike traditional diffusion models that transform noise into data, Bridge Models directly model the…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhenxiong Tan , Zeqing Wang , Xingyi Yang , Songhua Liu , Xinchao Wang

Diffusion Transformers (DiTs) have become a de facto backbone of modern visual generation, and nearly every major axis of their design -- tokenization, attention, conditioning, objectives, and latent autoencoders -- has been extensively…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Chao Xu , Maohua Li , Qirui Li , Yixuan Xu , Yanke Zhou , Yunhe Li , Cuifeng Shen , Hanlin Tang , Kan Liu , Tao Lan , Lin Qu , Shao-Qun Zhang

Contemporary diffusion models built upon U-Net or Diffusion Transformer (DiT) architectures have revolutionized image generation through transformer-based attention mechanisms. The prevailing paradigm has commonly employed self-attention…

计算机视觉与模式识别 · 计算机科学 2025-05-01 ZiYi Dong , Chengxing Zhou , Weijian Deng , Pengxu Wei , Xiangyang Ji , Liang Lin

Diffusion transformers (DiT) have demonstrated exceptional performance in video generation. However, their large number of parameters and high computational complexity limit their deployment on edge devices. Quantization can reduce storage…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Weilun Feng , Chuanguang Yang , Haotong Qin , Xiangqi Li , Yu Wang , Zhulin An , Libo Huang , Boyu Diao , Zixiang Zhao , Yongjun Xu , Michele Magno

The quadratic computational complexity of self-attention in diffusion transformers (DiT) introduces substantial computational costs in high-resolution image generation. While the linear-complexity Mamba model emerges as a potential…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Yuan Yao , Yicong Hong , Difan Liu , Long Mai , Feng Liu , Jiebo Luo

Large-scale pre-trained diffusion models are becoming increasingly popular in solving the Real-World Image Super-Resolution (Real-ISR) problem because of their rich generative priors. The recent development of diffusion transformer (DiT)…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Zheng-Peng Duan , Jiawei Zhang , Xin Jin , Ziheng Zhang , Zheng Xiong , Dongqing Zou , Jimmy S. Ren , Chun-Le Guo , Chongyi Li

The landscape of high-performance image generation models is currently dominated by proprietary systems, such as Nano Banana Pro and Seedream 4.0. Leading open-source alternatives, including Qwen-Image, Hunyuan-Image-3.0 and FLUX.2, are…

Despite the rapid advancement of Virtual Try-On (VTON) and Try-Off (VTOFF) technologies, existing VTON methods face challenges with fine-grained detail preservation, generalization to complex scenes, complicated pipeline, and efficient…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Weixuan Zeng , Pengcheng Wei , Huaiqing Wang , Boheng Zhang , Jia Sun , Dewen Fan , Lin HE , Long Chen , Qianqian Gan , Fan Yang , Tingting Gao

Inspired by the in-context learning mechanism of large language models (LLMs), a new paradigm of generalizable visual prompt-based image editing is emerging. Existing single-reference methods typically focus on style or appearance…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Yan Gong , Yiren Song , Yicheng Li , Chenglin Li , Yin Zhang

Diffusion Transformers (DiTs) have exhibited robust capabilities in image generation tasks. However, accurate text-guided image editing for multimodal DiTs (MM-DiTs) still poses a significant challenge. Unlike UNet-based structures that…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Yu Xu , Fan Tang , Juan Cao , Yuxin Zhang , Xiaoyu Kong , Jintao Li , Oliver Deussen , Tong-Yee Lee

Diffusion Transformers (DiTs) achieve state-of-the-art performance in text-to-image synthesis but remain computationally expensive due to the iterative nature of denoising and the quadratic cost of global attention. In this work, we observe…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Bowen Lin , Fanjiang Ye , Yihua Liu , Zhenghui Guo , Boyuan Zhang , Weijian Zheng , Yufan Xu , Tiancheng Xing , Yuke Wang , Chengming Zhang

With the scale of vision Transformer-based models continuing to grow, finetuning these large-scale pretrained models for new tasks has become increasingly parameter-intensive. Visual prompt tuning is introduced as a parameter-efficient…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Runjia Zeng , Cheng Han , Qifan Wang , Chunshu Wu , Tong Geng , Lifu Huang , Ying Nian Wu , Dongfang Liu

Parameter-efficient fine-tuning (PEFT) has emerged as a popular solution for adapting pre-trained Vision Transformer (ViT) models to downstream applications by updating only a small subset of parameters. While current PEFT methods have…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Ting Liu , Xuyang Liu , Liangtao Shi , Zunnan Xu , Yue Hu , Siteng Huang , Yi Xin , Bineng Zhong , Donglin Wang

Diffusion models have proven to be highly effective in image and video generation; however, they encounter challenges in the correct composition of objects when generating images of varying sizes due to single-scale training data. Adapting…

计算机视觉与模式识别 · 计算机科学 2024-09-23 Lanqing Guo , Yingqing He , Haoxin Chen , Menghan Xia , Xiaodong Cun , Yufei Wang , Siyu Huang , Yong Zhang , Xintao Wang , Qifeng Chen , Ying Shan , Bihan Wen

Diffusion Transformers (DiTs) have demonstrated exceptional capabilities in text-to-image synthesis. However, in the domain of controllable text-to-image generation using DiTs, most existing methods still rely on the ControlNet paradigm…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Shanyuan Liu , Jian Zhu , Junda Lu , Yue Gong , Liuzhuozheng Li , Bo Cheng , Yuhang Ma , Liebucha Wu , Xiaoyu Wu , Dawei Leng , Yuhui Yin

Diffusion Transformers (DiTs) incur prohibitive computational costs due to the quadratic scaling of self-attention. Existing pruning methods fail to simultaneously satisfy differentiability, efficiency, and the strict static budgets…

Diffusion models have demonstrated excellent capabilities in text-to-image generation. Their semantic understanding (i.e., prompt following) ability has also been greatly improved with large language models (e.g., T5, Llama). However,…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Anthony Chen , Jianjin Xu , Wenzhao Zheng , Gaole Dai , Yida Wang , Renrui Zhang , Haofan Wang , Shanghang Zhang

Image fusion aims to blend complementary information from multiple sensing modalities, yet existing approaches remain limited in robustness, adaptability, and controllability. Most current fusion networks are tailored to specific tasks and…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Jiayang Li , Chengjie Jiang , Junjun Jiang , Pengwei Liang , Jiayi Ma , Liqiang Nie

We introduce Lavender, a simple supervised fine-tuning (SFT) method that boosts the performance of advanced vision-language models (VLMs) by leveraging state-of-the-art image generation models such as Stable Diffusion. Specifically,…

机器学习 · 计算机科学 2025-05-27 Chen Jin , Ryutaro Tanno , Amrutha Saseendran , Tom Diethe , Philip Teare