English
Related papers

Related papers: EfficientDM: Efficient Quantization-Aware Fine-Tun…

200 papers

Diffusion models have gained significant popularity in image generation tasks. However, generating high-quality content remains notably slow because it requires running model inference over many time steps. To accelerate these models, we…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zichen Fan , Steve Dai , Rangharajan Venkatesan , Dennis Sylvester , Brucek Khailany

Fine-tuning large diffusion models for custom applications demands substantial power and time, which poses significant challenges for efficient implementation on mobile devices. In this paper, we develop a novel training accelerator…

Graphics · Computer Science 2025-04-14 Jinming Lu , Minghao She , Wendong Mao , Zhongfeng Wang

Text-to-image diffusion models are computationally intensive, often requiring dozens of forward passes through large transformer backbones. For instance, Stable Diffusion XL generates high-quality images with 50 evaluations of a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Natalia Frumkin , Diana Marculescu

Diffusion Transformers (DiTs) have recently attracted significant interest from both industry and academia due to their enhanced capabilities in visual generation, surpassing the performance of traditional diffusion models that employ…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zhenyuan Dong , Sai Qian Zhang

Diffusion models have marked a significant breakthrough in the synthesis of semantically coherent images. However, their extensive noise estimation networks and the iterative generation process limit their wider application, particularly on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuzhe Yao , Feng Tian , Jun Chen , Haonan Lin , Guang Dai , Yong Liu , Jingdong Wang

Quantization for deep neural networks have afforded models for edge devices that use less on-board memory and enable efficient low-power inference. In this paper, we present a comparison of model-parameter driven quantization approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Prateeth Nayak , David Zhang , Sek Chai

Recently, Diffusion Transformers (DiTs) have emerged as a dominant architecture in video generation, surpassing U-Net-based models in terms of performance. However, the enhanced capabilities of DiTs come with significant drawbacks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Junyi Wu , Zhiteng Li , Zheng Hui , Yulun Zhang , Linghe Kong , Xiaokang Yang

Diffusion Transformers (DiTs) have recently gained substantial attention in both industrial and academic fields for their superior visual generation capabilities, outperforming traditional diffusion models that use U-Net. However,the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenxuan Liu , Sai Qian Zhang

Diffusion models have shown superior performance in real-world video super-resolution (VSR). However, the slow processing speeds and heavy resource consumption of diffusion models hinder their practical application and deployment.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Bowen Chai , Zheng Chen , Libo Zhu , Wenbo Li , Yong Guo , Yulun Zhang

Diffusion large language models (dLLMs), which offer bidirectional context and flexible masked-denoising generation, are emerging as a compelling alternative to autoregressive (AR) LLMs. However, like AR LLMs, their model sizes continue to…

Machine Learning · Computer Science 2025-10-07 Tianao Zhang , Zhiteng Li , Xianglong Yan , Haotong Qin , Yong Guo , Yulun Zhang

Diffusion models have achieved cutting-edge performance in image generation. However, their lengthy denoising process and computationally intensive score estimation network impede their scalability in low-latency and resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Qian Zeng , Jie Song , Han Zheng , Hao Jiang , Mingli Song

Low-bit quantization has become widespread for compressing image super-resolution (SR) models for edge deployment, which allows advanced SR models to enjoy compact low-bit parameters and efficient integer/bitwise constructions for storage…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Kai Liu , Haotong Qin , Yong Guo , Xin Yuan , Linghe Kong , Guihai Chen , Yulun Zhang

Diffusion models have revolutionized image synthesis, setting new benchmarks in quality and creativity. However, their widespread adoption is hindered by the intensive computation required during the iterative denoising process.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Huanpeng Chu , Wei Wu , Chengjie Zang , Kun Yuan

Transformer-based diffusion models, dubbed Diffusion Transformers (DiTs), have achieved state-of-the-art performance in image and video generation tasks. However, their large model size and slow inference speed limit their practical…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Xinyan Liu , Huihong Shi , Yang Xu , Zhongfeng Wang

Diffusion transformers (DiTs) combine transformer architectures with diffusion models. However, their computational complexity imposes significant limitations on real-time applications and sustainability of AI systems. In this study, we aim…

Machine Learning · Computer Science 2025-02-07 Younghye Hwang , Hyojin Lee , Joonhyuk Kang

Deploying Vision-Language Models (VLMs) on edge devices (e.g., smartphones and robots) is crucial for enabling low-latency and privacy-preserving intelligent applications. Given the resource constraints of these devices, quantization offers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Tianyu Guo , Shanwei Zhao , Shiai Zhu , Chenguang Ma

Large-scale pre-trained Vision-Language Models (VLMs) have gained prominence in various visual and multimodal tasks, yet the deployment of VLMs on downstream application platforms remains challenging due to their prohibitive requirements of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Huixin Sun , Runqi Wang , Yanjing Li , Xianbin Cao , Xiaolong Jiang , Yao Hu , Baochang Zhang

Quantization has emerged as a mainstream approach for deploying Large Language Models (LLMs) on resource-constrained devices, yet compressing precision below 4-bit typically causes severe performance degradation or prohibitive retraining…

Machine Learning · Computer Science 2026-05-22 Shu-Hao Zhang , Le-Tong Huang , Xiang-Sheng Deng , Xin-Yi Zou , Chen Wu , Nan Li , Shao-Qun Zhang , Zhi-Hua Zhou

Diffusion models have shown remarkable performance in image synthesis, but they demand extensive computational and memory resources for training, fine-tuning and inference. Although advanced quantization techniques have successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Hoigi Seo , Wongi Jeong , Kyungryeol Lee , Se Young Chun

Diffusion models (DMs) generate remarkable high quality images via the stochastic denoising process, which unfortunately incurs high sampling time. Post-quantizing the trained diffusion models in fixed bit-widths, e.g., 4 bits on weights…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Rocco Manz Maruzzelli , Basile Lewandowski , Lydia Y. Chen