English
Related papers

Related papers: Pioneering 4-Bit FP Quantization for Diffusion Mod…

200 papers

Quantization is an indispensable technique for serving Large Language Models (LLMs) and has recently found its way into LoRA fine-tuning. In this work we focus on the scenario where quantization and LoRA fine-tuning are applied together on…

Computation and Language · Computer Science 2023-11-29 Yixiao Li , Yifan Yu , Chen Liang , Pengcheng He , Nikos Karampatziakis , Weizhu Chen , Tuo Zhao

Quantization has been widely used to compress and accelerate inference of large language models (LLMs). Existing methods focus on exploring the per-token dynamic calibration to ensure both inference acceleration and model accuracy under…

Machine Learning · Computer Science 2025-03-12 Jinguang Wang , Jingyu Wang , Haifeng Sun , Tingting Yang , Zirui Zhuang , Wanyi Ning , Yuexi Yin , Qi Qi , Jianxin Liao

Text-to-image generation via Stable Diffusion models (SDM) have demonstrated remarkable capabilities. However, their computational intensity, particularly in the iterative denoising process, hinders real-time deployment in latency-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Shuaiting Li , Juncan Deng , Zeyu Wang , Kedong Xu , Rongtao Deng , Hong Gu , Haibin Shen , Kejie Huang

Based on the model's resilience to computational noise, model quantization is important for compressing models and improving computing speed. Existing quantization techniques rely heavily on experience and "fine-tuning" skills. In the…

Machine Learning · Computer Science 2022-07-22 Daning Cheng , Wenguang Chen

With the rapid growth in the use of fine-tuning for large language models (LLMs), optimizing fine-tuning while keeping inference efficient has become highly important. However, this is a challenging task as it requires improvements in all…

Computation and Language · Computer Science 2024-10-14 Changhun Lee , Jun-gyu Jin , Younghyun Cho , Eunhyeok Park

Diffusion models are the go-to method for Text-to-Image generation, but their iterative denoising processes has high inference latency. Quantization reduces compute time by using lower bitwidths, but applies a fixed precision across all…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Basile Lewandowski , Simon Kurz , Aditya Shankar , Robert Birke , Jian-Jia Chen , Lydia Y. Chen

Post-training quantization (PTQ) improves efficiency but struggles with limited calibration data, especially under privacy constraints. Data-free quantization (DFQ) mitigates this by generating synthetic images using generative models such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Jiwoong Park , Chaeun Lee , Yongseok Choi , Sein Park , Deokki Hong , Jungwook Choi

One-step diffusion-based image super-resolution (OSDSR) models are showing increasingly superior performance nowadays. However, although their denoising steps are reduced to one and they can be quantized to 8-bit to reduce the costs…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Libo Zhu , Haotong Qin , Kaicheng Yang , Wenbo Li , Yong Guo , Yulun Zhang , Susanto Rahardja , Xiaokang Yang

Quantization followed by parameter-efficient fine-tuning has emerged as a promising paradigm for downstream adaptation under tight GPU memory constraints. However, this sequential pipeline fails to leverage the intricate interaction between…

Machine Learning · Computer Science 2026-02-27 Changhai Zhou , Shiyang Zhang , Yuhua Zhou , Qian Qiao , Jun Gao , Cheng Jin , Kaizhou Qin , Weizhong Zhang

Compressing neural networks by quantizing model parameters offers useful trade-off between performance and efficiency. Methods like quantization-aware training and post-training quantization strive to maintain the downstream performance of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Thomas Woergaard , Raghavendra Selvan

Diffusion models have shown remarkable performance in image synthesis by progressively estimating a smooth transition from a Gaussian distribution of noise to a real image. Unfortunately, their practical deployment is limited by slow…

Machine Learning · Computer Science 2026-03-03 Dung Anh Hoang , Cuong Pham anh Trung Le , Jianfei Cai , Thanh-Toan Do

Neural network quantization is widely used to reduce model inference complexity in real-world deployments. However, traditional integer quantization suffers from accuracy degradation when adapting to various dynamic ranges. Recent research…

Performance · Computer Science 2023-10-30 Zhuoyi Zhang , Yunchen Zhang , Gonglei Shi , Yu Shen , Ruihao Gong , Xiaoxu Xia , Qi Zhang , Lewei Lu , Xianglong Liu

The diffusion model has gained popularity in vision applications due to its remarkable generative performance and versatility. However, high storage and computation demands, resulting from the model size and iterative generation, hinder its…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Junhyuk So , Jungwon Lee , Daehyun Ahn , Hyungjun Kim , Eunhyeok Park

Low precision data representation is important to reduce storage size and memory access for convolutional neural networks (CNNs). Yet, existing methods have two major limitations: (1) requiring re-training to maintain accuracy for deep…

Signal Processing · Electrical Eng. & Systems 2020-03-10 Chen Wu , Mingyu Wang , Xinyuan Chu , Kun Wang , Lei He

Quantization is a technique for creating efficient Deep Neural Networks (DNNs), which involves performing computations and storing tensors at lower bit-widths than f32 floating point precision. Quantization reduces model size and inference…

Machine Learning · Computer Science 2023-10-02 Eliska Kloberdanz , Wei Le

While federated learning (FL) systems often utilize quantization to battle communication and computational bottlenecks, they have heretofore been limited to deploying fixed-precision quantization schemes. Meanwhile, the concept of…

Machine Learning · Computer Science 2023-12-01 Huancheng Chen , Haris Vikalo

Large language models (LLMs) demand extensive memory capacity during both fine-tuning and inference. To enable memory-efficient fine-tuning, existing methods apply block-wise quantization techniques, such as NF4 and AF4, to the network…

Machine Learning · Computer Science 2025-05-13 Patrick Blumenberg , Thomas Graave , Tim Fingscheidt

Diffusion models have achieved remarkable success in the image and video generation tasks. Nevertheless, they often require a large amount of memory and time overhead during inference, due to the complex network architecture and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Haocheng Huang , Jiaxin Chen , Jinyang Guo , Ruiyi Zhan , Yunhong Wang

Diffusion models achieve high-quality image generation but face deployment challenges due to their high computational requirements. Although 8-bit outlier-aware post-training quantization (PTQ) matches full-precision performance, extending…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Donghoon Kim , Dongyoung Lee , Ik Joon Chang , Sung-Ho Bae

Mixed-precision quantization has received increasing attention for its capability of reducing the computational burden and speeding up the inference time. Existing methods usually focus on the sensitivity of different network layers, which…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Mingkai Wang , Taisong Jin , Miaohui Zhang , Zhengtao Yu