English
Related papers

Related papers: Evaluating Quantized Large Language Models

200 papers

Scaling model size significantly challenges the deployment and inference of Large Language Models (LLMs). Due to the redundancy in LLM weights, recent research has focused on pushing weight-only quantization to extremely low-bit (even down…

Artificial Intelligence · Computer Science 2024-10-23 Yifei Liu , Jicheng Wen , Yang Wang , Shengyu Ye , Li Lyna Zhang , Ting Cao , Cheng Li , Mao Yang

Post-Training Quantization (PTQ) enhances the efficiency of Large Language Models (LLMs) by enabling faster operation and compatibility with more accessible hardware through reduced memory usage, at the cost of small performance drops. We…

Machine Learning · Computer Science 2024-06-06 Davide Paglieri , Saurabh Dash , Tim Rocktäschel , Jack Parker-Holder

Existing post-training quantization methods for large language models (LLMs) offer remarkable success. However, the increasingly marginal performance gains suggest that existing quantization strategies are insufficient to support the…

Machine Learning · Computer Science 2025-10-28 Jiaqi Zhao , Miao Zhang , Deng Xiang , Ming Li , Weili Guan , Liqiang Nie

Large Language Models (LLMs) suffer severe performance degradation when facing extremely low-bit (sub 2-bit) quantization. Several existing sub 2-bit post-training quantization (PTQ) methods utilize a mix-precision scheme by leveraging an…

Machine Learning · Computer Science 2025-08-07 Jiaqi Zhao , Miao Zhang , Ming Wang , Yuzhang Shang , Kaihao Zhang , Weili Guan , Yaowei Wang , Min Zhang

Microscaling Floating-Point (MXFP) has emerged as a promising low-precision format for large language models (LLMs). Despite various post-training quantization (PTQ) algorithms being proposed, they mostly focus on integer quantization,…

Computation and Language · Computer Science 2026-01-15 Manyi Zhang , Ji-Fu Li , Zhongao Sun , Haoli Bai , Hui-Ling Zhen , Zhenhua Dong , Xianzhi Yu

Large Language Models (LLMs) are powerful tools for modern applications, but their computational demands limit accessibility. Quantization offers efficiency gains, yet its impact on safety and trustworthiness remains poorly understood. To…

Cryptography and Security · Computer Science 2025-07-01 Artyom Kharinaev , Viktor Moskvoretskii , Egor Shvetsov , Kseniia Studenikina , Bykov Mikhail , Evgeny Burnaev

Large language models (LLMs) now support context windows exceeding 128K tokens, but this comes with significant memory requirements and high inference latency. Quantization can mitigate these costs, but may degrade performance. In this…

Computation and Language · Computer Science 2025-09-23 Anmol Mekala , Anirudh Atmakuru , Yixiao Song , Marzena Karpinska , Mohit Iyyer

Post-training quantization (PTQ) has played a key role in compressing large language models (LLMs) with ultra-low costs. However, existing PTQ methods only focus on handling the outliers within one layer or one block, which ignores the…

Machine Learning · Computer Science 2025-02-26 Xin Ding , Xiaoyu Liu , Zhijun Tu , Yun Zhang , Wei Li , Jie Hu , Hanting Chen , Yehui Tang , Zhiwei Xiong , Baoqun Yin , Yunhe Wang

Post-training quantization (PTQ) of large language models (LLMs) holds the promise in reducing the prohibitive computational cost at inference time. Quantization of all weight, activation and key-value (KV) cache tensors to 4-bit without…

Machine Learning · Computer Science 2025-02-05 Utkarsh Saxena , Sayeh Sharify , Kaushik Roy , Xin Wang

Quantization is an effective technique to reduce the deployment cost of large language models (LLMs), and post-training quantization (PTQ) has been widely studied due to its efficiency. However, existing PTQ methods are limited by their…

Machine Learning · Computer Science 2025-09-30 Qitao Tan , Xiaoying Song , Jin Lu , Guoming Li , Jun Liu , Lingzi Hong , Caiwen Ding , Jundong Li , Xiaoming Zhai , Shaoyi Huang , Wei Niu , Geng Yuan

Quantizing large language models (LLMs) to 1-bit precision significantly reduces computational costs, but existing quantization techniques suffer from noticeable performance degradation when using weight and activation precisions below 4…

Machine Learning · Computer Science 2025-07-01 Siqing Song , Chuang Wang , Ruiqi Wang , Yi Yang , Xu-Yao Zhang

Recent studies introduced effective compression techniques for Large Language Models (LLMs) via post-training quantization or low-bit weight representation. Although quantized weights offer storage efficiency and allow for faster inference,…

Computation and Language · Computer Science 2024-05-02 Irina Proskurina , Luc Brun , Guillaume Metzler , Julien Velcin

The size of a model has been a strong predictor of its quality, as well as its cost. As such, the trade-off between model cost and quality has been well-studied. Post-training optimizations like quantization and pruning have typically…

Machine Learning · Computer Science 2025-08-29 Giuseppe Franco , Pablo Monteagudo-Lago , Ian Colbert , Nicholas Fraser , Michaela Blott

In the era of large-scale language models, the substantial parameter size poses significant challenges for deployment. Being a prevalent compression technique, quantization has emerged as the mainstream practice to tackle this issue, which…

Computation and Language · Computer Science 2023-08-31 Qingyuan Li , Yifan Zhang , Liang Li , Peng Yao , Bo Zhang , Xiangxiang Chu , Yerui Sun , Li Du , Yuchen Xie

Vision-Language Models (VLMs) have enabled a variety of real-world applications. The large parameter size of VLMs brings large memory and computation overhead which poses significant challenges for deployment. Post-Training Quantization…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Shiyao Li , Yingchun Hu , Xuefei Ning , Xihui Liu , Ke Hong , Xiaotao Jia , Xiuhong Li , Yaqi Yan , Pei Ran , Guohao Dai , Shengen Yan , Huazhong Yang , Yu Wang

Transformer-based architectures like BERT have achieved great success in a wide range of Natural Language tasks. Despite their decent performance, the models still have numerous parameters and high computational complexity, impeding their…

Computation and Language · Computer Science 2022-11-01 Ting Hu , Christoph Meinel , Haojin Yang

Large Language Models (LLMs) with multimodal capabilities have revolutionized vision-language tasks, but their deployment often requires huge memory and computational resources. While post-training quantization (PTQ) has successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shubhang Bhatnagar , Andy Xu , Kar-Han Tan , Narendra Ahuja

Large language models (LLMs) excel at natural language tasks but face deployment challenges due to their growing size outpacing GPU memory advancements. Model quantization mitigates this issue by lowering weight and activation precision,…

Computation and Language · Computer Science 2025-12-17 Shizhuo Mao , Song Chen , Yi Kang

Due to the high memory and computational costs associated with large language models (LLMs), model compression techniques such as quantization, which reduces inference costs, and parameter-efficient fine-tuning (PEFT) methods like Low-Rank…

Machine Learning · Computer Science 2025-07-23 Hyesung Jeon , Yulhwa Kim , Jae-joon Kim

This paper provides a comprehensive overview of the principles, challenges, and methodologies associated with quantizing large-scale neural network models. As neural networks have evolved towards larger and more complex architectures to…

Machine Learning · Computer Science 2024-09-19 Yanshu Wang , Tong Yang , Xiyan Liang , Guoan Wang , Hanning Lu , Xu Zhe , Yaoming Li , Li Weitao