English
Related papers

Related papers: How Quantization Shapes Bias in Large Language Mod…

200 papers

Algorithms and models are increasingly deployed to inform decisions about people, inevitably affecting their lives. As a consequence, those in charge of developing these models must carefully evaluate their impact on different groups of…

Computers and Society · Computer Science 2023-04-27 Alessandro Fabris , Andrea Esuli , Alejandro Moreo , Fabrizio Sebastiani

Large Language Models (LLMs) are increasingly used in decision-making, yet their susceptibility to cognitive biases remains a pressing challenge. This study explores how personality traits influence these biases and evaluates the…

Artificial Intelligence · Computer Science 2025-02-21 Jiangen He , Jiqun Liu

Recently, there has been an increase in efforts to understand how large language models (LLMs) propagate and amplify social biases. Several works have utilized templates for fairness evaluation, which allow researchers to quantify social…

Computation and Language · Computer Science 2022-10-11 Preethi Seshadri , Pouya Pezeshkpour , Sameer Singh

The growing scale of large language models (LLMs) not only demands extensive computational resources but also raises environmental concerns due to their increasing carbon footprint. Model quantization emerges as an effective approach that…

Software Engineering · Computer Science 2025-07-15 Saima Afrin , Bowen Xu , Antonio Mastropaolo

With the ever-growing complexity of deep learning models for face recognition, it becomes hard to deploy these systems in real life. Researchers have two options: 1) use smaller models; 2) compress their current models. Since the usage of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Pedro C. Neto , Eduarda Caldeira , Jaime S. Cardoso , Ana F. Sequeira

The impressive performance of language models is undeniable. However, the presence of biases based on gender, race, socio-economic status, physical appearance, and sexual orientation makes the deployment of language models challenging. This…

Computation and Language · Computer Science 2025-08-13 Swati Rajwal , Shivank Garg , Reem Abdel-Salam , Abdelrahman Zayed

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

Artificial Intelligence · Computer Science 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

Quantization is widely adopted to reduce the computational cost of large language models (LLMs); however, its implications for fairness and safety, particularly in dynamic quantization and multilingual contexts, remain underexplored. In…

Computation and Language · Computer Science 2026-01-21 Muhammad Alif Al Hakim , Alfan Farizki Wicaksono , Fajri Koto

The popularity of pretrained language models in natural language processing systems calls for a careful evaluation of such models in down-stream tasks, which have a higher potential for societal impact. The evaluation of such systems…

Computation and Language · Computer Science 2022-04-15 Ioana Baldini , Dennis Wei , Karthikeyan Natesan Ramamurthy , Mikhail Yurochkin , Moninder Singh

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

Large language models of code exhibit high capability in performing diverse software engineering tasks, such as code translation, defect detection, text-to-code generation, and code summarization. While their ability to enhance developer…

Software Engineering · Computer Science 2025-05-21 Aftab Hussain , Sadegh AlMahdi Kazemi Zarkouei , Md Rafiqul Islam Rabin , Mohammad Amin Alipour , Sen Lin , Bowen Xu

Bayesian neural networks (BNNs) are making significant progress in many research areas where decision-making needs to be accompanied by uncertainty estimation. Being able to quantify uncertainty while making decisions is essential for…

Machine Learning · Computer Science 2021-06-07 Martin Ferianc , Partha Maji , Matthew Mattina , Miguel Rodrigues

Post Training Quantization (PTQ) is widely adopted due to its high compression capacity and speed with minimal impact on accuracy. However, we observed that disparate impacts are exacerbated by quantization, especially for minority groups.…

Machine Learning · Computer Science 2025-09-10 Abhimanyu Bellam , Jung-Eun Kim

Quantization is widely used to accelerate inference and streamline the deployment of large language models (LLMs), yet its effects on self-explanations (SEs) remain unexplored. SEs, generated by LLMs to justify their own outputs, require…

Computation and Language · Computer Science 2026-01-05 Qianli Wang , Nils Feldhus , Pepa Atanasova , Fedor Splitt , Simon Ostermann , Sebastian Möller , Vera Schmitt

Biases induced to text by generative models have become an increasingly large topic in recent years. In this paper we explore how machine translation might introduce a bias in sentiments as classified by sentiment analysis models. For this,…

Computation and Language · Computer Science 2023-06-13 Kai Hartung , Aaricia Herygers , Shubham Kurlekar , Khabbab Zakaria , Taylan Volkan , Sören Gröttrup , Munir Georges

Large language models (LLMs) have been shown to propagate and amplify harmful stereotypes, particularly those that disproportionately affect marginalised communities. To understand the effect of these stereotypes more comprehensively, we…

Computation and Language · Computer Science 2024-10-10 Zara Siddique , Liam D. Turner , Luis Espinosa-Anke

Neural network quantization is a critical technique for deploying models on resource-limited devices. Despite its widespread use, the impact of quantization on model perceptual fields, particularly in relation to class activation maps…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Mohamed Amine Kerkouri , Marouane Tliba , Aladine Chetouani , Alessandro Bruno

Large language models (LLMs) have exhibited exciting progress in multiple scenarios, while the huge computational demands hinder their deployments in lots of real-world applications. As an effective means to reduce memory footprint and…

Machine Learning · Computer Science 2024-06-21 Yijun Liu , Yuan Meng , Fang Wu , Shenhao Peng , Hang Yao , Chaoyu Guan , Chen Tang , Xinzhu Ma , Zhi Wang , Wenwu Zhu

The size of pretrained models is increasing, and so is their performance on a variety of NLP tasks. However, as their memorization capacity grows, they might pick up more social biases. In this work, we examine the connection between model…

Computation and Language · Computer Science 2022-06-22 Yarden Tal , Inbal Magar , Roy Schwartz

Increasing the number of parameters in large language models (LLMs) usually improves performance in downstream tasks but raises compute and memory costs, making deployment difficult in resource-limited settings. Quantization techniques,…

Computation and Language · Computer Science 2024-06-07 Renren Jin , Jiangcun Du , Wuwei Huang , Wei Liu , Jian Luan , Bin Wang , Deyi Xiong