English
Related papers

Related papers: How Quantization Shapes Bias in Large Language Mod…

200 papers

While reasoning-based large language models excel at complex tasks through an internal, structured thinking process, a concerning phenomenon has emerged that such a thinking process can aggregate social stereotypes, leading to biased…

Computation and Language · Computer Science 2026-05-13 Guoqing Luo , Iffat Maab , Lili Mou , Junichi Yamagishi

Text-to-Image (TTI) generative models have shown great progress in the past few years in terms of their ability to generate complex and high-quality imagery. At the same time, these models have been shown to suffer from harmful biases,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Aditya Chinchure , Pushkar Shukla , Gaurav Bhatt , Kiri Salij , Kartik Hosanagar , Leonid Sigal , Matthew Turk

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Research on bias in machine learning algorithms has generally been concerned with the impact of bias on predictive accuracy. We believe that there are other factors that should also play a role in the evaluation of bias. One such factor is…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

Prompting inputs with natural language task descriptions has emerged as a popular mechanism to elicit reasonably accurate outputs from large-scale generative language models with little to no in-context supervision. This also helps gain…

Computation and Language · Computer Science 2023-08-17 Lisa Bauer , Karthik Gopalakrishnan , Spandana Gella , Yang Liu , Mohit Bansal , Dilek Hakkani-Tur

Large language models (LLMs) are known to produce varying responses depending on prompt phrasing, indicating that subtle guidance in phrasing can steer their answers. However, the impact of this framing bias on LLM-based evaluation, where…

Computation and Language · Computer Science 2026-01-21 Yerin Hwang , Dongryeol Lee , Taegwan Kang , Minwoo Lee , Kyomin Jung

Large Language Models (LLMs) have fundamentally transformed the field of natural language processing; however, their vulnerability to biases presents a notable obstacle that threatens both fairness and trust. This review offers an extensive…

Computation and Language · Computer Science 2025-09-19 Kiana Kiashemshaki , Mohammad Jalili Torkamani , Negin Mahmoudi , Meysam Shirdel Bilehsavar

Scale is often attributed as one of the factors that cause an increase in the performance of LLMs, resulting in models with billion and trillion parameters. One of the limitations of such large models is the high computational requirements…

Machine Learning · Computer Science 2024-05-09 Sher Badshah , Hassan Sajjad

Machine learning algorithms are optimized to model statistical properties of the training data. If the input data reflects stereotypes and biases of the broader society, then the output of the learning algorithm also captures these…

Computation and Language · Computer Science 2016-06-21 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

This study aims to understand how statistical biases affect the model's ability to generalize to in-distribution and out-of-distribution data on algorithmic tasks. Prior research indicates that transformers may inadvertently learn to rely…

Machine Learning · Computer Science 2024-09-11 John Mitros

Large language models (LLMs) are increasingly positioned as solutions for education, yet evaluations often reduce their impact to narrow performance metrics. This paper reframes the question by asking "what kind of impact should LLMs have…

Computers and Society · Computer Science 2025-10-01 Jiayu Huang , Ruoxin Ritter Wang , Jen-Hao Liu , Boming Xia , Yue Huang , Ruoxi Sun , Jason Minhui Xue , Jinan Zou

Confirmation bias and peer pressure both have substantial impacts on the formation of collective decisions. Nevertheless, few attempts have been made to study how the interplay between these two mechanisms affects public opinion evolution.…

Physics and Society · Physics 2020-12-22 Longzhao Liu , Xin Wang , Shaoting Tang , Zhiming Zheng

Speech and voice conditions can alter the acoustic properties of speech, which could impact the performance of paralinguistic models for affect for people with atypical speech. We evaluate publicly available models for recognizing…

Machine Learning · Computer Science 2025-08-01 Jaya Narain , Amrit Romana , Vikramjit Mitra , Colin Lea , Shirley Ren

Emerging research on bias attribution and interpretability have revealed how tokens contribute to biased behavior in language models processing English texts. We build on this line of inquiry by adapting the information-theoretic bias…

Computation and Language · Computer Science 2025-08-29 Lance Calvin Lim Gamboa , Yue Feng , Mark Lee

Current bias evaluations in Instruction Text-to-Speech (ITTS) often rely on univariate testing, overlooking the compositional structure of social cues. In this work, we investigate gender bias by modeling prompts as combinations of Social…

Signal Processing · Electrical Eng. & Systems 2026-03-24 Kuan-Yu Chen , Yi-Cheng Lin , Po-Chung Hsieh , Huang-Cheng Chou , Chih-Fan Hsu , Jeng-Lin Li , Hung-yi Lee , Jian-Jiun Ding

Many text corpora exhibit socially problematic biases, which can be propagated or amplified in the models trained on such data. For example, doctor cooccurs more frequently with male pronouns than female pronouns. In this study we (i)…

Computation and Language · Computer Science 2019-04-08 Shikha Bordia , Samuel R. Bowman

Confirmation bias is a cognitive bias that adversely affects management decisions, and mathematical modelling is an aid to its detailed understanding. Bias in opinion update about the value of a parameter is modelled here assuming that…

Other Statistics · Statistics 2022-02-08 Rose D Baker

Several prior works have shown that language models (LMs) can generate text containing harmful social biases and stereotypes. While decoding algorithms play a central role in determining properties of LM generated text, their impact on the…

Computation and Language · Computer Science 2022-10-11 Jwala Dhamala , Varun Kumar , Rahul Gupta , Kai-Wei Chang , Aram Galstyan

Large language models (LLMs) are increasingly used to assess moral or ethical statements, yet their judgments may reflect social and linguistic biases. This work presents a controlled, sentence-level study of how grammatical person, number,…

Computation and Language · Computer Science 2026-03-17 Gustavo Lúcius Fernandes , Jeiverson C. V. M. Santos , Pedro O. S. Vaz-de-Melo