English
Related papers

Related papers: Who Gets Which Message? Auditing Demographic Bias …

200 papers

The rapid integration of Large Language Models (LLMs) into various domains raises concerns about societal inequalities and information bias. This study examines biases in LLMs related to background, gender, and age, with a focus on their…

Computation and Language · Computer Science 2025-09-15 Willem Huijzer , Jieying Chen

Social media discourse involves people from different backgrounds, beliefs, and motives. Thus, often such discourse can devolve into toxic interactions. Generative Models, such as Llama and ChatGPT, have recently exploded in popularity due…

Machine Learning · Computer Science 2024-11-21 Anique Tahir , Lu Cheng , Manuel Sandoval , Yasin N. Silva , Deborah L. Hall , Huan Liu

Large Language Models (LLMs) have seen widespread deployment in various real-world applications. Understanding these biases is crucial to comprehend the potential downstream consequences when using LLMs to make decisions, particularly for…

Computation and Language · Computer Science 2024-01-10 Abel Salinas , Parth Vipul Shah , Yuzhong Huang , Robert McCormack , Fred Morstatter

Human judgments are inherently subjective and are actively affected by personal traits such as gender and ethnicity. While Large Language Models (LLMs) are widely used to simulate human responses across diverse contexts, their ability to…

Computation and Language · Computer Science 2025-02-18 Huaman Sun , Jiaxin Pei , Minje Choi , David Jurgens

Large Language Models are increasingly employed in generating consumer product recommendations, yet their potential for embedding and amplifying gender and race biases remains underexplored. This paper serves as one of the first attempts to…

Computation and Language · Computer Science 2026-02-10 Ke Xu , Shera Potka , Alex Thomo

The growing prominence of large language models (LLMs) in daily life has heightened concerns that LLMs exhibit many of the same gender-related biases as their creators. In the context of hiring decisions, we quantify the degree to which…

Computers and Society · Computer Science 2026-04-02 Nina Gerszberg , Janka Hamori , Andrew Lo

Large Language Models (LLMs) are capable of generating opinions and propagating bias unknowingly, originating from unrepresentative and non-diverse data collection. Prior research has analysed these opinions with respect to the West,…

Computers and Society · Computer Science 2025-03-11 Hari Shankar , Vedanta S P , Tejas Cavale , Ponnurangam Kumaraguru , Abhijnan Chakraborty

This paper examines how Large Language Models (LLMs) reproduce societal norms, particularly heterocisnormativity, and how these norms translate into measurable biases in their text generations. We investigate whether explicit information…

Computation and Language · Computer Science 2026-01-29 Mae Sosto , Delfina Sol Martinez Pandiani , Laura Hollink

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

Computation and Language · Computer Science 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

Large Language Models (LLMs) routinely infer users demographic traits from phrasing alone, which can result in biased responses, even when no explicit demographic information is provided. The role of disability cues in shaping these…

Computation and Language · Computer Science 2025-10-23 Vishnu Hari , Kalpana Panda , Srikant Panda , Amit Agarwal , Hitesh Laxmichand Patel

We investigate how Large Language Models (LLMs) behave when simulating political discourse on social media. Leveraging 21 million interactions on X during the 2024 U.S. presidential election, we construct LLM agents based on 1,186 real…

Human-Computer Interaction · Computer Science 2025-07-02 Jacopo Nudo , Mario Edoardo Pandolfo , Edoardo Loru , Mattia Samory , Matteo Cinelli , Walter Quattrociocchi

Large Language Models (LLMs) are widely used for text generation, making it crucial to address potential bias. This study investigates ideological framing bias in LLM-generated articles, focusing on the subtle and subjective nature of such…

Computation and Language · Computer Science 2026-01-13 Molly Kennedy , Ayyoob Imani , Timo Spinde , Akiko Aizawa , Hinrich Schütze

Large Language Models' (LLMs) ability to converse naturally is empowered by their ability to empathetically understand and respond to their users. However, emotional experiences are shaped by demographic and cultural contexts. This raises…

Computation and Language · Computer Science 2025-10-28 Ananya Malik , Nazanin Sabri , Melissa Karnaze , Mai Elsherief

Generative artificial intelligence (AI), particularly large language models (LLMs), is being rapidly deployed in recruitment and for candidate shortlisting. We audit several mid-sized open-source LLMs for gender bias using a dataset of…

General Economics · Economics 2025-05-01 Sugat Chaturvedi , Rochana Chaturvedi

This paper examines biases in large language models (LLMs) when generating synthetic populations from responses to personality questionnaires. Using five LLMs, we first assess the representativeness and potential biases in the…

Computers and Society · Computer Science 2026-02-04 Jacopo Amidei , Gregorio Ferreira , Mario Muñoz Serrano , Rubén Nieto , Andreas Kaltenbrunner

Large language models (LLMs) are rapidly being integrated into high-stakes public safety systems, including emergency call triage and dispatch decision support, yet their demographic fairness in this context remains largely untested. Here…

Computation and Language · Computer Science 2026-05-05 William Guey , Wei Zhang , Pierrick Bougault , Yi Wang , Bertan Ucar , Vitor D. de Moura , José O. Gomes

Large language models (LLMs) are becoming pervasive in everyday life, yet their propensity to reproduce biases inherited from training data remains a pressing concern. Prior investigations into bias in LLMs have focused on the association…

Computation and Language · Computer Science 2024-04-29 Messi H. J. Lee , Jacob M. Montgomery , Calvin K. Lai

As the application of Large Language Models (LLMs) spreads across various industries, there are increasing concerns about the potential for their misuse, especially in sensitive areas such as political discourse. Deliberately aligning LLMs…

Computation and Language · Computer Science 2026-04-28 Lisa Korver , Mohamed Mostagir , Sherief Reda

The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings. This research evaluates the performance of seven…

Computation and Language · Computer Science 2024-06-14 Millicent Ochieng , Varun Gumma , Sunayana Sitaram , Jindong Wang , Vishrav Chaudhary , Keshet Ronen , Kalika Bali , Jacki O'Neill

Commit messages are essential in software development as they serve to document and explain code changes. Yet, their quality often falls short in practice, with studies showing significant proportions of empty or inadequate messages. While…

Software Engineering · Computer Science 2025-07-16 Qunhong Zeng , Yuxia Zhang , Zexiong Ma , Bo Jiang , Ningyuan Sun , Klaas-Jan Stol , Xingyu Mou , Hui Liu