English
Related papers

Related papers: Towards Understanding and Mitigating Social Biases…

200 papers

Transformer language models have achieved state-of-the-art performance for a variety of natural language tasks but have been shown to encode unwanted biases. We evaluate the social biases encoded by transformers trained with the masked…

Computation and Language · Computer Science 2025-08-19 Rahul Zalkikar , Kanchan Chandra

Large language models (LLMs) often inherit and amplify social biases embedded in their training data. A prominent social bias is gender bias. In this regard, prior work has mainly focused on gender stereotyping bias - the association of…

Computation and Language · Computer Science 2025-06-18 Erik Derner , Sara Sansalvador de la Fuente , Yoan Gutiérrez , Paloma Moreda , Nuria Oliver

Large Language Models (LLMs) exhibit social biases, which can lead to harmful stereotypes and unfair outcomes. We propose \textbf{Multi-Persona Thinking (MPT)}, a simple inference-time framework that reduces social bias by encouraging…

Computation and Language · Computer Science 2026-04-22 Yuxing Chen , Guoqing Luo , Zijun Wu , Lili Mou

Large language models (LLMs) are known to perpetuate stereotypes and exhibit biases. Various strategies have been proposed to mitigate these biases, but most work studies biases as a black-box problem without considering how concepts are…

Computation and Language · Computer Science 2025-09-19 Hannah Cyberey , Yangfeng Ji , David Evans

As NLP models become more integrated with the everyday lives of people, it becomes important to examine the social effect that the usage of these systems has. While these models understand language and have increased accuracy on difficult…

Computation and Language · Computer Science 2022-04-21 Rajas Bansal

Large Language Models (LLMs) have revolutionized natural language processing, yet concerns persist regarding their tendency to reflect or amplify social biases. This study introduces a novel evaluation framework to uncover gender biases in…

Computation and Language · Computer Science 2026-03-10 Evan Chen , Run-Jun Zhan , Yan-Bai Lin , Hung-Hsuan Chen

Large Language Models (LLMs) can generate biased responses. Yet previous direct probing techniques contain either gender mentions or predefined gender stereotypes, which are challenging to comprehensively collect. Hence, we propose an…

Computation and Language · Computer Science 2024-02-20 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

While advances in fairness and alignment have helped mitigate overt biases exhibited by large language models (LLMs) when explicitly prompted, we hypothesize that these models may still exhibit implicit biases when simulating human…

Computation and Language · Computer Science 2025-01-30 Yuxuan Li , Hirokazu Shirado , Sauvik Das

Recent advances in the capacity of large language models to generate human-like text have resulted in their increased adoption in user-facing settings. In parallel, these improvements have prompted a heated discourse around the risks of…

Computation and Language · Computer Science 2023-02-23 Sachin Kumar , Vidhisha Balachandran , Lucille Njoo , Antonios Anastasopoulos , Yulia Tsvetkov

Sociodemographic bias in language models (LMs) has the potential for harm when deployed in real-world settings. This paper presents a comprehensive survey of the past decade of research on sociodemographic bias in LMs, organized into a…

Computation and Language · Computer Science 2024-08-15 Vipul Gupta , Pranav Narayanan Venkit , Shomir Wilson , Rebecca J. Passonneau

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

Machine Learning · Computer Science 2024-04-04 Anna Kruspe

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

Pretrained language models (PLMs), such as GPT2, have achieved remarkable empirical performance in text generation tasks. However, pretrained on large-scale natural language corpora, the generated text from PLMs may exhibit social bias…

Computation and Language · Computer Science 2023-02-28 Rui Wang , Pengyu Cheng , Ricardo Henao

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

Researchers have devised numerous ways to quantify social biases vested in pretrained language models. As some language models are capable of generating coherent completions given a set of textual prompts, several prompting datasets have…

Computation and Language · Computer Science 2022-05-25 Afra Feyza Akyürek , Muhammed Yusuf Kocyigit , Sejin Paik , Derry Wijaya

Warning: This research studies AI persuasion and bias amplification that could be misused; all experiments are for safety evaluation. Large Language Models (LLMs) now generate convincing, human-like text and are widely used in content…

Computation and Language · Computer Science 2025-08-25 Saumya Roy

Large Language Models (LLMs) are trained primarily on minimally processed web text, which exhibits the same wide range of social biases held by the humans who created that content. Consequently, text generated by LLMs can inadvertently…

Computation and Language · Computer Science 2023-07-04 Harnoor Dhingra , Preetiha Jayashanker , Sayali Moghe , Emma Strubell

Large Language Models (LLMs) can generate biased and toxic responses. Yet most prior work on LLM gender bias evaluation requires predefined gender-related phrases or gender stereotypes, which are challenging to be comprehensively collected…

Computation and Language · Computer Science 2023-11-02 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

Progress in natural language generation research has been shaped by the ever-growing size of language models. While large language models pre-trained on web data can generate human-sounding text, they also reproduce social biases and…

Computation and Language · Computer Science 2023-06-06 Celine Wald , Lukas Pfahler

Advances in language modeling architectures and the availability of large text corpora have driven progress in automatic text generation. While this results in models capable of generating coherent texts, it also prompts models to…

Computation and Language · Computer Science 2020-10-09 Po-Sen Huang , Huan Zhang , Ray Jiang , Robert Stanforth , Johannes Welbl , Jack Rae , Vishal Maini , Dani Yogatama , Pushmeet Kohli