English
Related papers

Related papers: Who Gets Which Message? Auditing Demographic Bias …

200 papers

Social biases can manifest in language agency. However, very limited research has investigated such biases in Large Language Model (LLM)-generated content. In addition, previous works often rely on string-matching techniques to identify…

Computation and Language · Computer Science 2025-06-03 Yixin Wan , Kai-Wei Chang

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

LLMs are increasingly powerful and widely used to assist users in a variety of tasks. This use risks the introduction of LLM biases to consequential decisions such as job hiring, human performance evaluation, and criminal sentencing. Bias…

Computation and Language · Computer Science 2024-06-21 Mahammed Kamruzzaman , Md. Minul Islam Shovon , Gene Louis Kim

Large Language Models (LLMs) are increasingly integrated into critical decision-making processes, such as loan approvals and visa applications, where inherent biases can lead to discriminatory outcomes. In this paper, we examine the nuanced…

Computation and Language · Computer Science 2024-05-30 Mina Arzaghi , Florian Carichon , Golnoosh Farnadi

Existing challenges in misinformation exposure and susceptibility vary across demographic groups, as some populations are more vulnerable to misinformation than others. Large language models (LLMs) introduce new dimensions to these…

Computation and Language · Computer Science 2025-10-15 Angana Borah , Rada Mihalcea , Verónica Pérez-Rosas

Large Language Models (LLMs) often exhibit gender bias, resulting in unequal treatment of male and female subjects across different contexts. To address this issue, we propose a novel data generation framework that fosters exploratory…

Computation and Language · Computer Science 2026-01-15 Kangda Wei , Hasnat Md Abdullah , Ruihong Huang

Large Language Models (LLMs) excel in text generation and understanding, especially in simulating socio-political and economic patterns, serving as an alternative to traditional surveys. However, their global applicability remains…

Computers and Society · Computer Science 2025-01-28 Andrés Abeliuk , Vanessa Gaete , Naim Bro

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

This paper presents research on enhancements to Large Language Models (LLMs) through the addition of diversity in its generated outputs. Our study introduces a configuration of multiple LLMs which demonstrates the diversities capable with a…

Computation and Language · Computer Science 2025-08-05 Purva Prasad Gosavi , Vaishnavi Murlidhar Kulkarni , Alan F. Smeaton

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

Computation and Language · Computer Science 2025-12-01 Fatima Kazi

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

Computation and Language · Computer Science 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

Computation and Language · Computer Science 2024-06-18 Filip Trhlik , Pontus Stenetorp

For subjective tasks such as hate detection, where people perceive hate differently, the Large Language Model's (LLM) ability to represent diverse groups is unclear. By including additional context in prompts, we comprehensively analyze…

Computation and Language · Computer Science 2024-10-04 Sarah Masud , Sahajpreet Singh , Viktor Hangya , Alexander Fraser , Tanmoy Chakraborty

Automatic evaluation metrics are crucial to the development of generative systems. In recent years, pre-trained language model (PLM) based metrics, such as BERTScore, have been commonly adopted in various generation tasks. However, it has…

Computation and Language · Computer Science 2022-10-17 Tianxiang Sun , Junliang He , Xipeng Qiu , Xuanjing Huang

Large Language Models (LLMs) are trained primarily on minimally processed web text, which exhibits the same wide range of social biases held by the humans who created that content. Consequently, text generated by LLMs can inadvertently…

Computation and Language · Computer Science 2023-07-04 Harnoor Dhingra , Preetiha Jayashanker , Sayali Moghe , Emma Strubell

Large Language Models (LLMs) are increasingly being used to generate text across various languages, for tasks such as translation, customer support, and education. Despite these advancements, LLMs show notable gender biases in English,…

Computation and Language · Computer Science 2024-09-23 Ishika Joshi , Ishita Gupta , Adrita Dey , Tapan Parikh