English
Related papers

Related papers: Systematic Offensive Stereotyping (SOS) Bias in La…

200 papers

Large language models (LLMs) have become integral tool for users from various backgrounds. LLMs, trained on vast corpora, reflect the linguistic and cultural nuances embedded in their pre-training data. However, the values and perspectives…

Computation and Language · Computer Science 2025-07-17 Songyuan Liu , Ziyang Zhang , Runze Yan , Wei Wu , Carl Yang , Jiaying Lu

Research on Large Language Models (LLMs) has often neglected subtle biases that, although less apparent, can significantly influence the models' outputs toward particular social narratives. This study addresses two such biases within LLMs:…

Computation and Language · Computer Science 2024-06-04 Abhishek Kumar , Sarfaroz Yunusov , Ali Emami

As large vision language models(LVLMs) rapidly advance, concerns about their potential to learn and generate social biases and stereotypes are increasing. Previous studies on LVLM's stereotypes face two primary limitations: metrics that…

Computation and Language · Computer Science 2025-05-28 Junhyuk Choi , Minju Kim , Yeseon Hong , Bugeun Kim

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Standard benchmarks of bias and fairness in large language models (LLMs) measure the association between the user attributes stated or implied by a prompt and the LLM's short text response, but human-AI interaction increasingly requires…

Computation and Language · Computer Science 2025-06-06 Kristian Lum , Jacy Reese Anthis , Kevin Robinson , Chirag Nagpal , Alexander D'Amour

Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always…

Computation and Language · Computer Science 2020-10-27 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani

While Large Language Models (LLMs) have become ubiquitous in many fields, understanding and mitigating LLM biases is an ongoing issue. This paper provides a novel method for evaluating the demographic biases of various generative AI models.…

Computation and Language · Computer Science 2025-06-16 Jack H Fagan , Ruhaan Juyaal , Amy Yue-Ming Yu , Siya Pun

Large vision-language models (LVLMs) have been rapidly developed and widely used in various fields, but the (potential) stereotypical bias in the model is largely unexplored. In this study, we present a pioneering measurement framework,…

Cryptography and Security · Computer Science 2024-10-10 Yukun Jiang , Zheng Li , Xinyue Shen , Yugeng Liu , Michael Backes , Yang Zhang

Hate speech detection across contemporary social media presents unique challenges due to linguistic diversity and the informal nature of online discourse. These challenges are further amplified in settings involving code-mixing,…

Computation and Language · Computer Science 2025-06-17 Daman Deep Singh , Ramanuj Bhattacharjee , Abhijnan Chakraborty

Hate speech detection has become a hot topic in recent years due to the exponential growth of offensive language in social media. It has proven that, state-of-the-art hate speech classifiers are efficient only when tested on the data with…

Computation and Language · Computer Science 2021-07-06 Hadi Mansourifar , Dana Alsagheer , Weidong Shi , Lan Ni , Yan Huang

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

Computation and Language · Computer Science 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

Computers and Society · Computer Science 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

Stereotypical bias encoded in language models (LMs) poses a threat to safe language technology, yet our understanding of how bias manifests in the parameters of LMs remains incomplete. We introduce local contrastive editing that enables the…

Computation and Language · Computer Science 2025-08-05 Marlene Lutz , Rochelle Choenni , Markus Strohmaier , Anne Lauscher

The automatic detection of hate speech online is an active research area in NLP. Most of the studies to date are based on social media datasets that contribute to the creation of hate speech detection models trained on them. However, data…

Computation and Language · Computer Science 2023-07-06 Dimosthenis Antypas , Jose Camacho-Collados

The proliferation of hate speech on social media platforms has necessitated the development of effective detection and moderation tools. This study evaluates the efficacy of various machine learning models in identifying hate speech and…

Computation and Language · Computer Science 2026-02-25 Saurabh Mishra , Shivani Thakur , Radhika Mamidi

Hate speech frequently appears on social media platforms and urgently needs to be effectively controlled. Alleviating the bias caused by hate speech can help resolve various ethical issues. Although existing research has constructed several…

Computation and Language · Computer Science 2025-08-27 Hongyan Wu , Zhengming Chen , Zijian Li , Nankai Lin , Lianxi Wang , Shengyi Jiang , Aimin Yang

Self-supervised learning (SSL) speech models have achieved remarkable performance in various tasks, yet the biased outcomes, especially affecting marginalized groups, raise significant concerns. Social bias refers to the phenomenon where…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yi-Cheng Lin , Tzu-Quan Lin , Hsi-Che Lin , Andy T. Liu , Hung-yi Lee

Open-generation bias benchmarks evaluate social biases in Large Language Models (LLMs) by analyzing their outputs. However, the classifiers used in analysis often have inherent biases, leading to unfair conclusions. This study examines such…

Computation and Language · Computer Science 2025-01-22 Nathaniel Demchak , Xin Guan , Zekun Wu , Ziyi Xu , Adriano Koshiyama , Emre Kazim

Hate speech detection on online social networks has become one of the emerging hot topics in recent years. With the broad spread and fast propagation speed across online social networks, hate speech makes significant impacts on society by…

Computation and Language · Computer Science 2024-09-26 Guanyi Mou , Pengyi Ye , Kyumin Lee

Hate speech detection is a crucial area of research in natural language processing, essential for ensuring online community safety. However, detecting implicit hate speech, where harmful intent is conveyed in subtle or indirect ways,…

Computation and Language · Computer Science 2025-04-17 Yumin Kim , Hwanhee Lee