中文
相关论文

相关论文: Measuring Stereotype and Deviation Biases in Large…

200 篇论文

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

计算与语言 · 计算机科学 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

计算机与社会 · 计算机科学 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

Large Language Models' (LLMs) ability to converse naturally is empowered by their ability to empathetically understand and respond to their users. However, emotional experiences are shaped by demographic and cultural contexts. This raises…

计算与语言 · 计算机科学 2025-10-28 Ananya Malik , Nazanin Sabri , Melissa Karnaze , Mai Elsherief

Large Language Models (LLMs) have become foundational in modern language-driven software applications, profoundly influencing daily life. A critical technique in leveraging their potential is role-playing, where LLMs simulate diverse roles…

计算机与社会 · 计算机科学 2026-04-23 Xinyue Li , Zhenpeng Chen , Jie M. Zhang , Ying Xiao , Tianlin Li , Weisong Sun , Yang Liu , Yiling Lou , Xuanzhe Liu

Language Models have ushered a new age of AI gaining traction within the NLP community as well as amongst the general population. AI's ability to make predictions, generations and its applications in sensitive decision-making scenarios,…

计算与语言 · 计算机科学 2023-11-28 Ananya Malik

Large vision-language models (LVLMs) have been rapidly developed and widely used in various fields, but the (potential) stereotypical bias in the model is largely unexplored. In this study, we present a pioneering measurement framework,…

密码学与安全 · 计算机科学 2024-10-10 Yukun Jiang , Zheng Li , Xinyue Shen , Yugeng Liu , Michael Backes , Yang Zhang

Large Language Models (LLMs) are finding applications in all aspects of life, but their susceptibility to biases, particularly gender stereotyping, raises ethical concerns. This study introduces a novel methodology, a persona-based…

计算机与社会 · 计算机科学 2025-02-18 Rajesh Ranjan , Shailja Gupta , Surya Naranyan Singh

Large language models (LLMs) reflect societal norms and biases, especially about gender. While societal biases and stereotypes have been extensively researched in various NLP applications, there is a surprising gap for emotion analysis.…

计算与语言 · 计算机科学 2024-05-29 Flor Miriam Plaza-del-Arco , Amanda Cercas Curry , Alba Curry , Gavin Abercrombie , Dirk Hovy

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

计算与语言 · 计算机科学 2025-05-26 Alireza Arbabi , Florian Kerschbaum

Background: Large language models (LLMs) are rapidly being integrated into healthcare, promising to enhance various clinical tasks. However, concerns exist regarding their potential for bias, which could compromise patient care and…

Stereotype detection is a challenging and subjective task, as certain statements, such as "Black people like to play basketball," may not appear overtly toxic but still reinforce racial stereotypes. With the increasing prevalence of large…

计算与语言 · 计算机科学 2024-11-19 Zekun Wu , Sahan Bulathwela , Maria Perez-Ortiz , Adriano Soares Koshiyama

With the wide and cross-domain adoption of Large Language Models, it becomes crucial to assess to which extent the statistical correlations in training data, which underlie their impressive performance, hide subtle and potentially troubling…

人工智能 · 计算机科学 2025-12-12 Massimiliano Luca , Ciro Beneduce , Bruno Lepri , Jacopo Staiano

Large language models (LLMs) often reflect real-world biases, leading to efforts to mitigate these effects and make the models unbiased. Achieving this goal requires defining clear criteria for an unbiased state, with any deviation from…

计算与语言 · 计算机科学 2024-11-27 Changgeon Ko , Jisu Shin , Hoyun Song , Jeongyeon Seo , Jong C. Park

Psychological assessment tools have long helped humans understand behavioural patterns. While Large Language Models (LLMs) can generate content comparable to that of humans, we explore whether they exhibit personality traits. To this end,…

计算与语言 · 计算机科学 2025-02-11 Pranav Bhandari , Usman Naseem , Amitava Datta , Nicolas Fay , Mehwish Nasim

Large Language Models (LLMs) are increasingly deployed in socially sensitive settings, raising concerns about fairness and biases, particularly across intersectional demographic attributes. In this paper, we systematically evaluate…

计算与语言 · 计算机科学 2026-04-24 Chaima Boufaied , Ronnie De Souza Santos , Ann Barcomb

With the increasing adoption of large language models (LLMs) in education, concerns about inherent biases in these models have gained prominence. We evaluate LLMs for bias in the personalized educational setting, specifically focusing on…

计算与语言 · 计算机科学 2025-02-11 Iain Weissburg , Sathvika Anand , Sharon Levy , Haewon Jeong

Generative large language models (LLMs) have been shown to exhibit harmful biases and stereotypes. While safety fine-tuning typically takes place in English, if at all, these models are being used by speakers of many different languages.…

计算与语言 · 计算机科学 2024-07-18 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Recent advancements in Large Language Models (LLMs) have positioned them as powerful tools for clinical decision-making, with rapidly expanding applications in healthcare. However, concerns about bias remain a significant challenge in the…

人工智能 · 计算机科学 2024-10-23 Kenza Benkirane , Jackie Kay , Maria Perez-Ortiz

Recent advancements in large language models (LLMs) have established them as powerful tools across numerous domains. However, persistent concerns about embedded biases, such as gender, racial, and cultural biases arising from their training…

计算与语言 · 计算机科学 2025-07-30 Hadi Mohammadi , Yasmeen F. S. S. Meijer , Efthymia Papadopoulou , Ayoub Bagheri

Large Language Models (LLMs), now used daily by millions, can encode societal biases, exposing their users to representational harms. A large body of scholarship on LLM bias exists but it predominantly adopts a Western-centric frame and…

计算与语言 · 计算机科学 2024-08-12 Khyati Khandelwal , Manuel Tonneau , Andrew M. Bean , Hannah Rose Kirk , Scott A. Hale