中文
相关论文

相关论文: Robustly Improving LLM Fairness in Realistic Setti…

200 篇论文

Recent studies highlight the effectiveness of using in-context learning (ICL) to steer large language models (LLMs) in processing tabular data, a challenging task given the structured nature of such data. Despite advancements in…

机器学习 · 计算机科学 2024-08-20 Jingyu Hu , Weiru Liu , Mengnan Du

An essential aspect of evaluating Large Language Models (LLMs) is identifying potential biases. This is especially relevant considering the substantial evidence that LLMs can replicate human social biases in their text outputs and further…

人机交互 · 计算机科学 2024-05-21 Paula Akemi Aoyagui , Sharon Ferguson , Anastasia Kuzminykh

Recent studies demonstrated that large language models (LLMs) can excel in many tasks via in-context learning (ICL). However, recent works show that ICL-prompted models tend to produce inaccurate results when presented with adversarial…

计算与语言 · 计算机科学 2024-05-21 Xuanli He , Yuxiang Wu , Oana-Maria Camburu , Pasquale Minervini , Pontus Stenetorp

Biases in large language models (LLMs) often manifest as systematic distortions in associations between demographic attributes and professional or social roles, reinforcing harmful stereotypes across gender, ethnicity, and geography. This…

计算与语言 · 计算机科学 2026-03-10 Ravi Ranjan , Utkarsh Grover , Agorista Polyzou

Large language models (LLMs) increasingly operate in high-stakes settings including healthcare and medicine, where demographic attributes such as race and ethnicity may be explicitly stated or implicitly inferred from text. However,…

计算与语言 · 计算机科学 2026-01-21 Shiyue Hu , Ruizhe Li , Yanjun Gao

Large Language Models (LLMs) are finding applications in all aspects of life, but their susceptibility to biases, particularly gender stereotyping, raises ethical concerns. This study introduces a novel methodology, a persona-based…

计算机与社会 · 计算机科学 2025-02-18 Rajesh Ranjan , Shailja Gupta , Surya Naranyan Singh

Large Language Models (LLMs) can generate biased and toxic responses. Yet most prior work on LLM gender bias evaluation requires predefined gender-related phrases or gender stereotypes, which are challenging to be comprehensively collected…

计算与语言 · 计算机科学 2023-11-02 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

Large language models (LLMs) have rapidly become indispensable tools for acquiring information and supporting human decision-making. However, ensuring that these models uphold fairness across varied contexts is critical to their safe and…

计算机与社会 · 计算机科学 2026-03-05 Xulang Zhang , Rui Mao , Erik Cambria

This study investigates whether large language models (LLMs) exhibit consistent behavior (signal) or random variation (noise) when screening resumes against job descriptions, and how their performance compares to human experts. Using…

计算与语言 · 计算机科学 2025-07-14 Aryan Varshney , Venkat Ram Reddy Ganuthula

Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making contexts. While prior work has shown that LLMs exhibit cognitive biases behaviorally, whether these biases correspond to identifiable internal…

人工智能 · 计算机科学 2026-04-03 Fan Huang , Songheng Zhang , Haewoon Kwak , Jisun An

As Large Language Models (LLMs) become increasingly powerful and accessible to human users, ensuring fairness across diverse demographic groups, i.e., group fairness, is a critical ethical concern. However, current fairness and bias…

计算与语言 · 计算机科学 2025-03-12 Kefan Song , Jin Yao , Runnan Jiang , Rohan Chandra , Shangtong Zhang

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

计算与语言 · 计算机科学 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

The integration of Large Language Models (LLMs) in information retrieval has raised a critical reevaluation of fairness in the text-ranking models. LLMs, such as GPT models and Llama2, have shown effectiveness in natural language…

信息检索 · 计算机科学 2024-06-27 Yuan Wang , Xuyang Wu , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

The development of LLMs has greatly enhanced the intelligence and fluency of question answering, while the emergence of retrieval enhancement has enabled models to better utilize external information. However, the presence of noise and…

计算与语言 · 计算机科学 2024-09-19 Xingyun Hong , Yan Shao , Zhilin Wang , Manni Duan , Jin Xiongnan

Large language models (LLMs) are increasingly embedded in healthcare workflows for documentation, education, and clinical decision support. However, these systems are trained on large text corpora that encode existing biases, including sex…

计算与语言 · 计算机科学 2026-02-05 Isabel Tsintsiper , Sheng Wong , Beth Albert , Shaun P Brennecke , Gabriel Davis Jones

This study evaluates the biases in Gemini 2.0 Flash Experimental, a state-of-the-art large language model (LLM) developed by Google, focusing on content moderation and gender disparities. By comparing its performance to ChatGPT-4o, examined…

计算与语言 · 计算机科学 2025-03-24 Roberto Balestri

Pre-trained large language models (LLMs) have been reliably integrated with visual input for multimodal tasks. The widespread adoption of instruction-tuned image-to-text vision-language assistants (VLAs) like LLaVA and InternVL necessitates…

计算机与社会 · 计算机科学 2025-03-14 Leander Girrbach , Stephan Alaniz , Yiran Huang , Trevor Darrell , Zeynep Akata

Large language models (LLMs) increasingly influence global digital ecosystems, yet their potential to perpetuate social and cultural biases remains poorly understood in underrepresented contexts. This study presents a systematic analysis of…

计算与语言 · 计算机科学 2026-03-10 Ashish Pandey , Tek Raj Chhetri

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

计算与语言 · 计算机科学 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

As more industries integrate machine learning into socially sensitive decision processes like hiring, loan-approval, and parole-granting, we are at risk of perpetuating historical and contemporary socioeconomic disparities. This is a…

计算机与社会 · 计算机科学 2017-10-20 Niels Bantilan