中文
相关论文

相关论文: Counterfactual Fairness Evaluation of LLM-Based Co…

200 篇论文

Recent advances in large vision-language models (LVLMs) have amplified concerns about fairness, yet existing evaluations remain confined to demographic attributes and often conflate fairness with refusal behavior. This paper broadens the…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Zaiying Zhao , Toshihiko Yamasaki

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

计算与语言 · 计算机科学 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

The rapid development of Large Language Models (LLMs) creates new opportunities for recommender systems, especially by exploiting the side information (e.g., descriptions and analyses of items) generated by these models. However, aligning…

信息检索 · 计算机科学 2025-04-14 Guixian Zhang , Guan Yuan , Debo Cheng , Lin Liu , Jiuyong Li , Shichao Zhang

Large Language Models (LLMs) have demonstrated remarkable success across various domains but often lack fairness considerations, potentially leading to discriminatory outcomes against marginalized populations. Unlike fairness in traditional…

计算与语言 · 计算机科学 2024-08-09 Thang Doan Viet , Zichong Wang , Minh Nhat Nguyen , Wenbin Zhang

Causal discovery (CD) plays a pivotal role in numerous scientific fields by clarifying the causal relationships that underlie phenomena observed in diverse disciplines. Despite significant advancements in CD algorithms that enhance bias and…

机器学习 · 计算机科学 2025-03-25 Khadija Zanna , Akane Sano

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

计算与语言 · 计算机科学 2025-05-26 Alireza Arbabi , Florian Kerschbaum

Large Language Models (LLMs) are increasingly deployed in various applications, raising critical concerns about fairness and potential biases in their outputs. This paper explores the prioritization of metamorphic relations (MRs) in…

计算与语言 · 计算机科学 2025-05-14 Suavis Giramata , Madhusudan Srinivasan , Venkat Naidu Gudivada , Upulee Kanewala

Multi-agent systems based on large language models (LLMs) for financial trading have grown rapidly since 2023, yet the field lacks a shared framework for understanding what drives performance or for evaluating claims credibly. This survey…

多智能体系统 · 计算机科学 2026-03-31 Phat Nguyen , Thang Pham

Recently, Large Language Models (LLMs) have demonstrated a superior ability to serve as ranking models. However, concerns have arisen as LLMs will exhibit discriminatory ranking behaviors based on users' sensitive attributes (\eg gender).…

信息检索 · 计算机科学 2024-09-26 Chen Xu , Wenjie Wang , Yuxin Li , Liang Pang , Jun Xu , Tat-Seng Chua

The presence of social biases in Natural Language Processing (NLP) and Information Retrieval (IR) systems is an ongoing challenge, which underlines the importance of developing robust approaches to identifying and evaluating such biases. In…

信息检索 · 计算机科学 2025-06-30 Maryam Mousavian , Zahra Abbasiantaeb , Mohammad Aliannejadi , Fabio Crestani

Existing fairness benchmarks for large language models (LLMs) primarily focus on simple tasks, such as multiple-choice questions, overlooking biases that may arise in more complex scenarios like long-text generation. To address this gap, we…

计算与语言 · 计算机科学 2025-08-08 Wonje Jeung , Dongjae Jeon , Ashkan Yousefpour , Jonghyun Choi

As libraries explore large language models (LLMs) as a scalable layer for reference services, a core fairness question follows: can LLM-based services support all patrons fairly, regardless of demographic identity? While LLMs offer great…

数字图书馆 · 计算机科学 2026-02-24 Haining Wang , Jason Clark , Angelica Peña

Large language models (LLMs) have shown remarkable capabilities in various natural language processing tasks, yet they often struggle with maintaining factual accuracy, particularly in knowledge-intensive domains like healthcare. This study…

计算与语言 · 计算机科学 2024-11-01 Hieu Tran , Junda Wang , Yujan Ting , Weijing Huang , Terrence Chen

Humor holds up a mirror to social perception: what we find funny often reflects who we are and how we judge others. When language models engage with humor, their reactions expose the social assumptions they have internalized from training…

计算与语言 · 计算机科学 2026-04-22 Shubin Kim , Yejin Son , Junyeong Park , Keummin Ka , Seungbeen Lee , Jaeyoung Lee , Hyeju Jang , Alice Oh , Youngjae Yu

Large Language Models (LLMs) can generate factually inaccurate content even if they have corresponding knowledge, which critically undermines their reliability. Existing approaches attempt to mitigate this by incorporating uncertainty in QA…

计算与语言 · 计算机科学 2026-04-14 Xiaoning Dong , Chengyan Wu , Yajie Wen , Yu Chen , Yun Xue , Jing Zhang , Wei Xu , Bolei Ma

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

计算与语言 · 计算机科学 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

人工智能 · 计算机科学 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

人工智能 · 计算机科学 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

In reinforcement learning with human feedback (RLHF), reward models can efficiently learn and amplify latent biases within multimodal datasets, which can lead to imperfect policy optimization through flawed reward signals and decreased…

机器学习 · 计算机科学 2025-08-28 Sheryl Mathew , N Harshit

Self-evolving large language model (LLM) agents continually improve by accumulating and reusing past experience, yet it remains unclear whether they faithfully rely on that experience to guide their behavior. We present the first systematic…

计算与语言 · 计算机科学 2026-02-10 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yang Deng , Yanyan Zhao , Wanxiang Che , Bing Qin , Ting Liu