中文
相关论文

相关论文: Improving Fairness in LLMs Through Testing-Time Ad…

200 篇论文

As AI systems become more integrated into daily life, the need for safer and more reliable moderation has never been greater. Large Language Models (LLMs) have demonstrated remarkable capabilities, surpassing earlier models in complexity…

人工智能 · 计算机科学 2026-01-13 Naseem Machlovi , Maryam Saleki , Innocent Ababio , Ruhul Amin

Large Language Models (LLMs) are increasingly deployed in various applications, raising critical concerns about fairness and potential biases in their outputs. This paper explores the prioritization of metamorphic relations (MRs) in…

计算与语言 · 计算机科学 2025-05-14 Suavis Giramata , Madhusudan Srinivasan , Venkat Naidu Gudivada , Upulee Kanewala

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly…

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

计算与语言 · 计算机科学 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Large Language Models (LLMs) have demonstrated promising capabilities as automatic evaluators in assessing the quality of generated natural language. However, LLMs still exhibit biases in evaluation and often struggle to generate coherent…

计算与语言 · 计算机科学 2025-01-20 Yinhong Liu , Han Zhou , Zhijiang Guo , Ehsan Shareghi , Ivan Vulić , Anna Korhonen , Nigel Collier

The fairness and trustworthiness of Large Language Models (LLMs) are receiving increasing attention. Implicit hate speech, which employs indirect language to convey hateful intentions, occupies a significant portion of practice. However,…

计算与语言 · 计算机科学 2024-07-24 Min Zhang , Jianfeng He , Taoran Ji , Chang-Tien Lu

The progress of AI systems such as large language models (LLMs) raises increasingly pressing concerns about their safe deployment. This paper examines the value alignment problem for LLMs, arguing that current alignment strategies are…

计算与语言 · 计算机科学 2025-06-06 Raphaël Millière

Large Language Model (LLM)-based recommendation systems excel in delivering comprehensive suggestions by deeply analyzing content and user behavior. However, they often inherit biases from skewed training data, favoring mainstream content…

信息检索 · 计算机科学 2026-02-02 Anindya Bijoy Das , Shahnewaz Karim Sakib

This paper investigates the subtle and often concealed biases present in Large Language Models (LLMs), focusing on implicit biases that may remain despite passing explicit bias tests. Implicit biases are significant because they influence…

计算与语言 · 计算机科学 2024-10-01 Serene Lim , María Pérez-Ortiz

Large Language Models (LLMs) are increasingly adopted in educational contexts to provide personalized support to students and teachers. The unprecedented capacity of LLM-based applications to understand and generate natural language can…

计算机与社会 · 计算机科学 2024-07-17 Jinsook Lee , Yann Hicke , Renzhe Yu , Christopher Brooks , René F. Kizilcec

As large language models (LLMs) become more widely deployed, it is crucial to examine their ethical tendencies. Building on research on fairness and discrimination in AI, we investigate whether LLMs exhibit speciesist bias -- discrimination…

计算与语言 · 计算机科学 2025-08-18 Monika Jotautaitė , Lucius Caviola , David A. Brewster , Thilo Hagendorff

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

人工智能 · 计算机科学 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

计算与语言 · 计算机科学 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

Large Language Models (LLMs) are trained on large corpora written by humans and demonstrate high performance on various tasks. However, as humans are susceptible to cognitive biases, which can result in irrational judgments, LLMs can also…

计算与语言 · 计算机科学 2024-12-03 Yasuaki Sumita , Koh Takeuchi , Hisashi Kashima

Recent advancements in large language models (LLMs) have established them as powerful tools across numerous domains. However, persistent concerns about embedded biases, such as gender, racial, and cultural biases arising from their training…

计算与语言 · 计算机科学 2025-07-30 Hadi Mohammadi , Yasmeen F. S. S. Meijer , Efthymia Papadopoulou , Ayoub Bagheri

Recently, computer scientists have developed large language models (LLMs) by training prediction models with large-scale language corpora and human reinforcements. The LLMs have become one promising way to implement artificial intelligence…

计算机与社会 · 计算机科学 2023-08-22 Hyemin Han

Large Language Models (LLMs), though shown to be effective in many applications, can vary significantly in their response quality. In this paper, we investigate this problem of prompt fairness: specifically, the phrasing of a prompt by…

机器学习 · 计算机科学 2025-11-26 Meiyu Zhong , Noel Teku , Ravi Tandon

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

机器学习 · 计算机科学 2025-06-13 Adam Karvonen , Samuel Marks

We explore how large language models (LLMs) can be influenced by prompting them to alter their initial decisions and align them with established ethical frameworks. Our study is based on two experiments designed to assess the susceptibility…

计算与语言 · 计算机科学 2024-11-19 Allison Huang , Yulu Niki Pi , Carlos Mougan

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

应用统计 · 统计学 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe