中文
相关论文

相关论文: Evaluating Nuanced Bias in Large Language Model Fr…

200 篇论文

Large Language Models (LLMs) annotated datasets are widely used nowadays, however, large-scale annotations often show biases in low-quality datasets. For example, Multiple-Choice Questions (MCQs) datasets with one single correct option is…

Tabular machine learning problems often require time-consuming and labor-intensive feature engineering. Recent efforts have focused on using large language models (LLMs) to capitalize on their potential domain knowledge. At the same time,…

机器学习 · 计算机科学 2025-07-16 Jaris Küken , Lennart Purucker , Frank Hutter

As large language models (LLMs) become integral to recruitment processes, concerns about AI-induced bias have intensified. This study examines biases in candidate interview reports generated by Claude 3.5 Sonnet, GPT-4o, Gemini 1.5, and…

人工智能 · 计算机科学 2024-10-23 Django Beatty , Kritsada Masanthia , Teepakorn Kaphol , Niphan Sethi

This study examines how Large Language Models (LLMs) can reduce biases in text-to-image generation systems by modifying user prompts. We define bias as a model's unfair deviation from population statistics given neutral prompts. Our…

计算与语言 · 计算机科学 2025-04-16 René Peinl

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

计算与语言 · 计算机科学 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Large language models (LLMs) have revolutionised many fields, with LLM-as-a-service (LLMSaaS) offering accessible, general-purpose solutions without costly task-specific training. In contrast to the widely studied prompt engineering for…

计算与语言 · 计算机科学 2026-03-17 Md Rakibul Hasan , Yue Yao , Md Zakir Hossain , Aneesh Krishna , Imre Rudas , Shafin Rahman , Tom Gedeon

Auditing Large Language Models (LLMs) to discover their biases and preferences is an emerging challenge in creating Responsible Artificial Intelligence (AI). While various methods have been proposed to elicit the preferences of such models,…

计算与语言 · 计算机科学 2024-11-12 Leif Azzopardi , Yashar Moshfeghi

Large language models are rapidly transforming social science research by enabling the automation of labor-intensive tasks like data annotation and text analysis. However, LLM outputs vary significantly depending on the implementation…

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

As large language models (LLMs) are increasingly deployed across diverse linguistic and cultural contexts, understanding their behavior in both factual and disputable scenarios is essential, especially when their outputs may shape public…

计算与语言 · 计算机科学 2025-06-30 Sean Kim , Hyuhng Joon Kim

Investigating bias in large language models (LLMs) is crucial for developing trustworthy AI. While prompt-based through prompt engineering is common, its effectiveness relies on the assumption that models inherently understand biases. Our…

计算与语言 · 计算机科学 2025-03-13 Xinyi Yang , Runzhe Zhan , Derek F. Wong , Shu Yang , Junchao Wu , Lidia S. Chao

Large Language Models (LLMs) have transformed text generation through inherently probabilistic context-aware mechanisms, mimicking human natural language. In this paper, we systematically investigate the performance of various LLMs when…

计算与语言 · 计算机科学 2025-02-28 Javier Coronado-Blázquez

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

机器学习 · 计算机科学 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Business processes are fundamental to organizational operations, yet their optimization remains challenging due to the timeconsuming nature of manual process analysis. Our paper harnesses Large Language Models (LLMs) to automate value-added…

计算与语言 · 计算机科学 2025-04-10 William De Michele , Abel Armas Cervantes , Lea Frermann

As the rapidly advancing domain of natural language processing (NLP), large language models (LLMs) have emerged as powerful tools for interpreting human commands and generating text across various tasks. Nonetheless, the resilience of LLMs…

计算与语言 · 计算机科学 2024-10-04 Bin Wang , Chengwei Wei , Zhengyuan Liu , Geyu Lin , Nancy F. Chen

Large Language Models are increasingly employed in generating consumer product recommendations, yet their potential for embedding and amplifying gender and race biases remains underexplored. This paper serves as one of the first attempts to…

计算与语言 · 计算机科学 2026-02-10 Ke Xu , Shera Potka , Alex Thomo

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

计算与语言 · 计算机科学 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

Effective personalized feedback is critical to students' literacy development. Though LLM-powered tools now promise to automate such feedback at scale, LLMs are not language-neutral: they privilege standard academic English and reproduce…

计算与语言 · 计算机科学 2026-03-16 Mei Tan , Lena Phalen , Dorottya Demszky

The deployment of Large Language Models (LLMs) in diverse applications necessitates an assurance of safety without compromising the contextual integrity of the generated content. Traditional approaches, including safety-specific fine-tuning…

计算与语言 · 计算机科学 2024-07-01 Shaina Raza , Ananya Raval , Veronica Chatrath

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

计算与语言 · 计算机科学 2025-06-17 Yan Sun , Stanley Kok