English
Related papers

Related papers: Small Changes, Large Consequences: Analyzing the A…

200 papers

Generative artificial intelligence (AI), particularly large language models (LLMs), is being rapidly deployed in recruitment and for candidate shortlisting. We audit several mid-sized open-source LLMs for gender bias using a dataset of…

General Economics · Economics 2025-05-01 Sugat Chaturvedi , Rochana Chaturvedi

Large language models (LLMs) have emerged as a useful technology for job matching, for both candidates and employers. Job matching is often based on a particular geographic location, such as a city or region. However, LLMs have known…

Computation and Language · Computer Science 2024-03-14 Charlie Campanella , Rob van der Goot

LLMs are increasingly used to boost productivity and support software engineering tasks. However, when applied to socially sensitive decisions such as team composition and task allocation, they raise concerns of fairness. Prior studies have…

The integration of Large Language Models (LLMs) in information retrieval has raised a critical reevaluation of fairness in the text-ranking models. LLMs, such as GPT models and Llama2, have shown effectiveness in natural language…

Information Retrieval · Computer Science 2024-06-27 Yuan Wang , Xuyang Wu , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

This study examines the behavior of Large Language Models (LLMs) when evaluating professional candidates based on their resumes or curricula vitae (CVs). In an experiment involving 22 leading LLMs, each model was systematically given one…

Computation and Language · Computer Science 2025-05-28 David Rozado

Large Language Models (LLMs) have seen widespread deployment in various real-world applications. Understanding these biases is crucial to comprehend the potential downstream consequences when using LLMs to make decisions, particularly for…

Computation and Language · Computer Science 2024-01-10 Abel Salinas , Parth Vipul Shah , Yuzhong Huang , Robert McCormack , Fred Morstatter

This study investigates whether large language models (LLMs) exhibit consistent behavior (signal) or random variation (noise) when screening resumes against job descriptions, and how their performance compares to human experts. Using…

Computation and Language · Computer Science 2025-07-14 Aryan Varshney , Venkat Ram Reddy Ganuthula

Large Language Models (LLMs) have revolutionized natural language processing, yet concerns persist regarding their tendency to reflect or amplify social biases. This study introduces a novel evaluation framework to uncover gender biases in…

Computation and Language · Computer Science 2026-03-10 Evan Chen , Run-Jun Zhan , Yan-Bai Lin , Hung-Hsuan Chen

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

Applications · Statistics 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe

Large Language Models (LLMs) excel in text generation and understanding, especially in simulating socio-political and economic patterns, serving as an alternative to traditional surveys. However, their global applicability remains…

Computers and Society · Computer Science 2025-01-28 Andrés Abeliuk , Vanessa Gaete , Naim Bro

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

Machine Learning · Computer Science 2025-06-13 Adam Karvonen , Samuel Marks

With the impressive performance in various downstream tasks, large language models (LLMs) have been widely integrated into production pipelines, like recruitment and recommendation systems. A known issue of models trained on natural…

Computation and Language · Computer Science 2025-01-22 Damin Zhang , Yi Zhang , Geetanjali Bihani , Julia Rayz

The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When…

Information Retrieval · Computer Science 2025-11-04 Amirabbas Afzali , Amirreza Velae , Iman Ahmadi , Mohammad Aliannejadi

The rise of generative artificial intelligence, particularly Large Language Models (LLMs), has intensified the imperative to scrutinize fairness alongside accuracy. Recent studies have begun to investigate fairness evaluations for LLMs…

Information Retrieval · Computer Science 2024-08-31 Chandan Kumar Sah , Lian Xiaoli , Muhammad Mirajul Islam

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

Artificial Intelligence · Computer Science 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

In an era where AI-driven hiring is transforming recruitment practices, concerns about fairness and bias have become increasingly important. To explore these issues, we introduce a benchmark, FAIRE (Fairness Assessment In Resume…

Computation and Language · Computer Science 2025-04-03 Athena Wen , Tanush Patil , Ansh Saxena , Yicheng Fu , Sean O'Brien , Kevin Zhu

Large language models (LLMs) increasingly operate in high-stakes settings including healthcare and medicine, where demographic attributes such as race and ethnicity may be explicitly stated or implicitly inferred from text. However,…

Computation and Language · Computer Science 2026-01-21 Shiyue Hu , Ruizhe Li , Yanjun Gao

Human judgments are inherently subjective and are actively affected by personal traits such as gender and ethnicity. While Large Language Models (LLMs) are widely used to simulate human responses across diverse contexts, their ability to…

Computation and Language · Computer Science 2025-02-18 Huaman Sun , Jiaxin Pei , Minje Choi , David Jurgens

Large Language Models (LLMs) are being increasingly explored as general-purpose tools for recommendation tasks, enabling zero-shot and instruction-following capabilities without the need for task-specific training. While the research…

Information Retrieval · Computer Science 2025-08-05 Ethan Bito , Yongli Ren , Estrid He