English
Related papers

Related papers: Audits as Evidence: Experiments, Ensembles, and En…

200 papers

We examine whether large language models (LLMs) exhibit race- and gender-based name discrimination in hiring decisions, similar to classic findings in the social sciences (Bertrand and Mullainathan, 2004). We design a series of templatic…

Computation and Language · Computer Science 2024-06-18 Haozhe An , Christabel Acquaye , Colin Wang , Zongxia Li , Rachel Rudinger

The use of machine learning systems in processing job applications has made the process agile and efficient, but at the same time it has created problems in terms of equality, reliability and transparency. In this paper we explain some of…

Computers and Society · Computer Science 2020-08-04 Andrés Páez , Natalia Ramírez-Bustamante

Gender discrimination in the hiring process is one significant factor contributing to labor market disparities. However, there is little evidence on the extent to which gender bias by hiring managers is responsible for these disparities. In…

General Economics · Economics 2023-08-24 Anuar Assamidanov

Social scientists have increasingly turned to audit experiments to investigate discrimination in the market for jobs, loans, housing and other opportunities. In a typical audit experiment, researchers assign ``signals'' (the treatment) to…

Methodology · Statistics 2025-03-14 Nicole Pashley , Brian Libgober , Tirthankar Dasgupta

Large language models (LLMs) are increasingly being deployed in high-stakes applications like hiring, yet their potential for unfair decision-making remains understudied in generative and retrieval settings. In this work, we examine the…

Computation and Language · Computer Science 2025-09-05 Preethi Seshadri , Hongyu Chen , Sameer Singh , Seraphina Goldfarb-Tarrant

Inferring racial discrimination in police use of force -- the average causal effect of civilian race on use of force -- requires two assumptions about policing prior to potential use of force: that officers do not discriminate in whom they…

Methodology · Statistics 2026-05-25 Thomas Leavitt , Jake Bowers , Luke Miratrix

Hundreds of millions of people now interact with language models, with uses ranging from serving as a writing aid to informing hiring decisions. Yet these language models are known to perpetuate systematic racial prejudices, making their…

Computation and Language · Computer Science 2024-03-04 Valentin Hofmann , Pratyusha Ria Kalluri , Dan Jurafsky , Sharese King

We discuss some causal estimands used to study racial discrimination in policing. A central challenge is that not all police-civilian encounters are recorded in administrative datasets and available to researchers. One possible solution is…

Applications · Statistics 2021-06-16 Qingyuan Zhao , Luke J Keele , Dylan S Small , Marshall M Joffe

This paper examines the impact of racial discrimination in hiring on employment, wages, and wealth disparities between black and white workers. Using a labor search-and-matching model with racially prejudiced and non-prejudiced firms, we…

General Economics · Economics 2026-04-24 Guanyi Yang , Srinivasan Murali

Over the past two decades, the notion of implicit bias has come to serve as an important component in our understanding of discrimination in activities such as hiring, promotion, and school admissions. Research on implicit bias posits that…

Computers and Society · Computer Science 2018-01-12 Jon Kleinberg , Manish Raghavan

Large language models offer significant potential for increasing labour productivity, such as streamlining personnel selection, but raise concerns about perpetuating systemic biases embedded into their pre-training data. This study explores…

General Economics · Economics 2024-02-13 Louis Lippens

Algorithmic tools are increasingly used in hiring to improve fairness and diversity, often by enforcing constraints such as gender-balanced candidate shortlists. However, we show theoretically and empirically that enforcing equal…

Machine Learning · Computer Science 2025-05-21 Prasanna Parasurama , Panos Ipeirotis

Humans increasingly delegate decisions to language models, yet whether these systems reproduce or reshape human patterns of discrimination remains unclear. Here we run a large-scale study to analyse whether language models use demographic…

Computers and Society · Computer Science 2026-05-15 Ze Wang , Guobin Shen , Michael Thaler

The Implicit Association Test, IAT, is widely used to measure hidden (subconscious) human biases, implicit bias, of many topics: race, gender, age, ethnicity, religion stereotypes. There is a need to understand the reliability of these…

Applications · Statistics 2023-12-27 S. Stanley Young , Warren B. Kindzierski

When plaintiffs prevail in a discrimination case, a major component of the calculation of economic loss is the length of time they would have been in the higher position had they been treated fairly during the period in which the employer…

Applications · Statistics 2013-12-02 Qing Pan , Joseph L. Gastwirth

Using a comprehensive matched employer-employee dataset for U.S. financial advisers from 2008 to 2018, we revisit established evidence on labor market penalties following financial misconduct. Prior studies report that female advisers are…

General Economics · Economics 2025-03-18 Jun Honda

The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit…

Machine Learning · Statistics 2020-06-17 Nathan Kallus , Xiaojie Mao , Angela Zhou

AI audits play a critical role in AI accountability and safety. One branch of the law for which AI audits are particularly salient is anti-discrimination law. Several areas of anti-discrimination law implicate the "less discriminatory…

Computers and Society · Computer Science 2025-09-09 Sarah H. Cen , Salil Goyal , Zaynah Javed , Ananya Karthik , Percy Liang , Daniel E. Ho

This work investigates the potential of undermining both fairness and detection performance in abusive language detection. In a dynamic and complex digital world, it is crucial to investigate the vulnerabilities of these detection models to…

Computation and Language · Computer Science 2023-12-07 Yueqing Liang , Lu Cheng , Ali Payani , Kai Shu

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko