English
Related papers

Related papers: Which Demographics do LLMs Default to During Annot…

200 papers

We examine whether large language models (LLMs) exhibit race- and gender-based name discrimination in hiring decisions, similar to classic findings in the social sciences (Bertrand and Mullainathan, 2004). We design a series of templatic…

Computation and Language · Computer Science 2024-06-18 Haozhe An , Christabel Acquaye , Colin Wang , Zongxia Li , Rachel Rudinger

Researchers have traditionally recruited native speakers to provide annotations for widely used benchmark datasets. However, there are languages for which recruiting native speakers can be difficult, and it would help to find learners of…

Computation and Language · Computer Science 2023-05-30 Haneul Yoo , Rifki Afina Putri , Changyoon Lee , Youngin Lee , So-Yeon Ahn , Dongyeop Kang , Alice Oh

A common practice in building NLP datasets, especially using crowd-sourced annotations, involves obtaining multiple annotator judgements on the same data instances, which are then flattened to produce a single "ground truth" label or score,…

Computation and Language · Computer Science 2021-10-13 Vinodkumar Prabhakaran , Aida Mostafazadeh Davani , Mark Díaz

The ongoing revolution in language modeling has led to various novel applications, some of which rely on the emerging social abilities of large language models (LLMs). Already, many turn to the new cyber friends for advice during the…

Computers and Society · Computer Science 2025-08-05 Ivan Zakazov , Mikolaj Boronski , Lorenzo Drudi , Robert West

Recent advances in artificial intelligence, including the development of highly sophisticated large language models (LLM), have proven beneficial in many real-world applications. However, evidence of inherent bias encoded in these LLMs has…

Computation and Language · Computer Science 2023-09-19 Vithya Yogarajan , Gillian Dobbie , Timothy Pistotti , Joshua Bensemann , Kobe Knowles

Large Language Models (LLMs) are increasingly integrated into critical decision-making processes, such as loan approvals and visa applications, where inherent biases can lead to discriminatory outcomes. In this paper, we examine the nuanced…

Computation and Language · Computer Science 2024-05-30 Mina Arzaghi , Florian Carichon , Golnoosh Farnadi

Commercial Large Language Models (LLMs) have recently incorporated memory features to deliver personalised responses. This memory retains details such as user demographics and individual characteristics, allowing LLMs to adjust their…

Computation and Language · Computer Science 2025-05-06 Paloma Piot , Patricia Martín-Rodilla , Javier Parapar

Classifiers tend to propagate biases present in the data on which they are trained. Hence, it is important to understand how the demographic identities of the annotators of comments affect the fairness of the resulting model. In this paper,…

Computation and Language · Computer Science 2021-06-07 Elizabeth Excell , Noura Al Moubayed

Numerous types of social biases have been identified in pre-trained language models (PLMs), and various intrinsic bias evaluation measures have been proposed for quantifying those social biases. Prior works have relied on human annotated…

Computation and Language · Computer Science 2023-01-31 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki

Large Language Models (LLMs) routinely infer users demographic traits from phrasing alone, which can result in biased responses, even when no explicit demographic information is provided. The role of disability cues in shaping these…

Computation and Language · Computer Science 2025-10-23 Vishnu Hari , Kalpana Panda , Srikant Panda , Amit Agarwal , Hitesh Laxmichand Patel

Large Language Models (LLMs) have become essential for offensive language detection, yet their ability to handle annotation disagreement remains underexplored. Disagreement samples, which arise from subjective interpretations, pose a unique…

Computation and Language · Computer Science 2025-05-20 Junyu Lu , Kai Ma , Kaichun Wang , Kelaiti Xiao , Roy Ka-Wei Lee , Bo Xu , Liang Yang , Hongfei Lin

High annotation costs from hiring or crowdsourcing complicate the creation of large, high-quality datasets needed for training reliable text classifiers. Recent research suggests using Large Language Models (LLMs) to automate the annotation…

Computation and Language · Computer Science 2025-01-27 Tomas Horych , Christoph Mandl , Terry Ruas , Andre Greiner-Petter , Bela Gipp , Akiko Aizawa , Timo Spinde

Using persona-conditioned LLMs as synthetic survey respondents has become a common practice in computational social science and agent-based simulations. Yet, it remains unclear whether multi-attribute persona prompting improves LLM…

Computers and Society · Computer Science 2026-02-24 Erika Elizabeth Taday Morocho , Lorenzo Cima , Tiziano Fagni , Marco Avvenuti , Stefano Cresci

With the impressive performance in various downstream tasks, large language models (LLMs) have been widely integrated into production pipelines, like recruitment and recommendation systems. A known issue of models trained on natural…

Computation and Language · Computer Science 2025-01-22 Damin Zhang , Yi Zhang , Geetanjali Bihani , Julia Rayz

Unwanted and often harmful social biases are becoming ever more salient in NLP research, affecting both models and datasets. In this work, we ask whether training on demographically perturbed data leads to fairer language models. We collect…

Computation and Language · Computer Science 2022-10-14 Rebecca Qian , Candace Ross , Jude Fernandes , Eric Smith , Douwe Kiela , Adina Williams

Though majority vote among annotators is typically used for ground truth labels in natural language processing, annotator disagreement in tasks such as hate speech detection may reflect differences in opinion across groups, not noise. Thus,…

Computation and Language · Computer Science 2024-03-19 Eve Fleisig , Rediet Abebe , Dan Klein

Aligning large language models (LLMs) with human values and intents critically involves the use of human or AI feedback. While dense feedback annotations are expensive to acquire and integrate, sparse feedback presents a structural design…

Machine Learning · Computer Science 2024-02-07 Hritik Bansal , John Dang , Aditya Grover

The "LLM-as-an-annotator" and "LLM-as-a-judge" paradigms employ Large Language Models (LLMs) as annotators, judges, and evaluators in tasks traditionally performed by humans. LLM annotations are widely used, not only in NLP research but…

Computation and Language · Computer Science 2025-08-11 Nitay Calderon , Roi Reichart , Rotem Dror

Large language models (LLMs) increasingly serve as human-like decision-making agents in social science and applied settings. These LLM-agents are typically assigned human-like characters and placed in real-life contexts. However, how these…

Artificial Intelligence · Computer Science 2025-12-24 Ji Ma

Objectives: Compare qualitative coding of instruction tuned large language models (IT-LLMs) against human coders in classifying the presence or absence of vulnerability in routinely collected unstructured text that describes police-public…

Computation and Language · Computer Science 2024-12-17 Sam Relins , Daniel Birks , Charlie Lloyd