English
Related papers

Related papers: Examining risks of racial biases in NLP tools for …

200 papers

We examine whether neural natural language processing (NLP) systems reflect historical biases in training data. We define a general benchmark to quantify gender bias in a variety of neural NLP tasks. Our empirical evaluation with…

Computation and Language · Computer Science 2019-06-03 Kaiji Lu , Piotr Mardziel , Fangjing Wu , Preetam Amancharla , Anupam Datta

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

How to avoid discrimination in the context of NLP technology is one of the major challenges in the field. We propose that a different and more substantiated framing of the problem could help to find more productive approaches. In the first…

Computers and Society · Computer Science 2025-08-07 Katrin Schulz , Marjolein Lanzing , Giulia Martinez Brenner

This research addresses privacy protection in Natural Language Processing (NLP) by introducing a novel algorithm based on differential privacy, aimed at safeguarding user data in common applications such as chatbots, sentiment analysis, and…

Cryptography and Security · Computer Science 2024-10-14 Shaobo Liu , Guiran Liu , Binrong Zhu , Yuanshuai Luo , Linxiao Wu , Rui Wang

Modern models for common NLP tasks often employ machine learning techniques and train on journalistic, social media, or other culturally-derived text. These have recently been scrutinized for racial and gender biases, rooting from inherent…

Computation and Language · Computer Science 2026-01-27 Scott Friedman , Sonja Schmer-Galunder , Anthony Chen , Jeffrey Rye

Despite inextricable ties between race and language, little work has considered race in NLP research and development. In this work, we survey 79 papers from the ACL anthology that mention race. These papers reveal various types of…

Computation and Language · Computer Science 2021-07-19 Anjalie Field , Su Lin Blodgett , Zeerak Waseem , Yulia Tsvetkov

Language models (LMs) are pretrained on diverse data sources, including news, discussion forums, books, and online encyclopedias. A significant portion of this data includes opinions and perspectives which, on one hand, celebrate democracy…

Computation and Language · Computer Science 2023-07-07 Shangbin Feng , Chan Young Park , Yuhan Liu , Yulia Tsvetkov

Language data and models demonstrate various types of bias, be it ethnic, religious, gender, or socioeconomic. AI/NLP models, when trained on the racially biased dataset, AI/NLP models instigate poor model explainability, influence user…

Computation and Language · Computer Science 2022-11-28 Kinshuk Sengupta , Praveen Ranjan Srivastava

Social bias in machine learning has drawn significant attention, with work ranging from demonstrations of bias in a multitude of applications, curating definitions of fairness for different contexts, to developing algorithms to mitigate…

Computation and Language · Computer Science 2019-11-06 Yi Chern Tan , L. Elisa Celis

This study explores using Natural Language Processing in aviation safety, focusing on machine learning algorithms to enhance safety measures. There are currently May 2024, 34 Scopus results from the keyword search natural language…

Computation and Language · Computer Science 2025-01-14 Aziida Nanyonga , Keith Joiner , Ugur Turhan , Graham Wild

Various forms of implications of artificial intelligence that either exacerbate or decrease racial systemic injustice have been explored in this applied research endeavor. Taking each thematic area of identifying, analyzing, and debating an…

Computers and Society · Computer Science 2022-01-05 Alia Abbas

Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague…

Computation and Language · Computer Science 2023-02-14 Xudong Han , Timothy Baldwin , Trevor Cohn

The rapid growth in the usage and applications of Natural Language Processing (NLP) in various sociotechnical solutions has highlighted the need for a comprehensive understanding of bias and its impact on society. While research on bias in…

Computation and Language · Computer Science 2023-08-28 Pranav Narayanan Venkit

Despite algorithms' potential to improve public services, adoption has been limited by concerns about effectiveness and equity. We conduct a randomized controlled trial ($N=4,681$) providing real-time algorithm support to Child Protective…

General Economics · Economics 2026-02-19 Marie-Pascale Grimon , Christopher Mills

Unwanted and often harmful social biases are becoming ever more salient in NLP research, affecting both models and datasets. In this work, we ask whether training on demographically perturbed data leads to fairer language models. We collect…

Computation and Language · Computer Science 2022-10-14 Rebecca Qian , Candace Ross , Jude Fernandes , Eric Smith , Douwe Kiela , Adina Williams

This paper explores the application of Natural Language Processing (NLP) in financial risk detection. By constructing an NLP-based financial risk detection model, this study aims to identify and predict potential risks in financial…

Risk Management · Quantitative Finance 2024-06-21 Liyang Wang , Yu Cheng , Ao Xiang , Jingyu Zhang , Haowei Yang

Natural Language Processing (NLP) aims to analyze text or speech via techniques in the computer science field. It serves applications in the domains of healthcare, commerce, education, and so on. Particularly, NLP has been widely applied to…

Computation and Language · Computer Science 2025-10-14 Yunshi Lan , Xinyuan Li , Hanyue Du , Xuesong Lu , Ming Gao , Weining Qian , Aoying Zhou

Large Language Models (LLMs) are prone to inheriting and amplifying societal biases embedded within their training data, potentially reinforcing harmful stereotypes related to gender, occupation, and other sensitive categories. This issue…

Computation and Language · Computer Science 2024-08-28 Atmika Gorti , Manas Gaur , Aman Chadha

Natural Language Processing (NLP) is a vital computational method for addressing language processing, analysis, and generation. NLP tasks form the core of many daily applications, from automatic text correction to speech recognition. While…

Computation and Language · Computer Science 2024-10-18 Caroline Sabty

This paper presents novel experiments shedding light on the shortcomings of current metrics for assessing biases of gender discrimination made by machine learning algorithms on textual data. We focus on the Bios dataset, and our learning…

Computation and Language · Computer Science 2023-06-09 Fanny Jourdan , Laurent Risser , Jean-Michel Loubes , Nicholas Asher