English
Related papers

Related papers: On Measures of Biases and Harms in NLP

200 papers

This paper is a summary of the work done in my PhD thesis. Where I investigate the impact of bias in NLP models on the task of hate speech detection from three perspectives: explainability, offensive stereotyping bias, and fairness. Then, I…

Computation and Language · Computer Science 2023-12-06 Fatma Elsafoury

Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found…

Computation and Language · Computer Science 2018-06-19 Adam Sutton , Thomas Lansdall-Welfare , Nello Cristianini

As LLMs are increasingly applied in socially impactful settings, concerns about gender bias have prompted growing efforts both to measure and mitigate such bias. These efforts often rely on evaluation tasks that differ from natural language…

Computation and Language · Computer Science 2025-09-11 Bufan Gao , Elisa Kreiss

Natural language processing (NLP) models often replicate or amplify social bias from training data, raising concerns about fairness. At the same time, their black-box nature makes it difficult for users to recognize biased predictions and…

Computation and Language · Computer Science 2026-02-12 Yifan Wang , Mayank Jobanputra , Ji-Ung Lee , Soyoung Oh , Isabel Valera , Vera Demberg

Large language models (LLMs) have garnered significant attention for their remarkable performance in a continuously expanding set of natural language processing tasks. However, these models have been shown to harbor inherent societal…

Computation and Language · Computer Science 2023-10-16 Abel Salinas , Louis Penafiel , Robert McCormack , Fred Morstatter

Fairness has become a trending topic in natural language processing (NLP), which addresses biases targeting certain social groups such as genders and religions. However, regional bias in language models (LMs), a long-standing global…

Computation and Language · Computer Science 2022-11-08 Yizhi Li , Ge Zhang , Bohao Yang , Chenghua Lin , Shi Wang , Anton Ragni , Jie Fu

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

Large Language Models (LLMs) are prone to inheriting and amplifying societal biases embedded within their training data, potentially reinforcing harmful stereotypes related to gender, occupation, and other sensitive categories. This issue…

Computation and Language · Computer Science 2024-08-28 Atmika Gorti , Manas Gaur , Aman Chadha

In recent years, significant advancements in the field of Natural Language Processing (NLP) have positioned commercialized language models as wide-reaching, highly useful tools. In tandem, there has been an explosion of multidisciplinary…

Computers and Society · Computer Science 2025-11-19 Jacob Hobbs

Pretrained multilingual models exhibit the same social bias as models processing English texts. This systematic review analyzes emerging research that extends bias evaluation and mitigation approaches into multilingual and non-English…

Computation and Language · Computer Science 2025-09-08 Lance Calvin Lim Gamboa , Yue Feng , Mark Lee

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

The remarkable progress in Natural Language Processing (NLP) brought about by deep learning, particularly with the recent advent of large pre-trained neural language models, is brought into scrutiny as several studies began to discuss and…

Computation and Language · Computer Science 2023-01-25 Anoop K. , Manjary P. Gangan , Deepak P. , Lajish V. L

Building equitable and inclusive NLP technologies demands consideration of whether and how social attitudes are represented in ML models. In particular, representations encoded in models often inadvertently perpetuate undesirable social…

Computation and Language · Computer Science 2020-05-05 Ben Hutchinson , Vinodkumar Prabhakaran , Emily Denton , Kellie Webster , Yu Zhong , Stephen Denuyl

This paper presents novel experiments shedding light on the shortcomings of current metrics for assessing biases of gender discrimination made by machine learning algorithms on textual data. We focus on the Bios dataset, and our learning…

Computation and Language · Computer Science 2023-06-09 Fanny Jourdan , Laurent Risser , Jean-Michel Loubes , Nicholas Asher

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

Although much literature has established the presence of demographic bias in natural language processing (NLP) models, most work relies on curated bias metrics that may not be reflective of real-world applications. At the same time,…

Computation and Language · Computer Science 2023-06-01 Anjalie Field , Amanda Coston , Nupoor Gandhi , Alexandra Chouldechova , Emily Putnam-Hornstein , David Steier , Yulia Tsvetkov

The pervasive spread of misinformation and disinformation in social media underscores the critical importance of detecting media bias. While robust Large Language Models (LLMs) have emerged as foundational tools for bias prediction,…

Computers and Society · Computer Science 2024-12-11 Luyang Lin , Lingzhi Wang , Jinsong Guo , Kam-Fai Wong

Large language models (LLMs) are increasingly used for text generation tasks from everyday use to high-stakes enterprise and government applications, including simulated interviews with asylum seekers. While many works highlight the new…

Computation and Language · Computer Science 2026-04-27 Ilana Nguyen , Harini Suresh , Thema Monroe-White , Evan Shieh

The presence of social biases in Natural Language Processing (NLP) and Information Retrieval (IR) systems is an ongoing challenge, which underlines the importance of developing robust approaches to identifying and evaluating such biases. In…

Information Retrieval · Computer Science 2025-06-30 Maryam Mousavian , Zahra Abbasiantaeb , Mohammad Aliannejadi , Fabio Crestani

The utility and power of Natural Language Processing (NLP) seems destined to change our technological society in profound and fundamental ways. However there are, to date, few accessible descriptions of the science of NLP that have been…

Computation and Language · Computer Science 2012-09-28 Kevin Mote