English
Related papers

Related papers: Biased Embeddings from Wild Data: Measuring, Under…

200 papers

High-dimensional representations for words, text, images, knowledge graphs and other structured data are commonly used in different paradigms of machine learning and data mining. These representations have different degrees of…

Computation and Language · Computer Science 2020-11-26 Sunipa Dev

Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using…

Computation and Language · Computer Science 2019-11-27 Sunipa Dev , Tao Li , Jeff Phillips , Vivek Srikumar

As NLP models become more integrated with the everyday lives of people, it becomes important to examine the social effect that the usage of these systems has. While these models understand language and have increased accuracy on difficult…

Computation and Language · Computer Science 2022-04-21 Rajas Bansal

Natural Language Processing (NLP) systems learn harmful societal biases that cause them to amplify inequality as they are deployed in more and more situations. To guide efforts at debiasing these systems, the NLP community relies on a…

Computation and Language · Computer Science 2021-06-09 Seraphina Goldfarb-Tarrant , Rebecca Marchant , Ricardo Muñoz Sanchez , Mugdha Pandya , Adam Lopez

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

Word vector representations are well developed tools for various NLP and Machine Learning tasks and are known to retain significant semantic and syntactic structure of languages. But they are prone to carrying and amplifying bias which can…

Computation and Language · Computer Science 2019-01-24 Sunipa Dev , Jeff Phillips

The problem of algorithmic bias in machine learning has gained a lot of attention in recent years due to its concrete and potentially hazardous implications in society. In much the same manner, biases can also alter modern industrial and…

Machine Learning · Computer Science 2022-10-11 Laurent Risser , Agustin Picard , Lucas Hervier , Jean-Michel Loubes

In recent years, word embeddings have been widely used to measure biases in texts. Even if they have proven to be effective in detecting a wide variety of biases, metrics based on word embeddings lack transparency and interpretability. We…

Computation and Language · Computer Science 2023-07-19 Francisco Valentini , Germán Rosati , Damián Blasi , Diego Fernandez Slezak , Edgar Altszyler

Recent studies show that Natural Language Processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. To create interventions and mitigate these biases…

Computation and Language · Computer Science 2022-10-17 Sunipa Dev , Emily Sheng , Jieyu Zhao , Aubrie Amstutz , Jiao Sun , Yu Hou , Mattie Sanseverino , Jiin Kim , Akihiro Nishi , Nanyun Peng , Kai-Wei Chang

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

Multilingual representations embed words from many languages into a single semantic space such that words with similar meanings are close to each other regardless of the language. These embeddings have been widely used in various settings,…

Computation and Language · Computer Science 2020-05-05 Jieyu Zhao , Subhabrata Mukherjee , Saghar Hosseini , Kai-Wei Chang , Ahmed Hassan Awadallah

Social bias in language - towards genders, ethnicities, ages, and other social groups - poses a problem with ethical impact for many NLP applications. Recent research has shown that machine learning models trained on respective data may not…

Computation and Language · Computer Science 2020-11-25 Maximilian Spliethöver , Henning Wachsmuth

Gender bias is highly impacting natural language processing applications. Word embeddings have clearly been proven both to keep and amplify gender biases that are present in current data sources. Recently, contextualized word embeddings…

Computation and Language · Computer Science 2019-04-19 Christine Basta , Marta R. Costa-jussà , Noe Casas

Word embeddings are widely used in NLP for a vast range of tasks. It was shown that word embeddings derived from text corpora reflect gender biases in society. This phenomenon is pervasive and consistent across different word embedding…

Computation and Language · Computer Science 2019-09-25 Hila Gonen , Yoav Goldberg

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

Due to the widespread use of data-powered systems in our everyday lives, concepts like bias and fairness gained significant attention among researchers and practitioners, in both industry and academia. Such issues typically emerge from the…

Machine Learning · Computer Science 2023-05-18 Gianluca Demartini , Kevin Roitero , Stefano Mizzaro