English
Related papers

Related papers: Mitigating Gender Bias in Machine Learning Data Se…

200 papers

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstream tasks like text…

Computation and Language · Computer Science 2023-01-31 Ewoenam Tokpo , Pieter Delobelle , Bettina Berendt , Toon Calders

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would…

Machine Learning · Computer Science 2019-09-05 Jindong Gu , Daniela Oelke

Language has a profound impact on our thoughts, perceptions, and conceptions of gender roles. Gender-inclusive language is, therefore, a key tool to promote social inclusion and contribute to achieving gender equality. Consequently,…

Computation and Language · Computer Science 2023-02-24 Jad Doughman , Wael Khreich

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

Computation and Language · Computer Science 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

Cyberbullying is a widespread adverse phenomenon among online social interactions in today's digital society. While numerous computational studies focus on enhancing the cyberbullying detection performance of machine learning algorithms,…

Computation and Language · Computer Science 2021-02-23 Oguzhan Gencoglu

Social bias in language - towards genders, ethnicities, ages, and other social groups - poses a problem with ethical impact for many NLP applications. Recent research has shown that machine learning models trained on respective data may not…

Computation and Language · Computer Science 2020-11-25 Maximilian Spliethöver , Henning Wachsmuth

Recent studies have shown that word embeddings exhibit gender bias inherited from the training corpora. However, most studies to date have focused on quantifying and mitigating such bias only in English. These analyses cannot be directly…

Computation and Language · Computer Science 2019-09-11 Pei Zhou , Weijia Shi , Jieyu Zhao , Kuan-Hao Huang , Muhao Chen , Ryan Cotterell , Kai-Wei Chang

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

Computation and Language · Computer Science 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

(Bolukbasi et al., 2016) demonstrated that pretrained word embeddings can inherit gender bias from the data they were trained on. We investigate how this bias affects downstream classification tasks, using the case study of occupation…

Machine Learning · Computer Science 2019-08-09 Flavien Prost , Nithum Thain , Tolga Bolukbasi

Does machine learning and AI ensure that social biases thrive ? This paper aims to analyse this issue. Indeed, as algorithms are informed by data, if these are corrupted, from a social bias perspective, good machine learning algorithms…

Machine Learning · Statistics 2020-11-03 Bertrand K. Hassani

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

In this paper, we propose a new framework for mitigating biases in machine learning systems. The problem of the existing mitigation approaches is that they are model-oriented in the sense that they focus on tuning the training algorithms to…

Machine Learning · Computer Science 2019-05-27 Adel Abusitta , Esma Aïmeur , Omar Abdel Wahab

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found…

Computation and Language · Computer Science 2018-06-19 Adam Sutton , Thomas Lansdall-Welfare , Nello Cristianini

There are concerns that neural language models may preserve some of the stereotypes of the underlying societies that generate the large corpora needed to train these models. For example, gender bias is a significant problem when generating…

Computation and Language · Computer Science 2019-11-04 Omar U. Florez

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero