English
Related papers

Related papers: A Multilingual Perspective on Probing Gender Bias

200 papers

Biases in culture, gender, ethnicity, etc. have existed for decades and have affected many areas of human social interaction. These biases have been shown to impact machine learning (ML) models, and for natural language processing (NLP),…

Computation and Language · Computer Science 2022-09-21 Dhanasekar Sundararaman , Vivek Subramanian

Accurately measuring gender stereotypical bias in language models is a complex task with many hidden aspects. Current benchmarks have underestimated this multifaceted challenge and failed to capture the full extent of the problem. This…

Computation and Language · Computer Science 2025-09-25 Mahdi Zakizadeh , Mohammad Taher Pilehvar

Institutions widely use student evaluations to assess the faculty's teaching performance, but underlying trends and biases can influence their interpretation. Using data from Rate My Professors, we conduct the largest and most recent…

Social and Information Networks · Computer Science 2020-12-09 Sofia Maria Nikolakaki , Joseph Lai , Evimaria Terzi

Technology for language generation has advanced rapidly, spurred by advancements in pre-training large models on massive amounts of data and the need for intelligent agents to communicate in a natural manner. While techniques can…

Computation and Language · Computer Science 2021-06-24 Emily Sheng , Kai-Wei Chang , Premkumar Natarajan , Nanyun Peng

Recent works have found evidence of gender bias in models of machine translation and coreference resolution using mostly synthetic diagnostic datasets. While these quantify bias in a controlled experiment, they often do so on a small scale…

Computation and Language · Computer Science 2021-09-13 Shahar Levy , Koren Lazar , Gabriel Stanovsky

Cyberbullying is of extreme prevalence today. Online-hate comments, toxicity, cyberbullying amongst children and other vulnerable groups are only growing over online classes, and increased access to social platforms, especially post…

Computation and Language · Computer Science 2021-07-20 Bhumika Bhatia , Anuj Verma , Anjum , Rahul Katarya

Common methods for interpreting neural models in natural language processing typically examine either their structure or their behavior, but not both. We propose a methodology grounded in the theory of causal mediation analysis for…

Computation and Language · Computer Science 2020-11-24 Jesse Vig , Sebastian Gehrmann , Yonatan Belinkov , Sharon Qian , Daniel Nevo , Simas Sakenis , Jason Huang , Yaron Singer , Stuart Shieber

Having recognized gender bias as a major issue affecting current translation technologies, researchers have primarily attempted to mitigate it by working on the data front. However, whether algorithmic aspects concur to exacerbate unwanted…

Computation and Language · Computer Science 2021-05-31 Marco Gaido , Beatrice Savoldi , Luisa Bentivogli , Matteo Negri , Marco Turchi

Neural Machine Translation (NMT) models, though state-of-the-art for translation, often reflect social biases, particularly gender bias. Existing evaluation benchmarks primarily focus on English as the source language of translation. For…

Computation and Language · Computer Science 2023-12-08 Pushpdeep Singh

Text classification is an important topic in the field of natural language processing. It has been preliminarily applied in information retrieval, digital library, automatic abstracting, text filtering, word semantic discrimination and many…

Computation and Language · Computer Science 2023-12-20 Hao Li , Brandon Bennett

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

Computation and Language · Computer Science 2022-10-21 Hadas Orgad , Yonatan Belinkov

Despite attempts to increase gender parity in politics, global efforts have struggled to ensure equal female representation. This is likely tied to implicit gender biases against women in authority. In this work, we present a comprehensive…

Computation and Language · Computer Science 2025-08-13 Sara Marjanovic , Karolina Stańczak , Isabelle Augenstein

Word embedding has become essential for natural language processing as it boosts empirical performances of various tasks. However, recent research discovers that gender bias is incorporated in neural word embeddings, and downstream tasks…

Computation and Language · Computer Science 2019-11-26 Zekun Yang , Juan Feng

The gender bias present in the data on which language models are pre-trained gets reflected in the systems that use these models. The model's intrinsic gender bias shows an outdated and unequal view of women in our culture and encourages…

Computation and Language · Computer Science 2022-09-09 Neeraja Kirtane , V Manushree , Aditya Kane

To mitigate gender bias in contextualized language models, different intrinsic mitigation strategies have been proposed, alongside many bias metrics. Considering that the end use of these language models is for downstream tasks like text…

Computation and Language · Computer Science 2023-01-31 Ewoenam Tokpo , Pieter Delobelle , Bettina Berendt , Toon Calders

As NLP models become more integrated with the everyday lives of people, it becomes important to examine the social effect that the usage of these systems has. While these models understand language and have increased accuracy on difficult…

Computation and Language · Computer Science 2022-04-21 Rajas Bansal

Gender bias in language models has attracted sufficient attention because it threatens social justice. However, most of the current debiasing methods degraded the model's performance on other tasks while the degradation mechanism is still…

Computation and Language · Computer Science 2023-06-13 Yiran Liu , Xiao Liu , Haotian Chen , Yang Yu

Sexism, an injustice that subjects women and girls to enormous suffering, manifests in blatant as well as subtle ways. In the wake of growing documentation of experiences of sexism on the web, the automatic categorization of accounts of…

Computation and Language · Computer Science 2019-11-19 Pulkit Parikh , Harika Abburi , Pinkesh Badjatiya , Radhika Krishnan , Niyati Chhaya , Manish Gupta , Vasudeva Varma

As the use of natural language processing increases in our day-to-day life, the need to address gender bias inherent in these systems also amplifies. This is because the inherent bias interferes with the semantic structure of the output of…

Computation and Language · Computer Science 2022-05-13 Neeraja Kirtane , Tanvi Anand

Gender diversity in the tech sector is - not yet? - sufficient to create a balanced ratio of men and women. For many women, access to computer science is hampered by socialization-related, social, cultural and structural obstacles. The…

Computers and Society · Computer Science 2021-07-06 Aurélie Breidenbach , Caroline Mahlow , Andreas Schreiber