English
Related papers

Related papers: Automatically Identifying Gender Issues in Machine…

200 papers

Speakers of different languages must attend to and encode strikingly different aspects of the world in order to use their language correctly (Sapir, 1921; Slobin, 1996). One such difference is related to the way gender is expressed in a…

Computation and Language · Computer Science 2019-09-12 Eva Vanmassenhove , Christian Hardmeier , Andy Way

A large number of machine translation approaches have recently been developed to facilitate the fluid migration of content across languages. However, the literature suggests that many obstacles must still be dealt with to achieve better…

Computation and Language · Computer Science 2019-07-26 Diego Moussallem , Matthias Wauer , Axel-Cyrille Ngonga Ngomo

Gender-neutral translation (GNT) that avoids biased and undue binary assumptions is a pivotal challenge for the creation of more inclusive translation technologies. Advancements for this task in Machine Translation (MT), however, are…

Computation and Language · Computer Science 2024-02-12 Beatrice Savoldi , Andrea Piergentili , Dennis Fucci , Matteo Negri , Luisa Bentivogli

Recent instruction fine-tuned models can solve multiple NLP tasks when prompted to do so, with machine translation (MT) being a prominent use case. However, current research often focuses on standard performance benchmarks, leaving…

Computation and Language · Computer Science 2023-10-26 Giuseppe Attanasio , Flor Miriam Plaza-del-Arco , Debora Nozza , Anne Lauscher

As large language models achieve impressive scores on traditional benchmarks, an increasing number of researchers are becoming concerned about benchmark data leakage during pre-training, commonly known as the data contamination problem. To…

Computation and Language · Computer Science 2024-06-27 Kun Qian , Shunji Wan , Claudia Tang , Youzhi Wang , Xuanming Zhang , Maximillian Chen , Zhou Yu

We present a three-pronged approach to improving Statistical Machine Translation (SMT), building on recent success in the application of neural networks to SMT. First, we propose new features based on neural networks to model various…

Computation and Language · Computer Science 2015-06-03 Hendra Setiawan , Zhongqiang Huang , Jacob Devlin , Thomas Lamar , Rabih Zbib , Richard Schwartz , John Makhoul

Gender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt a…

Computation and Language · Computer Science 2022-03-21 Beatrice Savoldi , Marco Gaido , Luisa Bentivogli , Matteo Negri , Marco Turchi

Multilingual language models were shown to allow for nontrivial transfer across scripts and languages. In this work, we study the structure of the internal representations that enable this transfer. We focus on the representation of gender…

Computation and Language · Computer Science 2022-08-15 Hila Gonen , Shauli Ravfogel , Yoav Goldberg

Ethics regarding social bias has recently thrown striking issues in natural language processing. Especially for gender-related topics, the need for a system that reduces the model bias has grown in areas such as image captioning, content…

Computation and Language · Computer Science 2019-05-29 Won Ik Cho , Ji Won Kim , Seok Min Kim , Nam Soo Kim

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

Neural Machine Translation models tend to perpetuate gender bias present in their training data distribution. Context-aware models have been previously suggested as a means to mitigate this type of bias. In this work, we examine this claim…

Computation and Language · Computer Science 2024-06-19 Harritxu Gete , Thierry Etchegoyhen

Gender-inclusive language is important for achieving gender equality in languages with gender inflections, such as German. While stirring some controversy, it is increasingly adopted by companies and political institutions. A handful of…

Computation and Language · Computer Science 2022-12-07 David Pomerenke

Neural machine translation inference procedures like beam search generate the most likely output under the model. This can exacerbate any demographic biases exhibited by the model. We focus on gender bias resulting from systematic errors in…

Computation and Language · Computer Science 2022-03-18 Danielle Saunders , Rosie Sallis , Bill Byrne

This study addresses the issue of speaker gender bias in Speech Translation (ST) systems, which can lead to offensive and inaccurate translations. The masculine bias often found in large-scale ST systems is typically perpetuated through…

Computation and Language · Computer Science 2025-01-13 Shubham Bansal , Vikas Joshi , Harveen Chadha , Rupeshkumar Mehta , Jinyu Li

Having recognized gender bias as a major issue affecting current translation technologies, researchers have primarily attempted to mitigate it by working on the data front. However, whether algorithmic aspects concur to exacerbate unwanted…

Computation and Language · Computer Science 2021-05-31 Marco Gaido , Beatrice Savoldi , Luisa Bentivogli , Matteo Negri , Marco Turchi

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Unlike major Western languages, most African languages are very low-resourced. Furthermore, the resources that do exist are often scattered and difficult to obtain and discover. As a result, the data and code for existing research has…

Computation and Language · Computer Science 2019-06-26 Laura Martinus , Jade Z. Abbott

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

Computation and Language · Computer Science 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

This paper aims at identifying the information flow in state-of-the-art machine translation systems, taking as example the transfer of gender when translating from French into English. Using a controlled set of examples, we experiment…

Computation and Language · Computer Science 2022-02-28 Guillaume Wisniewski , Lichao Zhu , Nicolas Ballier , François Yvon