English
Related papers

Related papers: Generating Gender Augmented Data for NLP

200 papers

Language models (LMs) have become pivotal in the realm of technological advancements. While their capabilities are vast and transformative, they often include societal biases encoded in the human-produced datasets used for their training.…

Computation and Language · Computer Science 2024-01-30 Iñigo Parra

While machine translation (MT) systems have seen significant improvements, it is still common for translations to reflect societal biases, such as gender bias. Decoder-only Large Language Models (LLMs) have demonstrated potential in MT,…

Computation and Language · Computer Science 2024-04-18 Eduardo Sánchez , Pierre Andrews , Pontus Stenetorp , Mikel Artetxe , Marta R. Costa-jussà

Response generation is a task in natural language processing (NLP) where a model is trained to respond to human statements. Conversational response generators take this one step further with the ability to respond within the context of…

Computation and Language · Computer Science 2022-04-07 Gabriel Louis Tan , Adrian Paule Ty , Schuyler Ng , Denzel Adrian Co , Jan Christian Blaise Cruz , Charibeth Cheng

Natural Language Generation (NLG) is a key component in a task-oriented dialogue system, which converts the structured meaning representation (MR) to the natural language. For large-scale conversational systems, where it is common to have…

Computation and Language · Computer Science 2021-06-11 Xinnuo Xu , Guoyin Wang , Young-Bum Kim , Sungjin Lee

Although large pre-trained language models have achieved great success in many NLP tasks, it has been shown that they reflect human biases from their pre-training corpora. This bias may lead to undesirable outcomes when these models are…

Computation and Language · Computer Science 2022-11-29 Aristides Milios , Parishad BehnamGhader

Large Language Models (LLMs) are increasingly being used to generate text across various languages, for tasks such as translation, customer support, and education. Despite these advancements, LLMs show notable gender biases in English,…

Computation and Language · Computer Science 2024-09-23 Ishika Joshi , Ishita Gupta , Adrita Dey , Tapan Parikh

Moving from limited-domain natural language generation (NLG) to open domain is difficult because the number of semantic input combinations grows exponentially with the number of domains. Therefore, it is important to leverage existing…

Computation and Language · Computer Science 2016-03-04 Tsung-Hsien Wen , Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , David Vandyke , Steve Young

Neural machine translation (NMT) models often suffer from gender biases that harm users and society at large. In this work, we explore how bridging the gap between languages for which parallel data is not available affects gender bias in…

Computation and Language · Computer Science 2023-05-29 Lena Cabrera , Jan Niehues

This paper presents a new method for automatically detecting words with lexical gender in large-scale language datasets. Currently, the evaluation of gender bias in natural language processing relies on manually compiled lexicons of…

Computation and Language · Computer Science 2022-06-29 Marion Bartl , Susan Leavy

Neural Machine Translation models tend to perpetuate gender bias present in their training data distribution. Context-aware models have been previously suggested as a means to mitigate this type of bias. In this work, we examine this claim…

Computation and Language · Computer Science 2024-06-19 Harritxu Gete , Thierry Etchegoyhen

Retrieval Augmented Generation (RAG) has gained popularity as a method for conveniently incorporating novel facts that were not seen during the pre-training stage in Large Language Model (LLM)-based Natural Language Generation (NLG)…

Computation and Language · Computer Science 2026-01-26 Tianhui Zhang , Yi Zhou , Danushka Bollegala

Implicit gender bias in Large Language Models (LLMs) is a well-documented problem, and implications of gender introduced into automatic translations can perpetuate real-world biases. However, some LLMs use heuristics or post-processing to…

Computation and Language · Computer Science 2024-04-03 Peter J Barclay , Ashkan Sami

Counterfactual Data Augmentation (CDA) has been one of the preferred techniques for mitigating gender bias in natural language models. CDA techniques have mostly employed word substitution based on dictionaries. Although such…

Computation and Language · Computer Science 2023-11-07 Ewoenam Kwaku Tokpo , Toon Calders

We present the first challenge set and evaluation protocol for the analysis of gender bias in machine translation (MT). Our approach uses two recent coreference resolution datasets composed of English sentences which cast participants into…

Computation and Language · Computer Science 2019-06-04 Gabriel Stanovsky , Noah A. Smith , Luke Zettlemoyer

Large Language Models (LLMs) have shown impressive performance across a variety of Artificial Intelligence (AI) and natural language processing tasks, such as content creation, report generation, etc. However, unregulated malign application…

Computation and Language · Computer Science 2023-09-15 Harika Abburi , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

Pronoun resolution is part of coreference resolution, the task of pairing an expression to its referring entity. This is an important task for natural language understanding and a necessary component of machine translation systems, chat…

Computation and Language · Computer Science 2019-06-14 Matei Ionita , Yury Kashnitsky , Ken Krige , Vladimir Larin , Denis Logvinenko , Atanas Atanasov

Natural Language Processing (NLP) is one of the most revolutionary technologies today. It uses artificial intelligence to understand human text and spoken words. It is used for text summarization, grammar checking, sentiment analysis, and…

Computation and Language · Computer Science 2025-12-22 G. M. Refatul Islam , Safwan Shaheer , Yaseen Nur , Mohammad Rafid Hamid

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are…

Machine Learning · Computer Science 2018-09-14 Zhiting Hu , Zichao Yang , Xiaodan Liang , Ruslan Salakhutdinov , Eric P. Xing

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

Computation and Language · Computer Science 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

Code-switching (CS) is still a critical challenge in Natural Language Processing (NLP), due to the limited availability of large-scale, diverse CS datasets for robust training and evaluation. Despite recent advances, the capabilities and…

Computation and Language · Computer Science 2026-03-09 Maite Heredia , Gorka Labaka , Jeremy Barnes , Aitor Soroa