English
Related papers

Related papers: Investigating Gender Bias in BERT

200 papers

This work combines algorithms based on word embeddings, dimensionality reduction, and clustering. The objective is to obtain topics from a set of unclassified texts. The algorithm to obtain the word embeddings is the BERT model, a neural…

Computation and Language · Computer Science 2023-12-08 Diego Saldaña Ulloa

Machine learning models are trained to find patterns in data. NLP models can inadvertently learn socially undesirable patterns when training on gender biased text. In this work, we propose a general framework that decomposes gender bias in…

Computation and Language · Computer Science 2020-05-05 Emily Dinan , Angela Fan , Ledell Wu , Jason Weston , Douwe Kiela , Adina Williams

The rise of concern around Natural Language Processing (NLP) technologies containing and perpetuating social biases has led to a rich and rapidly growing area of research. Gender bias is one of the central biases being analyzed, but to date…

Computation and Language · Computer Science 2022-05-06 Hannah Devinney , Jenny Björklund , Henrik Björklund

As natural language processing methods are increasingly deployed in real-world scenarios such as healthcare, legal systems, and social science, it becomes necessary to recognize the role they potentially play in shaping social biases and…

Computation and Language · Computer Science 2020-07-17 Paul Pu Liang , Irene Mengze Li , Emily Zheng , Yao Chong Lim , Ruslan Salakhutdinov , Louis-Philippe Morency

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

Cryptography and Security · Computer Science 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

Models based on the transformer architecture, such as BERT, have marked a crucial step forward in the field of Natural Language Processing. Importantly, they allow the creation of word embeddings that capture important semantic information…

Computation and Language · Computer Science 2021-01-01 Jacob Turton , David Vinson , Robert Elliott Smith

Natural Language Processing (NLP) for low-resource languages, which lack large annotated datasets, faces significant challenges due to limited high-quality data and linguistic resources. The selection of embeddings plays a critical role in…

Computation and Language · Computer Science 2025-02-21 Abhay Shanbhag , Suramya Jadhav , Amogh Thakurdesai , Ridhima Sinare , Raviraj Joshi

Gender bias in large language models has primarily been investigated for English, while languages with grammatical or morphological gender remain comparatively understudied. This paper investigates how and when gender information emerges in…

Computation and Language · Computer Science 2026-05-11 Jonas Klein , Chiara Manna , Eva Vanmassenhove

Multimodal sentiment analysis has become an increasingly popular research area as the demand for multimodal online content is growing. For multimodal sentiment analysis, words can have different meanings depending on the linguistic context…

Computation and Language · Computer Science 2022-09-16 Junghun Kim , Jihie Kim

Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such…

Computation and Language · Computer Science 2025-06-09 Bhavik Chandna , Zubair Bashir , Procheta Sen

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

There exist both scalable tasks, like reading comprehension and fact-checking, where model performance improves with model size, and unscalable tasks, like arithmetic reasoning and symbolic reasoning, where model performance does not…

Computation and Language · Computer Science 2024-01-30 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki , Timothy Baldwin

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing…

Computation and Language · Computer Science 2021-03-11 Joshua R. Minot , Nicholas Cheney , Marc Maier , Danne C. Elbers , Christopher M. Danforth , Peter Sheridan Dodds

The application of Natural Language Processing (NLP) has achieved a high level of relevance in several areas. In the field of software engineering (SE), NLP applications are based on the classification of similar texts (e.g. software…

Software Engineering · Computer Science 2021-12-02 Eliane Maria De Bortoli Fávero , Dalcimar Casanova

Pre-trained language models such as BERT have been proved to be powerful in many natural language processing tasks. But in some text classification applications such as emotion recognition and sentiment analysis, BERT may not lead to…

Computation and Language · Computer Science 2025-06-03 Zixiao Zhu , Kezhi Mao

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

Large Language Models (LLMs) exhibit socio-economic biases that can propagate into downstream tasks. While prior studies have questioned whether intrinsic bias in LLMs affects fairness at the downstream task level, this work empirically…

Computation and Language · Computer Science 2025-09-23 'Mina Arzaghi' , 'Alireza Dehghanpour Farashah' , 'Florian Carichon' , ' Golnoosh Farnadi'

Deep learning approaches are superior in NLP due to their ability to extract informative features and patterns from languages. The two most successful neural architectures are LSTM and transformers, used in large pretrained language models…

Computation and Language · Computer Science 2022-03-03 Matej Klemen , Luka Krsnik , Marko Robnik-Šikonja

When exposed to human-generated data, language models are known to learn and amplify societal biases. While previous works introduced benchmarks that can be used to assess the bias in these models, they rely on assumptions that may not be…

Computation and Language · Computer Science 2025-10-16 Angana Borah , Aparna Garimella , Rada Mihalcea

Training data for NLP tasks often exhibits gender bias in that fewer sentences refer to women than to men. In Neural Machine Translation (NMT) gender bias has been shown to reduce translation quality, particularly when the target language…

Computation and Language · Computer Science 2020-07-10 Danielle Saunders , Bill Byrne