English
Related papers

Related papers: Gender Biases in Error Mitigation by Voice Assista…

200 papers

Rapid development of artificial intelligence (AI) systems amplify many concerns in society. These AI algorithms inherit different biases from humans due to mysterious operational flow and because of that it is becoming adverse in usage. As…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Artem Domnich , Gholamreza Anbarjafari

Model-based evaluation metrics (e.g., CLIPScore and GPTScore) have demonstrated decent correlations with human judgments in various language generation tasks. However, their impact on fairness remains largely unexplored. It is widely…

Computation and Language · Computer Science 2023-11-06 Haoyi Qiu , Zi-Yi Dou , Tianlu Wang , Asli Celikyilmaz , Nanyun Peng

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

Speech Large Language Models (SpeechLLMs) process spoken input directly, retaining cues such as accent and perceived gender that were previously removed in cascaded pipelines. This introduces speaker identity dependent variation in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Shree Harsha Bokkahalli Satish , Christoph Minixhofer , Maria Teleki , James Caverlee , Ondřej Klejch , Peter Bell , Gustav Eje Henter , Éva Székely

Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sexist" when trained on…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park , Jamin Shin , Pascale Fung

Gender bias is highly impacting natural language processing applications. Word embeddings have clearly been proven both to keep and amplify gender biases that are present in current data sources. Recently, contextualized word embeddings…

Computation and Language · Computer Science 2019-04-19 Christine Basta , Marta R. Costa-jussà , Noe Casas

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza

Recursive prompting with large language models enables scalable synthetic dataset generation but introduces the risk of bias amplification. We investigate gender bias dynamics across three generations of recursive text generation using…

Computation and Language · Computer Science 2025-11-17 Ashish Kattamuri , Arpita Vats , Harshwardhan Fartale , Rahul Raja , Akshata Kishore Moharir , Ishita Prasad

Recently there has been a growing concern about machine bias, where trained statistical models grow to reflect controversial societal asymmetries, such as gender or racial bias. A significant number of AI tools have recently been suggested…

Computers and Society · Computer Science 2019-03-12 Marcelo O. R. Prates , Pedro H. C. Avelar , Luis Lamb

Recent years have seen rapid growth in the market for HR technology and AI-driven HR solutions in particular. This popularity has also resulted in increased attention to the negative aspects of using AI to support hiring practices, such as…

Computers and Society · Computer Science 2026-03-09 Mesut Kaya , Toine Bogers

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

Computation and Language · Computer Science 2022-11-29 Kenan Tang , Hanchun Jiang

Conversational agents that mimic people have raised questions about the ethics of anthropomorphizing machines with human social identity cues. Critics have also questioned assumptions of identity neutrality in humanlike agents. Recent work…

Human-Computer Interaction · Computer Science 2025-06-04 Takao Fujii , Katie Seaborn , Madeleine Steeds , Jun Kato

Unlike text, speech conveys information about the speaker, such as gender, through acoustic cues like pitch. This gives rise to modality-specific bias concerns. For example, in speech translation (ST), when translating from languages with…

Computation and Language · Computer Science 2026-04-29 Lina Conti , Dennis Fucci , Marco Gaido , Matteo Negri , Guillaume Wisniewski , Luisa Bentivogli

Voice-based systems like Amazon Alexa, Google Assistant, and Apple Siri, along with the growing popularity of OpenAI's ChatGPT and Microsoft's Copilot, serve diverse populations, including visually impaired and low-literacy communities.…

Human-Computer Interaction · Computer Science 2024-09-04 Sachin Pathiyan Cherumanal , Falk Scholer , Johanne R. Trippas , Damiano Spina

Current automatic speech recognition (ASR) models are designed to be used across many languages and tasks without substantial changes. However, this broad language coverage hides performance gaps within languages, for example, across…

Computation and Language · Computer Science 2024-10-04 Giuseppe Attanasio , Beatrice Savoldi , Dennis Fucci , Dirk Hovy

While several previous studies have analyzed gender bias in research, we are still missing a comprehensive analysis of gender differences in the AI community, covering diverse topics and different development trends. Using the AI Scholar…

Computation and Language · Computer Science 2025-06-23 Yiwen Ding , Jiarui Liu , Zhiheng Lyu , Kun Zhang , Bernhard Schoelkopf , Zhijing Jin , Rada Mihalcea

SpeechLLMs process spoken language directly from audio, but accent and vocal identity cues can lead to biased behaviour. Current bias evaluations often miss how such bias manifests in end-to-end speech interactions and how users experience…

Human-Computer Interaction · Computer Science 2026-04-16 Shree Harsha Bokkahalli Satish , Maria Teleki , Christoph Minixhofer , Ondrej Klejch , Peter Bell , Éva Székely

Predictive algorithms have a powerful potential to offer benefits in areas as varied as medicine or education. However, these algorithms and the data they use are built by humans, consequently, they can inherit the bias and prejudices…

Human-Computer Interaction · Computer Science 2022-03-22 Cristina Manresa-Yee , Silvia Ramis

Models often easily learn biases present in the training data, and their predictions directly reflect this bias. We analyze gender bias in dialogue data, and examine how this bias is actually amplified in subsequent generative chit-chat…

Computation and Language · Computer Science 2020-04-17 Emily Dinan , Angela Fan , Adina Williams , Jack Urbanek , Douwe Kiela , Jason Weston

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai