中文
相关论文

相关论文: Gender Bias in Transformer Models: A comprehensive…

200 篇论文

Successful deployment of artificial intelligence (AI) in various settings has led to numerous positive outcomes for individuals and society. However, AI systems have also been shown to harm parts of the population due to biased predictions.…

计算机与社会 · 计算机科学 2023-07-21 Ondrej Bohdal , Timothy Hospedales , Philip H. S. Torr , Fazl Barez

Researchers have devised numerous ways to quantify social biases vested in pretrained language models. As some language models are capable of generating coherent completions given a set of textual prompts, several prompting datasets have…

计算与语言 · 计算机科学 2022-05-25 Afra Feyza Akyürek , Muhammed Yusuf Kocyigit , Sejin Paik , Derry Wijaya

Large Language Models (LLMs) are finding applications in all aspects of life, but their susceptibility to biases, particularly gender stereotyping, raises ethical concerns. This study introduces a novel methodology, a persona-based…

计算机与社会 · 计算机科学 2025-02-18 Rajesh Ranjan , Shailja Gupta , Surya Naranyan Singh

Machine learning models are trained to find patterns in data. NLP models can inadvertently learn socially undesirable patterns when training on gender biased text. In this work, we propose a general framework that decomposes gender bias in…

计算与语言 · 计算机科学 2020-05-05 Emily Dinan , Angela Fan , Ledell Wu , Jason Weston , Douwe Kiela , Adina Williams

The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a…

计算机视觉与模式识别 · 计算机科学 2021-06-08 Osman Aka , Ken Burke , Alex Bäuerle , Christina Greer , Margaret Mitchell

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

机器学习 · 计算机科学 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

This paper examines how international AI governance frameworks address gender issues and gender-based harms. The analysis covers binding regulations, such as the EU AI Act; soft law instruments, like the UNESCO Recommendations on AI Ethics;…

计算机与社会 · 计算机科学 2025-12-11 Jelena Cupac

Artificial Intelligence (AI) has paved the way for revolutionary decision-making processes, which if harnessed appropriately, can contribute to advancements in various sectors, from healthcare to economics. However, its black box nature…

Neural machine translation (NMT) models often suffer from gender biases that harm users and society at large. In this work, we explore how bridging the gap between languages for which parallel data is not available affects gender bias in…

计算与语言 · 计算机科学 2023-05-29 Lena Cabrera , Jan Niehues

While several previous studies have analyzed gender bias in research, we are still missing a comprehensive analysis of gender differences in the AI community, covering diverse topics and different development trends. Using the AI Scholar…

计算与语言 · 计算机科学 2025-06-23 Yiwen Ding , Jiarui Liu , Zhiheng Lyu , Kun Zhang , Bernhard Schoelkopf , Zhijing Jin , Rada Mihalcea

Large Language Models (LLMs), such as GPT-4 and BERT, have rapidly gained traction in natural language processing (NLP) and are now integral to financial decision-making. However, their deployment introduces critical challenges,…

计算机与社会 · 计算机科学 2024-10-29 Hui Zhong , Songsheng Chen , Mian Liang

In this paper, we propose a novel gender bias detection method by utilizing attention map for transformer-based models. We 1) give an intuitive gender bias judgement method by comparing the different relation degree between the genders and…

计算与语言 · 计算机科学 2021-11-01 Bingbing Li , Hongwu Peng , Rajat Sainju , Junhuan Yang , Lei Yang , Yueying Liang , Weiwen Jiang , Binghui Wang , Hang Liu , Caiwen Ding

Transformers have made significant strides across various artificial intelligence domains, including natural language processing, computer vision, and audio processing. This success has naturally garnered considerable interest from both…

图像与视频处理 · 电气工程与系统科学 2024-08-12 Elyas Rashno , Amir Eskandari , Aman Anand , Farhana Zulkernine

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

计算与语言 · 计算机科学 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

AI-generated text detectors have recently gained adoption in educational and professional contexts. Prior research has uncovered isolated cases of bias, particularly against English Language Learners (ELLs) however, there is a lack of…

人工智能 · 计算机科学 2025-12-15 Priyam Basu , Yunfeng Zhang , Vipul Raheja

Human-AI collaboration is increasingly relevant in consequential areas where AI recommendations support human discretion. However, human-AI teams' effectiveness, capability, and fairness highly depend on human perceptions of AI. Positive…

人机交互 · 计算机科学 2025-06-06 Domenique Zipperling , Luca Deck , Julia Lanzl , Niklas Kühl

The paradigm of pretrained deep learning models has recently emerged in artificial intelligence practice, allowing deployment in numerous societal settings with limited computational resources, but also embedding biases and enabling…

计算机与社会 · 计算机科学 2019-09-10 Lav R. Varshney , Nitish Shirish Keskar , Richard Socher

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

计算与语言 · 计算机科学 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When…

信息检索 · 计算机科学 2025-11-04 Amirabbas Afzali , Amirreza Velae , Iman Ahmadi , Mohammad Aliannejadi

Political biases in Large Language Model (LLM)-based artificial intelligence (AI) systems, such as OpenAI's ChatGPT or Google's Gemini, have been previously reported. While several prior studies have attempted to quantify these biases using…

计算机与社会 · 计算机科学 2025-03-17 David Rozado