中文
相关论文

相关论文: Gender Biases in Automatic Evaluation Metrics for …

200 篇论文

Vision-language models are growing in popularity and public visibility to generate, edit, and caption images at scale; but their outputs can perpetuate and amplify societal biases learned during pre-training on uncurated image-text pairs…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Brandon Smith , Miguel Farinha , Siobhan Mackenzie Hall , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

计算与语言 · 计算机科学 2022-10-21 Hadas Orgad , Yonatan Belinkov

Text-to-Image (TTI) generative models have shown great progress in the past few years in terms of their ability to generate complex and high-quality imagery. At the same time, these models have been shown to suffer from harmful biases,…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Aditya Chinchure , Pushkar Shukla , Gaurav Bhatt , Kiri Salij , Kartik Hosanagar , Leonid Sigal , Matthew Turk

Gender bias is highly impacting natural language processing applications. Word embeddings have clearly been proven both to keep and amplify gender biases that are present in current data sources. Recently, contextualized word embeddings…

计算与语言 · 计算机科学 2019-04-19 Christine Basta , Marta R. Costa-jussà , Noe Casas

Humans have entered the age of algorithms. Each minute, algorithms shape countless preferences from suggesting a product to a potential life partner. In the marketplace algorithms are trained to learn consumer preferences from customer…

计算与语言 · 计算机科学 2019-02-04 A. Mishra , H. Mishra , S. Rathee

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

计算与语言 · 计算机科学 2021-05-06 Christine Basta , Marta R. Costa-jussà

Text-to-image models, which can generate high-quality images based on textual input, have recently enabled various content-creation tools. Despite significantly affecting a wide range of downstream applications, the distributions of these…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Yanzhe Zhang , Lu Jiang , Greg Turk , Diyi Yang

When exposed to human-generated data, language models are known to learn and amplify societal biases. While previous works introduced benchmarks that can be used to assess the bias in these models, they rely on assumptions that may not be…

计算与语言 · 计算机科学 2025-10-16 Angana Borah , Aparna Garimella , Rada Mihalcea

Automatic evaluation metrics hold a fundamental importance in the development and fine-grained analysis of captioning systems. While current evaluation metrics tend to achieve an acceptable correlation with human judgements at the system…

人工智能 · 计算机科学 2020-12-25 Naeha Sharif , Lyndon White , Mohammed Bennamoun , Wei Liu , Syed Afaq Ali Shah

While there have been significant gains in the field of automated video description, the generalization performance of automated description models to novel domains remains a major barrier to using these systems in the real world. Most…

计算机视觉与模式识别 · 计算机科学 2023-01-16 David M. Chan , Austin Myers , Sudheendra Vijayanarasimhan , David A. Ross , Bryan Seybold , John F. Canny

Large multimodal models (LMMs) have revolutionized text-to-image generation, but they risk perpetuating the harmful social biases in their training data. Prior work has identified gender bias in these models, but methodological limitations…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Juan Manuel Contreras

Pretrained language models are publicly available and constantly finetuned for various real-life applications. As they become capable of grasping complex contextual information, harmful biases are likely increasingly intertwined with those…

计算与语言 · 计算机科学 2023-06-28 Sophie Jentzsch , Cigdem Turan

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

计算与语言 · 计算机科学 2023-09-04 Vishesh Thakur

Automatic metrics are now central to evaluating text-to-image models, often substituting for human judgment in benchmarking and large-scale filtering. However, it remains unclear whether these metrics truly prioritize semantic correctness…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Subhadeep Roy , Gagan Bhatia , Steffen Eger

Automatic evaluation metrics are crucial to the development of generative systems. In recent years, pre-trained language model (PLM) based metrics, such as BERTScore, have been commonly adopted in various generation tasks. However, it has…

计算与语言 · 计算机科学 2022-10-17 Tianxiang Sun , Junliang He , Xipeng Qiu , Xuanjing Huang

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

计算与语言 · 计算机科学 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

Humans show language-biased image recognition for a word-embedded image, known as picture-word interference. Such interference depends on hierarchical semantic categories and reflects that human language processing highly interacts with…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Yoann Lemesle , Masataka Sawayama , Guillermo Valle-Perez , Maxime Adolphe , Hélène Sauzéon , Pierre-Yves Oudeyer

Image captioning is a multimodal problem that has drawn extensive attention in both the natural language processing and computer vision community. In this paper, we present a novel image captioning architecture to better explore semantics…

计算机视觉与模式识别 · 计算机科学 2020-06-23 Zhan Shi , Xu Zhou , Xipeng Qiu , Xiaodan Zhu

Image captioning has become an essential Vision & Language research task. It is about predicting the most accurate caption given a specific image or video. The research community has achieved impressive results by continuously proposing new…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Guillermo Ruiz , Tania Ramírez , Daniela Moctezuma

Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sexist" when trained on…

计算与语言 · 计算机科学 2018-08-23 Ji Ho Park , Jamin Shin , Pascale Fung