English
Related papers

Related papers: Robots Enact Malignant Stereotypes

200 papers

In recent years, the rapid advancement of machine learning (ML) models, particularly transformer-based pre-trained models, has revolutionized Natural Language Processing (NLP) and Computer Vision (CV) fields. However, researchers have…

Computation and Language · Computer Science 2023-09-27 Nayeon Lee , Yejin Bang , Holy Lovenia , Samuel Cahyawijaya , Wenliang Dai , Pascale Fung

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

Machine learning models that convert user-written text descriptions into images are now widely available online and used by millions of users to generate millions of images a day. We investigate the potential for these models to amplify…

We investigate the potential for nationality biases in natural language processing (NLP) models using human evaluation methods. Biased NLP models can perpetuate stereotypes and lead to algorithmic discrimination, posing a significant…

Computation and Language · Computer Science 2023-08-09 Pranav Narayanan Venkit , Sanjana Gautam , Ruchi Panchanadikar , Ting-Hao `Kenneth' Huang , Shomir Wilson

As robots increasingly enter the workforce, human-robot interaction (HRI) must address how implicit social biases influence user preferences. This paper investigates how users rationalize their selections of robots varying in skin tone and…

Robotics · Computer Science 2026-04-01 Jiangen He , Wanqi Zhang , Jessica K. Barfield

We explore social perception of human faces in CLIP, a widely used open-source vision-language model. To this end, we compare the similarity in CLIP embeddings between different textual prompts and a set of face images. Our textual prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Carina I. Hausladen , Manuel Knott , Colin F. Camerer , Pietro Perona

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Increasingly, software is making autonomous decisions in case of criminal sentencing, approving credit cards, hiring employees, and so on. Some of these decisions show bias and adversely affect certain social groups (e.g. those defined by…

Machine Learning · Computer Science 2021-07-12 Joymallya Chakraborty , Suvodeep Majumder , Tim Menzies

Automated computer vision systems have been applied in many domains including security, law enforcement, and personal devices, but recent reports suggest that these systems may produce biased results, discriminating against people in…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Jungseock Joo , Kimmo Kärkkäinen

In the rapidly advancing field of artificial intelligence, machine perception is becoming paramount to achieving increased performance. Image classification systems are becoming increasingly integral to various applications, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Javon Hickmon

The Vision-Language Pre-training (VLP) models like CLIP have gained popularity in recent years. However, many works found that the social biases hidden in CLIP easily manifest in downstream tasks, especially in image retrieval, which can…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Junyang Wang , Yi Zhang , Jitao Sang

Fairness in human-robot interaction critically depends on the reliability of the perceptual models that enable robots to interpret human behavior. While demographic biases have been widely studied in high-level facial analysis tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Pablo Parte , Roberto Valle , José M. Buenaposada , Luis Baumela

Nine language-vision AI models trained on web scrapes with the Contrastive Language-Image Pretraining (CLIP) objective are evaluated for evidence of a bias studied by psychologists: the sexual objectification of girls and women, which…

Computers and Society · Computer Science 2023-05-17 Robert Wolfe , Yiwei Yang , Bill Howe , Aylin Caliskan

Recent advances in machine learning leverage massive datasets of unlabeled images from the web to learn general-purpose image representations for tasks from image classification to face recognition. But do unsupervised computer vision…

Computers and Society · Computer Science 2021-01-28 Ryan Steed , Aylin Caliskan

Gender stereotypes are pervasive beliefs about individuals based on their gender that play a significant role in shaping societal attitudes, behaviours, and even opportunities. Recognizing the negative implications of gender stereotypes,…

Computation and Language · Computer Science 2024-04-19 Isar Nejadgholi , Kathleen C. Fraser , Anna Kerkhof , Svetlana Kiritchenko

Stereotype detection is a challenging and subjective task, as certain statements, such as "Black people like to play basketball," may not appear overtly toxic but still reinforce racial stereotypes. With the increasing prevalence of large…

Computation and Language · Computer Science 2024-11-19 Zekun Wu , Sahan Bulathwela , Maria Perez-Ortiz , Adriano Soares Koshiyama

Model-based evaluation metrics (e.g., CLIPScore and GPTScore) have demonstrated decent correlations with human judgments in various language generation tasks. However, their impact on fairness remains largely unexplored. It is widely…

Computation and Language · Computer Science 2023-11-06 Haoyi Qiu , Zi-Yi Dou , Tianlu Wang , Asli Celikyilmaz , Nanyun Peng

Here, I ask what we can learn about how gender affects how people engage with robots. I review 46 empirical studies of social robots, published 2018 or earlier, which report on the gender of their participants or the perceived or intended…

Robotics · Computer Science 2022-07-04 David Gray Widder

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

Computation and Language · Computer Science 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

Machine learning (ML) and artificial intelligence (AI) tools increasingly permeate every possible social, political, and economic sphere; sorting, taxonomizing and predicting complex human behaviour and social phenomena. However, from…

Computers and Society · Computer Science 2022-06-10 Abeba Birhane