English
Related papers

Related papers: Evaluating Large Language Models through Gender an…

200 papers

In recent years, the rapid advancement of machine learning (ML) models, particularly transformer-based pre-trained models, has revolutionized Natural Language Processing (NLP) and Computer Vision (CV) fields. However, researchers have…

Computation and Language · Computer Science 2023-09-27 Nayeon Lee , Yejin Bang , Holy Lovenia , Samuel Cahyawijaya , Wenliang Dai , Pascale Fung

With the rise of human-machine communication, machines are increasingly designed with humanlike characteristics, such as gender, which can inadvertently trigger cognitive biases. Many conversational agents (CAs), such as voice assistants…

Human-Computer Interaction · Computer Science 2024-01-09 Weizi Liu

Language models have been shown to propagate social bias through their output, particularly in the representation of gender and ethnicity. This paper investigates gender and ethnicity biases in AI-generated occupational stories.…

Computation and Language · Computer Science 2025-09-08 Martha O. Dimgba , Sharon Oba , Ameeta Agrawal , Philippe J. Giabbanelli

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

Applications · Statistics 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe

From massive face-recognition-based surveillance and machine-learning-based decision systems predicting crime recidivism rates, to the move towards automated health diagnostic systems, artificial intelligence (AI) is being used in scenarios…

Computers and Society · Computer Science 2019-08-20 Timnit Gebru

This paper explores the nuanced landscape of generative AI (genAI), particularly focusing on neural network-based models like Large Language Models (LLMs). While genAI garners both optimistic enthusiasm and sceptical criticism, this work…

Computers and Society · Computer Science 2024-10-23 Ante Prodan , Jo-An Occhipinti , Rehez Ahlip , Goran Ujdur , Harris A. Eyre , Kyle Goosen , Luke Penza , Mark Heffernan

Warning: This paper may contain texts with uncomfortable content. Large Language Models (LLMs) have achieved remarkable performance in various tasks, including those involving multimodal data like speech. However, these models often exhibit…

Computation and Language · Computer Science 2025-05-22 Yi-Cheng Lin , Wei-Chih Chen , Hung-yi Lee

The pervasive spread of misinformation and disinformation in social media underscores the critical importance of detecting media bias. While robust Large Language Models (LLMs) have emerged as foundational tools for bias prediction,…

Computers and Society · Computer Science 2024-12-11 Luyang Lin , Lingzhi Wang , Jinsong Guo , Kam-Fai Wong

Multimodal large language models (MLLMs) have shown impressive capabilities across tasks involving both visual and textual modalities. However, growing concerns remain about their potential to encode and amplify gender bias, particularly in…

Computation and Language · Computer Science 2025-07-08 Yue Xu , Wenjie Wang

Spurious correlations were found to be an important factor explaining model performance in various NLP tasks (e.g., gender or racial artifacts), often considered to be ''shortcuts'' to the actual task. However, humans tend to similarly make…

Computation and Language · Computer Science 2025-08-25 Gili Lior , Gabriel Stanovsky

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Computation and Language · Computer Science 2025-05-28 Charaka Vinayak Kumar , Ashok Urlana , Gopichand Kanumolu , Bala Mallikarjunarao Garlapati , Pruthwik Mishra

While advances in fairness and alignment have helped mitigate overt biases exhibited by large language models (LLMs) when explicitly prompted, we hypothesize that these models may still exhibit implicit biases when simulating human…

Computation and Language · Computer Science 2025-01-30 Yuxuan Li , Hirokazu Shirado , Sauvik Das

This paper presents research on enhancements to Large Language Models (LLMs) through the addition of diversity in its generated outputs. Our study introduces a configuration of multiple LLMs which demonstrates the diversities capable with a…

Computation and Language · Computer Science 2025-08-05 Purva Prasad Gosavi , Vaishnavi Murlidhar Kulkarni , Alan F. Smeaton

This paper investigates the subtle and often concealed biases present in Large Language Models (LLMs), focusing on implicit biases that may remain despite passing explicit bias tests. Implicit biases are significant because they influence…

Computation and Language · Computer Science 2024-10-01 Serene Lim , María Pérez-Ortiz

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou

In subjective decision-making, where decisions are based on contextual interpretation, Large Language Models (LLMs) can be integrated to present users with additional rationales to consider. The diversity of these rationales is mediated by…

Human-Computer Interaction · Computer Science 2025-02-21 Paula Akemi Aoyagui , Kelsey Stemmler , Sharon Ferguson , Young-ho Kim , Anastasia Kuzminykh

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza

Scaling existing applications and solutions to multiple human languages has traditionally proven to be difficult, mainly due to the language-dependent nature of preprocessing and feature engineering techniques employed in traditional…

Computation and Language · Computer Science 2020-01-01 Xiaotong Liu , Yingbei Tong , Anbang Xu , Rama Akkiraju

Large language models (LLMs) have brought breakthroughs in tasks including translation, summarization, information retrieval, and language generation, gaining growing interest in the CHI community. Meanwhile, the literature shows…

Human-Computer Interaction · Computer Science 2024-03-05 Lu Wang , Max Song , Rezvaneh Rezapour , Bum Chul Kwon , Jina Huh-Yoo

Traditional discussions of bias in large language models focus on a conception of bias closely tied to unfairness, especially as affecting marginalized groups. Recent work raises the novel possibility of assessing the outputs of large…

Artificial Intelligence · Computer Science 2023-11-21 David Thorstad