English
Related papers

Related papers: Computer says 'no': Exploring systemic bias in Cha…

200 papers

As a natural language assistant, ChatGPT is capable of performing various tasks, including but not limited to article generation, code completion, and data analysis. Furthermore, ChatGPT has consistently demonstrated a remarkable level of…

Computation and Language · Computer Science 2023-03-15 Yunjie Ji , Yan Gong , Yiping Peng , Chao Ni , Peiyan Sun , Dongyu Pan , Baochang Ma , Xiangang Li

Large Language Models (LLMs) have taken the world by storm, demonstrating their ability not only to automate tedious tasks, but also to show some degree of proficiency in completing software engineering tasks. A key concern with LLMs is…

Software Engineering · Computer Science 2025-01-15 Takashi Nakano , Kazumasa Shimari , Raula Gaikovina Kula , Christoph Treude , Marc Cheong , Kenichi Matsumoto

Hundreds of millions of people now interact with language models, with uses ranging from serving as a writing aid to informing hiring decisions. Yet these language models are known to perpetuate systematic racial prejudices, making their…

Computation and Language · Computer Science 2024-03-04 Valentin Hofmann , Pratyusha Ria Kalluri , Dan Jurafsky , Sharese King

Chatbots have been studied for more than half a century. With the rapid development of natural language processing (NLP) technologies in recent years, chatbots using large language models (LLMs) have received much attention nowadays.…

Computation and Language · Computer Science 2023-12-12 Jintang Xue , Yun-Cheng Wang , Chengwei Wei , Xiaofeng Liu , Jonghye Woo , C. -C. Jay Kuo

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

Machine Learning · Computer Science 2024-04-04 Anna Kruspe

AI-based systems such as language models have been shown to replicate and even amplify social biases reflected in their training data. Among other questionable behaviors, this can lead to AI-generated text--and text suggestions--that…

Computation and Language · Computer Science 2026-02-19 Connor Baumler , Hal Daumé

Chatbots are often designed to mimic social roles attributed to humans. However, little is known about the impact on user's perceptions of using language that fails to conform to the associated social role. Our research draws on…

Human-Computer Interaction · Computer Science 2024-01-24 Ana Paula Chaves , Jesse Egbert , Toby Hocking , Eck Doerry , Marco Aurelio Gerosa

We investigate how people perceive ChatGPT, and, in particular, how they assign human-like attributes such as gender to the chatbot. Across five pre-registered studies (N = 1,552), we find that people are more likely to perceive ChatGPT to…

Human-Computer Interaction · Computer Science 2023-05-23 Jared Wong , Jin Kim

LLMs have emerged as a promising tool for assisting individuals in diverse text-generation tasks, including job-related texts. However, LLM-generated answers have been increasingly found to exhibit gender bias. This study evaluates three…

Computation and Language · Computer Science 2024-12-02 Haein Kong , Yongsu Ahn , Sangyub Lee , Yunho Maeng

Gender bias in machine translation (MT) systems has been extensively documented, but bias in automatic quality estimation (QE) metrics remains comparatively underexplored. Existing studies suggest that QE metrics can also exhibit gender…

Computation and Language · Computer Science 2025-10-09 Giorgos Filandrianos , Orfeas Menis Mastromichalakis , Wafaa Mohammed , Giuseppe Attanasio , Chrysoula Zerva

I investigate bias in terms of ChatGPT's college major recommendations for students with various profiles, looking at demographic disparities in factors such as race, gender, and socioeconomic status, as well as educational disparities such…

Computers and Society · Computer Science 2024-01-23 Alex Zheng

ChatGPT has the ability to generate grammatically flawless and seemingly-human replies to different types of questions from various domains. The number of its users and of its applications is growing at an unprecedented rate. Unfortunately,…

Computation and Language · Computer Science 2023-02-01 Sandra Mitrović , Davide Andreoletti , Omran Ayoub

This paper investigates the empathetic responding capabilities of ChatGPT, particularly its latest iteration, GPT-4, in comparison to human-generated responses to a wide range of emotional scenarios, both positive and negative. We employ a…

Human-Computer Interaction · Computer Science 2024-03-12 Anuradha Welivita , Pearl Pu

Recommendation systems have witnessed significant advancements and have been widely used over the past decades. However, most traditional recommendation methods are task-specific and therefore lack efficient generalization ability.…

Information Retrieval · Computer Science 2023-10-30 Junling Liu , Chao Liu , Peilin Zhou , Renjie Lv , Kang Zhou , Yan Zhang

ChatGPT is a natural language processing tool that can engage in human-like conversations and generate coherent and contextually relevant responses to various prompts. ChatGPT is capable of understanding natural text that is input by a user…

Human-Computer Interaction · Computer Science 2024-09-02 Sara Amani , Lance White , Trini Balart , Laksha Arora , Kristi J. Shryock , Kelly Brumbelow , Karan L. Watson

Causal networks are widely used in many fields, including epidemiology, social science, medicine, and engineering, to model the complex relationships between variables. While it can be convenient to algorithmically infer these models…

Artificial Intelligence · Computer Science 2023-12-29 Yanming Zhang , Brette Fitzgibbon , Dino Garofolo , Akshith Kota , Eric Papenhausen , Klaus Mueller

Human gender bias is reflected in language and text production. Because state-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans, gender bias can also be found in MT. For instance…

Computation and Language · Computer Science 2021-07-27 Jonas-Dario Troles , Ute Schmid

The dynamics of human-AI communication have been reshaped by language models such as ChatGPT. However, extant research has primarily focused on dyadic communication, leaving much to be explored regarding the dynamics of human-AI…

Human-Computer Interaction · Computer Science 2024-07-01 Sion Yoon , Tae Eun Kim , Yoo Jung Oh

Over the last few years, large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) that fundamentally transform research and developments in the field. ChatGPT represents one of the…

Computation and Language · Computer Science 2023-04-13 Viet Dac Lai , Nghia Trung Ngo , Amir Pouran Ben Veyseh , Hieu Man , Franck Dernoncourt , Trung Bui , Thien Huu Nguyen

ChatGPT's emergence heralds a transformative phase in NLP, particularly demonstrated through its excellent performance on many English benchmarks. However, the model's efficacy across diverse linguistic contexts remains largely uncharted…

Computation and Language · Computer Science 2023-10-24 Md Tawkat Islam Khondaker , Abdul Waheed , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed