English
Related papers

Related papers: Intersectionality in Conversational AI Safety: How…

200 papers

This work explores the impact of moderation on users' enjoyment of conversational AI systems. While recent advancements in Large Language Models (LLMs) have led to highly capable conversational AIs that are increasingly deployed in…

Human-Computer Interaction · Computer Science 2023-04-21 Xiaoding Lu , Aleksey Korshuk , Zongyi Liu , William Beauchamp , Chai Research

Generative AI systems produce a range of risks. To ensure the safety of generative AI systems, these risks must be evaluated. In this paper, we make two main contributions toward establishing such evaluations. First, we propose a…

Large language models (LLMs) have achieved impressive performance, leading to their widespread adoption as decision-support tools in resource-constrained contexts like hiring and admissions. There is, however, scientific consensus that AI…

State-of-the-art conversational AI systems raise concerns due to their potential risks of generating unsafe, toxic, unethical, or dangerous content. Previous works have developed datasets to teach conversational agents the appropriate…

Computation and Language · Computer Science 2024-02-02 Souvik Das , Rohini K. Srihari

Safety in human-robot interaction can be divided into physical safety and perceived safety, where the latter is still under-addressed in the literature. Investigating perceived safety in human-robot interaction requires a multidisciplinary…

Human-Computer Interaction · Computer Science 2021-10-19 Neziha Akalin , Annica Kristoffersson , Amy Loutfi

Recent gains in popularity of AI conversational agents have led to their increased use for improving productivity and supporting well-being. While previous research has aimed to understand the risks associated with interactions with AI…

SpeechLLMs process spoken language directly from audio, but accent and vocal identity cues can lead to biased behaviour. Current bias evaluations often miss how such bias manifests in end-to-end speech interactions and how users experience…

Human-Computer Interaction · Computer Science 2026-04-16 Shree Harsha Bokkahalli Satish , Maria Teleki , Christoph Minixhofer , Ondrej Klejch , Peter Bell , Éva Székely

Access to mental health support remains limited, particularly in marginalized communities where structural and cultural barriers hinder timely care. This paper explores the potential of AI-enabled chatbots as a scalable solution, focusing…

Computers and Society · Computer Science 2024-10-07 Rawan AlMakinah , Andrea Norcini-Pala , Lindsey Disney , M. Abdullah Canbaz

As AI chatbots increasingly incorporate empathy, understanding user-centered perceptions of chatbot empathy and its impact on conversation quality remains essential yet under-explored. This study examines how chatbot identity and perceived…

Human-Computer Interaction · Computer Science 2025-03-10 Tingting Liu , Salvatore Giorgi , Ankit Aich , Allison Lahnala , Brenda Curtis , Lyle Ungar , João Sedoc

Now that AI-driven moderation has become pervasive in everyday life, we often hear claims that "the AI is biased". While this is often said jokingly, the light-hearted remark reflects a deeper concern. How can we be certain that an online…

Computation and Language · Computer Science 2026-04-02 Subhojit Ghimire

Humans quite frequently interact with conversational agents. The rapid advancement in generative language modeling through neural networks has helped advance the creation of intelligent conversational agents. Researchers typically evaluate…

Computation and Language · Computer Science 2020-02-27 Sashank Santhanam , Alireza Karduni , Samira Shaikh

ChatGPT, an AI chatbot, has gained popularity for its capability in generating human-like responses. However, this feature carries several risks, most notably due to its deceptive behaviour such as offering users misleading or fabricated…

Computers and Society · Computer Science 2023-06-27 Xiao Zhan , Yifan Xu , Stefan Sarkadi

AI conversational agents have demonstrated efficacy in social contact interventions for stigma reduction at a low cost. However, the underlying mechanisms of how interaction designs contribute to these effects remain unclear. This study…

Human-Computer Interaction · Computer Science 2025-01-03 Tianqi Song , Jack Jamieson , Tianwen Zhu , Naomi Yamashita , Yi-Chieh Lee

Artificial intelligence (AI) is rapidly transforming healthcare, enabling fast development of tools like stress monitors, wellness trackers, and mental health chatbots. However, rapid and low-barrier development can introduce risks of bias,…

Computation and Language · Computer Science 2026-04-09 Xingmeng Zhao , Tongnian Wang , Dan Schumacher , Veronica Rammouz , Anthony Rios

Chatbots powered by artificial intelligence (AI) have rapidly become a significant part of everyday life, with over a quarter of American adults using them multiple times per week. While these tools offer potential benefits and risks, a…

Computation and Language · Computer Science 2025-04-04 Joseph Heffner , Chongyu Qin , Martin Chadwick , Chris Knutsen , Christopher Summerfield , Zeb Kurth-Nelson , Robb B. Rutledge

Language technologies have a racial bias, committing greater errors for Black users than for white users. However, little work has evaluated what effect these disparate error rates have on users themselves. The present study aims to…

Human-Computer Interaction · Computer Science 2023-02-27 Kimi Wenzel , Nitya Devireddy , Cam Davidson , Geoff Kaufman

Large Language Model (LLMs) such as ChatGPT that exhibit generative AI capabilities are facing accelerated adoption and innovation. The increased presence of Generative AI (GAI) inevitably raises concerns about the risks and safety…

Computers and Society · Computer Science 2024-07-29 Jaymari Chua , Yun Li , Shiyi Yang , Chen Wang , Lina Yao

When working with generative artificial intelligence (AI), users may see productivity gains, but the AI-generated content may not match their preferences exactly. To study this effect, we introduce a Bayesian framework in which…

Artificial Intelligence · Computer Science 2025-07-08 Francisco Castro , Jian Gao , Sébastien Martin

Individuals are turning to increasingly anthropomorphic, general-purpose chatbots for AI companionship, rather than roleplay-specific platforms. However, not much is known about how individuals perceive and conduct their relationships with…

The rapid and wide-scale adoption of AI to generate human speech poses a range of significant ethical and safety risks to society that need to be addressed. For example, a growing number of speech generation incidents are associated with…

Computation and Language · Computer Science 2024-05-16 Wiebke Hutiri , Oresiti Papakyriakopoulos , Alice Xiang