English
Related papers

Related papers: Intersectionality in Conversational AI Safety: How…

200 papers

Intersectionality is a framework that analyzes how interlocking systems of power and oppression affect individuals along overlapping dimensions including race, gender, sexual orientation, class, and disability. Intersectionality theory…

Machine Learning · Computer Science 2019-09-11 James Foulds , Rashidul Islam , Kamrun Keya , Shimei Pan

This study presents a unique framework that applies and extends Solove (2006)'s taxonomy to address privacy concerns in interactions with text-based AI chatbots. As chatbot prevalence grows, concerns about user privacy have heightened.…

Human-Computer Interaction · Computer Science 2024-02-16 Ece Gumusel , Kyrie Zhixuan Zhou , Madelyn Rose Sanfilippo

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

Artificial Intelligence · Computer Science 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

The emergence of Generative AI (Gen AI) and Large Language Models (LLMs) has enabled more advanced chatbots capable of human-like interactions. However, these conversational agents introduce a broader set of operational risks that extend…

Cryptography and Security · Computer Science 2025-05-09 Pedro Pinacho-Davidson , Fernando Gutierrez , Pablo Zapata , Rodolfo Vergara , Pablo Aqueveque

The widespread adoption of conversational AI platforms has introduced new security and privacy risks. While these risks and their mitigation strategies have been extensively researched from a technical perspective, users' perceptions of…

Cryptography and Security · Computer Science 2025-05-19 Mutahar Ali , Arjun Arunasalam , Habiba Farrukh

Given the rapid advancement of large-scale language models, artificial intelligence (AI) models, like ChatGPT, are playing an increasingly prominent role in human society. However, to ensure that artificial intelligence models benefit human…

Computation and Language · Computer Science 2024-05-07 Hang Yuan , Zhongyue Che , Shao Li , Yue Zhang , Xiaomeng Hu , Siyang Luo

As the capabilities of generative language models continue to advance, the implications of biases ingrained within these models have garnered increasing attention from researchers, practitioners, and the broader public. This article…

Computers and Society · Computer Science 2023-11-14 Emilio Ferrara

Conversational AI is increasingly deployed in emotionally charged and ethically sensitive interactions. Previous research has primarily concentrated on emotional benchmarks or static safety checks, overlooking how alignment unfolds in…

Computation and Language · Computer Science 2026-04-06 Jiawen Deng , Wentao Zhang , Ziyun Jiao , Fuji Ren

AI chatbots designed as emotional companions blur the boundaries between interpersonal intimacy and institutional software, creating a complex, multi-dimensional privacy environment. Drawing on Communication Privacy Management theory and…

Cryptography and Security · Computer Science 2026-01-19 Hsuen-Chi Chiu , Jeremy Foote

As a general purpose technology without a concrete pre-defined purpose, personal chatbots can be used for a whole range of objectives, depending on the personal needs, contexts, and tasks of an individual, and so potentially impact a…

Computers and Society · Computer Science 2024-05-01 Kimon Kieslich , Natali Helberger , Nicholas Diakopoulos

The rapid convergence of artificial intelligence (AI) toward conversational chatbot interfaces marks a critical moment for the industry. This paper argues that the chatbot paradigm is not a neutral interface choice, but a dominant…

Computers and Society · Computer Science 2026-05-11 Sourojit Ghosh , Pranav Narayanan Venkit , Sanjana Gautam , Avijit Ghosh

Older adults have increasingly turned to conversational AI as a source of emotional support. However, little is known about how emotionally supportive interactions are experienced in everyday use, particularly when AI systems limit,…

Human-Computer Interaction · Computer Science 2026-05-08 Mengqi Shi , Tianqi Song , Zicheng Zhu , Yi-Chieh Lee

Dialogue safety problems severely limit the real-world deployment of neural conversational models and have attracted great research interests recently. However, dialogue safety problems remain under-defined and the corresponding dataset is…

Computation and Language · Computer Science 2022-04-05 Hao Sun , Guangxuan Xu , Jiawen Deng , Jiale Cheng , Chujie Zheng , Hao Zhou , Nanyun Peng , Xiaoyan Zhu , Minlie Huang

This article explores the phenomenon of confirmation bias in generative AI chatbots, a relatively underexamined aspect of AI-human interaction. Drawing on cognitive psychology and computational linguistics, it examines how confirmation…

Human-Computer Interaction · Computer Science 2025-04-15 Yiran Du

As people increasingly seek emotional support and companionship from AI chatbots, understanding how such interactions impact mental well-being becomes critical. We conducted a four-week randomized controlled experiment (n=981, >300k…

As conversational AI systems increasingly permeate the socio-emotional realms of human life, they bring both benefits and risks to individuals and society. Despite extensive research on detecting and categorizing harms in AI systems, less…

Human-Computer Interaction · Computer Science 2026-05-06 Renwen Zhang , Han Li , Han Meng , Jinyuan Zhan , Hongyuan Gan , Yi-Chieh Lee

As artificial intelligence (AI) becomes more widespread, one question that arises is how human-AI interaction might impact human-human interaction. Chatbots, for example, are increasingly used as social companions, and while much is…

Human-Computer Interaction · Computer Science 2025-04-14 Rose E. Guingrich , Michael S. A. Graziano

While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which…

Computation and Language · Computer Science 2023-10-24 Nicholas Meade , Spandana Gella , Devamanyu Hazarika , Prakhar Gupta , Di Jin , Siva Reddy , Yang Liu , Dilek Hakkani-Tür

Conversational systems or chatbots are an example of AI-Infused Applications (AIIA). Chatbots are especially important as they are often the first interaction of clients with a business and are the entry point of a business into the AI…

Dialogue systems in the form of chatbots and personal assistants are being increasingly integrated into people's lives. Modern dialogue systems may consider adopting anthropomorphic personas, mimicking societal demographic groups to appear…

Computation and Language · Computer Science 2021-12-16 Emily Sheng , Josh Arnold , Zhou Yu , Kai-Wei Chang , Nanyun Peng