English
Related papers

Related papers: Why So Toxic? Measuring and Triggering Toxic Behav…

200 papers

Social bots play a significant role in many online social networks (OSN) as they imitate human behavior. This fact raises difficult questions about their capabilities and potential risks. Given the recent advances in Generative AI (GenAI),…

Social and Information Networks · Computer Science 2024-05-06 Shaghayegh Najari , Davood Rafiee , Mostafa Salehi , Reza Farahbakhsh

ChatGPT, an AI chatbot, has gained popularity for its capability in generating human-like responses. However, this feature carries several risks, most notably due to its deceptive behaviour such as offering users misleading or fabricated…

Computers and Society · Computer Science 2023-06-27 Xiao Zhan , Yifan Xu , Stefan Sarkadi

Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks…

Computation and Language · Computer Science 2024-04-29 Lingyao Li , Lizhou Fan , Shubham Atreja , Libby Hemphill

Chatbots shifted from rule-based to artificial intelligence techniques and gained traction in medicine, shopping, customer services, food delivery, education, and research. OpenAI developed ChatGPT blizzard on the Internet as it crossed one…

Cryptography and Security · Computer Science 2023-06-16 Attia Qammar , Hongmei Wang , Jianguo Ding , Abdenacer Naouri , Mahmoud Daneshmand , Huansheng Ning

Online harms are a growing problem in digital spaces, putting user safety at risk and reducing trust in social media platforms. One of the most persistent forms of harm is hate speech. To address this, we need tools that combine the speed…

Computation and Language · Computer Science 2025-09-03 Paloma Piot , Diego Sánchez , Javier Parapar

Common problems in playing online mobile and computer games were related to toxic behavior and abusive communication among players. Based on different reports and studies, the study also discusses the impact of online hate speech and…

Computation and Language · Computer Science 2024-03-28 Daniel Fesalbon , Arvin De La Cruz , Marvin Mallari , Nelson Rodelas

As mental health chatbots proliferate to address the global treatment gap, a critical question emerges: How do we design for relational safety the quality of interaction patterns that unfold across conversations rather than the correctness…

Human-Computer Interaction · Computer Science 2026-02-27 Joydeep Chandra , Satyam Kumar Navneet , Yong Zhang

As artificial intelligence (AI) becomes more widespread, one question that arises is how human-AI interaction might impact human-human interaction. Chatbots, for example, are increasingly used as social companions, and while much is…

Human-Computer Interaction · Computer Science 2025-04-14 Rose E. Guingrich , Michael S. A. Graziano

This paper delves into the realm of ChatGPT, an AI-powered chatbot that utilizes topic modeling and reinforcement learning to generate natural responses. Although ChatGPT holds immense promise across various industries, such as customer…

Cryptography and Security · Computer Science 2023-07-27 Xiaodong Wu , Ran Duan , Jianbing Ni

Existing emotion-aware conversational models usually focus on controlling the response contents to align with a specific emotion class, whereas empathy is the ability to understand and concern the feelings and experience of others. Hence,…

Computation and Language · Computer Science 2021-05-26 Yanran Li , Ke Li , Hongke Ning , xiaoqiang Xia , Yalong Guo , Chen Wei , Jianwei Cui , Bin Wang

Recent advances in large language models (LLMs) have led to the development of powerful AI chatbots capable of engaging in natural and human-like conversations. However, these chatbots can be potentially harmful, exhibiting manipulative,…

Artificial Intelligence · Computer Science 2023-04-04 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi , Kush R. Varshney

Fostering a collaborative and inclusive environment is crucial for the sustained progress of open source development. However, the prevalence of negative discourse, often manifested as toxic comments, poses significant challenges to…

Software Engineering · Computer Science 2023-12-21 Shyamal Mishra , Preetha Chatterjee

Artificially intelligent chatbot, such as ChatGPT, represents a recent and powerful advancement in the AI domain. Users prefer them for obtaining quick and precise answers, avoiding the usual hassle of clicking through multiple links in…

Artificial Intelligence · Computer Science 2023-11-01 Seraj A. M. Mostafa , Md Z. Islam , Mohammad Z. Islam , Fairose Jeehan , Saujanna Jafreen , Raihan U. Islam

Mental health concerns are rising globally, prompting increased reliance on technology to address the demand-supply gap in mental health services. In particular, mental health chatbots are emerging as a promising solution, but these remain…

Human-Computer Interaction · Computer Science 2026-01-23 Shreya Haran , Samiha Thatikonda , Dong Whi Yoo , Koustuv Saha

Large language models (LLMs) have shown incredible capabilities and transcended the natural language processing (NLP) community, with adoption throughout many services like healthcare, therapy, education, and customer service. Since users…

Computation and Language · Computer Science 2023-04-12 Ameet Deshpande , Vishvak Murahari , Tanmay Rajpurohit , Ashwin Kalyan , Karthik Narasimhan

Toxicity in bug report discussions poses significant challenges to the collaborative dynamics of open-source software development. Bug reports are crucial for identifying and resolving defects, yet their inherently problem-focused nature…

Software Engineering · Computer Science 2025-05-05 Mia Mohammad Imran , Jaydeb Sarker

Companion chatbots offer a potential solution to the growing epidemic of loneliness, but their impact on users' psychosocial well-being remains poorly understood, raising critical ethical questions about their deployment and design. This…

Human-Computer Interaction · Computer Science 2025-08-12 Auren R. Liu , Pat Pataranutaporn , Pattie Maes

The emergence of Generative AI (Gen AI) and Large Language Models (LLMs) has enabled more advanced chatbots capable of human-like interactions. However, these conversational agents introduce a broader set of operational risks that extend…

Cryptography and Security · Computer Science 2025-05-09 Pedro Pinacho-Davidson , Fernando Gutierrez , Pablo Zapata , Rodolfo Vergara , Pablo Aqueveque

Introduction: The use of chatbots is becoming increasingly important across various aspects of daily life. However, the privacy concerns associated with these communications have not yet been thoroughly addressed. The aim of this study was…

Human-Computer Interaction · Computer Science 2025-08-12 Julia Ive , Vishal Yadav , Mariia Ignashina , Matthew Rand , Paulina Bondaronek

Millions of patients are already using large language model (LLM) chatbots for medical advice on a regular basis, raising patient safety concerns. This physician-led red-teaming study compares the safety of four publicly available…