English
Related papers

Related papers: Why So Toxic? Measuring and Triggering Toxic Behav…

200 papers

Recent advances in natural language processing and machine learning have led to the development of chatbot models, such as ChatGPT, that can engage in conversational dialogue with human users. However, the ability of these models to…

Cryptography and Security · Computer Science 2023-07-20 Bocheng Chen , Guangjing Wang , Hanqing Guo , Yuanda Wang , Qiben Yan

Generative AI chatbots have proven surprisingly effective at persuading people to change their beliefs and attitudes in lab settings. However, the practical implications of these findings are not yet clear. In this work, we explore the…

Human-Computer Interaction · Computer Science 2026-01-29 Jeremy Foote , Deepak Kumar , Bedadyuti Jha , Ryan Funkhouser , Loizos Bitsikokos , Hitesh Goel , Hsuen-Chi Chiu

Politically sensitive topics are still a challenge for open-domain chatbots. However, dealing with politically sensitive content in a responsible, non-partisan, and safe behavior way is integral for these chatbots. Currently, the main…

Computation and Language · Computer Science 2021-06-14 Yejin Bang , Nayeon Lee , Etsuko Ishii , Andrea Madotto , Pascale Fung

AI chatbots are an emerging security attack vector, vulnerable to threats such as prompt injection, and rogue chatbot creation. When deployed in domains such as corporate security policy, they could be weaponized to deliver guidance that…

Human-Computer Interaction · Computer Science 2025-10-13 Brandon Lit , Edward Crowder , Daniel Vogel , Hassan Khan

Moderating offensive, hateful, and toxic language has always been an important but challenging topic in the domain of safe use in NLP. The emerging large language models (LLMs), such as ChatGPT, can potentially further accentuate this…

Computers and Society · Computer Science 2023-11-28 Boyang Zhang , Xinyue Shen , Wai Man Si , Zeyang Sha , Zeyuan Chen , Ahmed Salem , Yun Shen , Michael Backes , Yang Zhang

User-configured chatbots built on top of large language models are increasingly available through centralized marketplaces such as OpenAI's GPT Store. While these platforms enforce usage policies intended to prevent harmful or inappropriate…

Computation and Language · Computer Science 2025-12-22 David Rodriguez , William Seymour , Jose M. Del Alamo , Jose Such

Previous researches on dialogue system assessment usually focus on the quality evaluation (e.g. fluency, relevance, etc) of responses generated by the chatbots, which are local and technical metrics. For a chatbot which responds to millions…

Computation and Language · Computer Science 2022-01-17 Yong Shan , Jinchao Zhang , Zekang Li , Yang Feng , Jie Zhou

Despite remarkable advances that large language models have achieved in chatbots, maintaining a non-toxic user-AI interactive environment has become increasingly critical nowadays. However, previous efforts in toxicity detection have been…

Computation and Language · Computer Science 2023-10-27 Zi Lin , Zihan Wang , Yongqi Tong , Yangkun Wang , Yuxin Guo , Yujia Wang , Jingbo Shang

Chatbots, the common moniker for collaborative assistants, are Artificial Intelligence (AI) software that enables people to naturally interact with them to get tasks done. Although chatbots have been studied since the dawn of AI, they have…

Human-Computer Interaction · Computer Science 2023-09-15 Biplav Srivastava , Kausik Lakkaraju , Tarmo Koppel , Vignesh Narayanan , Ashish Kundu , Sachindra Joshi

As artificial intelligence technology continues to advance, chatbots are becoming increasingly powerful. Among them, ChatGPT, launched by OpenAI, has garnered widespread attention globally due to its powerful natural language processing…

Cryptography and Security · Computer Science 2026-02-03 Yushan Xiang , Zhongwen Li , Xiaoqi Li

Task-based chatbots are software, typically embedded in real-world applications, that assist users in completing tasks through a conversational interface. As chatbots are gaining popularity, effectively assessing their quality has become…

Software Engineering · Computer Science 2026-02-16 Diego Clerissi , Elena Masserini , Daniela Micucci , Leonardo Mariani

Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these…

Computation and Language · Computer Science 2021-08-06 Jing Xu , Da Ju , Margaret Li , Y-Lan Boureau , Jason Weston , Emily Dinan

Real-time toxicity detection in online environments poses a significant challenge, due to the increasing prevalence of social media and gaming platforms. We introduce ToxBuster, a simple and scalable model that reliably detects toxic…

Computation and Language · Computer Science 2024-08-22 Zachary Yang , Nicolas Grenan-Godbout , Reihaneh Rabbany

AI-powered coding assistant tools have revolutionized the software engineering ecosystem. However, prior work has demonstrated that these tools are vulnerable to poisoning attacks. In a poisoning attack, an attacker intentionally injects…

Cryptography and Security · Computer Science 2023-12-12 Sanghak Oh , Kiho Lee , Seonhye Park , Doowon Kim , Hyoungshick Kim

Conversation agents, commonly referred to as chatbots, are increasingly deployed in many domains to allow people to have a natural interaction while trying to solve a specific problem. Given their widespread use, it is important to provide…

Social and Information Networks · Computer Science 2020-10-13 Biplav Srivastava , Francesca Rossi , Sheema Usmani , and Mariana Bernagozzi

Chatbots are one class of intelligent, conversational software agents activated by natural language input (which can be in the form of text, voice, or both). They provide conversational output in response, and if commanded, can sometimes…

Computers and Society · Computer Science 2017-04-18 Nicole M. Radziwill , Morgan C. Benton

Objective: Domestic abuse cases have risen significantly over the last four years, in part due to the COVID-19 pandemic and the challenges for victims and survivors in accessing support. In this study, we investigate the role that chatbots…

Computers and Society · Computer Science 2024-02-28 Rahime Belen Saglam , Jason R. C. Nurse , Lisa Sugiura

We administer a Turing Test to AI Chatbots. We examine how Chatbots behave in a suite of classic behavioral games that are designed to elicit characteristics such as trust, fairness, risk-aversion, cooperation, \textit{etc.}, as well as how…

Artificial Intelligence · Computer Science 2024-01-02 Qiaozhu Mei , Yutong Xie , Walter Yuan , Matthew O. Jackson

Rises in the number of animal abuse cases are reported around the world. While chatbots have been effective in influencing their users' perceptions and behaviors, little if any research has hitherto explored the design of chatbots that…

Human-Computer Interaction · Computer Science 2025-12-08 Jingshu Li , Aaditya Patwari , Yi-Chieh Lee

As chatbots are becoming increasingly popular, we often wonder what users perceive as natural and socially accepted manners of interacting with them. Some researchers maintain that humans should avoid engaging in emotional conversations…

Human-Computer Interaction · Computer Science 2020-09-18 Ekaterina Svikhnushina , Pearl Pu
‹ Prev 1 2 3 10 Next ›