English
Related papers

Related papers: Recipes for Safety in Open-domain Chatbots

200 papers

Dialogue systems, also called chatbots, are now used in a wide range of applications. However, they still have some major weaknesses. One key weakness is that they are typically trained from manually-labeled data and/or written with…

Computation and Language · Computer Science 2021-02-25 Bing Liu , Sahisnu Mazumder

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

Computation and Language · Computer Science 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

Recent work building open-domain chatbots has demonstrated that increasing model size improves performance. On the other hand, latency and connectivity considerations dictate the move of digital assistants on the device. Giving a digital…

Computation and Language · Computer Science 2022-04-11 Greyson Gerhard-Young , Raviteja Anantha , Srinivas Chappidi , Björn Hoffmeister

The detection of offensive language in the context of a dialogue has become an increasingly important application of natural language processing. The detection of trolls in public forums (Gal\'an-Garc\'ia et al., 2016), and the deployment…

Computation and Language · Computer Science 2019-08-20 Emily Dinan , Samuel Humeau , Bharath Chintagunta , Jason Weston

Open-domain chatbots are supposed to converse freely with humans without being restricted to a topic, task or domain. However, the boundaries and/or contents of open-domain conversations are not clear. To clarify the boundaries of…

Computation and Language · Computer Science 2022-11-28 A. Seza Doğruöz , Gabriel Skantze

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Despite important progress, conversational systems often generate dialogues that sound unnatural to humans. We conjecture that the reason lies in their different training and testing conditions: agents are trained in a controlled "lab"…

Computation and Language · Computer Science 2021-04-01 Alberto Testoni , Raffaella Bernardi

Current open-domain conversational models can easily be made to talk in inadequate ways. Online learning from conversational feedback given by the conversation partner is a promising avenue for a model to improve and adapt, so as to…

Computation and Language · Computer Science 2022-05-06 Megan Ung , Jing Xu , Y-Lan Boureau

As the capabilities of generative language models continue to advance, the implications of biases ingrained within these models have garnered increasing attention from researchers, practitioners, and the broader public. This article…

Computers and Society · Computer Science 2023-11-14 Emilio Ferrara

The emergence of Generative AI (Gen AI) and Large Language Models (LLMs) has enabled more advanced chatbots capable of human-like interactions. However, these conversational agents introduce a broader set of operational risks that extend…

Cryptography and Security · Computer Science 2025-05-09 Pedro Pinacho-Davidson , Fernando Gutierrez , Pablo Zapata , Rodolfo Vergara , Pablo Aqueveque

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

As generative models become ubiquitous, there is a critical need for fine-grained control over the generation process. Yet, while controlled generation methods from prompting to fine-tuning proliferate, a fundamental question remains…

Artificial Intelligence · Computer Science 2026-01-12 Emily Cheng , Carmen Amo Alonso , Federico Danieli , Arno Blaas , Luca Zappella , Pau Rodriguez , Xavier Suau

Chatbots are used in many applications, e.g., automated agents, smart home assistants, interactive characters in online games, etc. Therefore, it is crucial to ensure they do not behave in undesired manners, providing offensive or toxic…

Computers and Society · Computer Science 2022-09-12 Wai Man Si , Michael Backes , Jeremy Blackburn , Emiliano De Cristofaro , Gianluca Stringhini , Savvas Zannettou , Yang Zhang

Politically sensitive topics are still a challenge for open-domain chatbots. However, dealing with politically sensitive content in a responsible, non-partisan, and safe behavior way is integral for these chatbots. Currently, the main…

Computation and Language · Computer Science 2021-06-14 Yejin Bang , Nayeon Lee , Etsuko Ishii , Andrea Madotto , Pascale Fung

Recent work in open-domain conversational agents has demonstrated that significant improvements in model engagingness and humanness metrics can be achieved via massive scaling in both pre-training data and model size (Adiwardana et al.,…

Computation and Language · Computer Science 2020-10-05 Kurt Shuster , Eric Michael Smith , Da Ju , Jason Weston

Dialogue systems in the form of chatbots and personal assistants are being increasingly integrated into people's lives. Modern dialogue systems may consider adopting anthropomorphic personas, mimicking societal demographic groups to appear…

Computation and Language · Computer Science 2021-12-16 Emily Sheng , Josh Arnold , Zhou Yu , Kai-Wei Chang , Nanyun Peng

Neural dialog models are known to suffer from problems such as generating unsafe and inconsistent responses. Even though these problems are crucial and prevalent, they are mostly manually identified by model designers through interactions.…

Computation and Language · Computer Science 2021-09-16 Dian Yu , Kenji Sagae

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Automatically evaluating text-based, non-task-oriented dialogue systems (i.e., `chatbots') remains an open problem. Previous approaches have suffered challenges ranging from poor correlation with human judgment to poor generalization and…

Computation and Language · Computer Science 2021-04-14 Ian Berlot-Attwell , Frank Rudzicz

An important aspect of developing conversational agents is to give a bot the ability to improve through communicating with humans and to learn from the mistakes that it makes. Most research has focused on learning from fixed training sets…

Artificial Intelligence · Computer Science 2017-01-17 Jiwei Li , Alexander H. Miller , Sumit Chopra , Marc'Aurelio Ranzato , Jason Weston