English
Related papers

Related papers: Recipes for Safety in Open-domain Chatbots

200 papers

While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which…

Computation and Language · Computer Science 2023-10-24 Nicholas Meade , Spandana Gella , Devamanyu Hazarika , Prakhar Gupta , Di Jin , Siva Reddy , Yang Liu , Dilek Hakkani-Tür

Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we…

Computation and Language · Computer Science 2020-05-01 Stephen Roller , Emily Dinan , Naman Goyal , Da Ju , Mary Williamson , Yinhan Liu , Jing Xu , Myle Ott , Kurt Shuster , Eric M. Smith , Y-Lan Boureau , Jason Weston

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

Computation and Language · Computer Science 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

Dialogue safety problems severely limit the real-world deployment of neural conversational models and have attracted great research interests recently. However, dialogue safety problems remain under-defined and the corresponding dataset is…

Computation and Language · Computer Science 2022-04-05 Hao Sun , Guangxuan Xu , Jiawen Deng , Jiale Cheng , Chujie Zheng , Hao Zhou , Nanyun Peng , Xiaoyan Zhu , Minlie Huang

Open-domain conversation models have become good at generating natural-sounding dialogue, using very large architectures with billions of trainable parameters. The vast training data required to train these architectures aggregates many…

Computation and Language · Computer Science 2020-09-24 Eric Michael Smith , Diana Gonzalez-Rico , Emily Dinan , Y-Lan Boureau

Recent open-domain dialogue models have brought numerous breakthroughs. However, building a chat system is not scalable since it often requires a considerable volume of human-human dialogue data, especially when enforcing features such as…

Computation and Language · Computer Science 2022-05-03 Sanghwan Bae , Donghyun Kwak , Sungdong Kim , Donghoon Ham , Soyoung Kang , Sang-Woo Lee , Woomyoung Park

Stylistic variation is critical to render the utterances generated by conversational agents natural and engaging. In this paper, we focus on sequence-to-sequence models for open-domain dialogue response generation and propose a new method…

Computation and Language · Computer Science 2018-10-02 Yujie Xing , Raquel Fernández

Recent advances in natural language processing and machine learning have led to the development of chatbot models, such as ChatGPT, that can engage in conversational dialogue with human users. However, the ability of these models to…

Cryptography and Security · Computer Science 2023-07-20 Bocheng Chen , Guangjing Wang , Hanqing Guo , Yuanda Wang , Qiben Yan

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

Computation and Language · Computer Science 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

The predominant approach to open-domain dialog generation relies on end-to-end training of neural models on chat datasets. However, this approach provides little insight as to what these models learn (or do not learn) about engaging in…

Computation and Language · Computer Science 2020-08-04 Abdelrhman Saleh , Tovly Deutsch , Stephen Casper , Yonatan Belinkov , Stuart Shieber

As generative large model capabilities advance, safety concerns become more pronounced in their outputs. To ensure the sustainable growth of the AI ecosystem, it's imperative to undertake a holistic evaluation and refinement of associated…

Artificial Intelligence · Computer Science 2023-12-01 Jiawen Deng , Jiale Cheng , Hao Sun , Zhexin Zhang , Minlie Huang

The development of Open-Domain Dialogue Systems (ODS)is a trending topic due to the large number of research challenges, large societal and business impact, and advances in the underlying technology. However, the development of these kinds…

Computation and Language · Computer Science 2021-12-28 Chen Zhang , João Sedoc , Luis Fernando D'Haro , Rafael Banchs , Alexander Rudnicky

Dialogue safety remains a pervasive challenge in open-domain human-machine interaction. Existing approaches propose distinctive dialogue safety taxonomies and datasets for detecting explicitly harmful responses. However, these taxonomies…

Computation and Language · Computer Science 2023-08-01 Huachuan Qiu , Tong Zhao , Anqi Li , Shuai Zhang , Hongliang He , Zhenzhong Lan

Language Models (LMs) often cannot be deployed because of their potential to harm users in hard-to-predict ways. Prior work identifies harmful behaviors before deployment by using human annotators to hand-write test cases. However, human…

Computation and Language · Computer Science 2022-02-08 Ethan Perez , Saffron Huang , Francis Song , Trevor Cai , Roman Ring , John Aslanides , Amelia Glaese , Nat McAleese , Geoffrey Irving

The manual modeling of complex systems is a daunting task; and although a plethora of methods exist that mitigate this issue, the problem remains very difficult. Recent advances in generative AI have allowed the creation of general-purpose…

Software Engineering · Computer Science 2024-01-05 David Harel , Guy Katz , Assaf Marron , Smadar Szekely

Generative AI, including large language models (LLMs) have the potential -- and already are being used -- to increase the speed, scale, and types of unsafe conversations online. LLMs lower the barrier for entry for bad actors to create…

Human-Computer Interaction · Computer Science 2025-07-31 Owen Hoffman , Kangze Peng , Zehua You , Sajid Kamal , Sukrit Venkatagiri

Although deep learning models have brought tremendous advancements to the field of open-domain dialogue response generation, recent research results have revealed that the trained models have undesirable generation behaviors, such as…

Computation and Language · Computer Science 2020-08-19 Tianxing He , James Glass

The use of dialogue systems as a medium for human-machine interaction is an increasingly prevalent paradigm. A growing number of dialogue systems use conversation strategies that are learned from large datasets. There are well documented…

Computation and Language · Computer Science 2017-11-27 Peter Henderson , Koustuv Sinha , Nicolas Angelard-Gontier , Nan Rosemary Ke , Genevieve Fried , Ryan Lowe , Joelle Pineau

Language generation models' democratization benefits many domains, from answering health-related questions to enhancing education by providing AI-driven tutoring services. However, language generation models' democratization also makes it…

Computation and Language · Computer Science 2021-06-03 Paras Bhatt , Anthony Rios

We study open domain dialogue generation with dialogue acts designed to explain how people engage in social chat. To imitate human behavior, we propose managing the flow of human-machine interactions with the dialogue acts as policies. The…

Computation and Language · Computer Science 2018-07-23 Can Xu , Wei Wu , Yu Wu
‹ Prev 1 2 3 10 Next ›