English
Related papers

Related papers: On the Safety of Conversational Models: Taxonomy, …

200 papers

Dialogue safety remains a pervasive challenge in open-domain human-machine interaction. Existing approaches propose distinctive dialogue safety taxonomies and datasets for detecting explicitly harmful responses. However, these taxonomies…

Computation and Language · Computer Science 2023-08-01 Huachuan Qiu , Tong Zhao , Anqi Li , Shuai Zhang , Hongliang He , Zhenzhong Lan

While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which…

Computation and Language · Computer Science 2023-10-24 Nicholas Meade , Spandana Gella , Devamanyu Hazarika , Prakhar Gupta , Di Jin , Siva Reddy , Yang Liu , Dilek Hakkani-Tür

The research of open-domain dialog systems has been greatly prospered by neural models trained on large-scale corpora, however, such corpora often introduce various safety problems (e.g., offensive languages, biases, and toxic behaviors)…

Computation and Language · Computer Science 2022-10-31 Jingyan Zhou , Jiawen Deng , Fei Mi , Yitong Li , Yasheng Wang , Minlie Huang , Xin Jiang , Qun Liu , Helen Meng

Training dialogue systems often entails dealing with noisy training examples and unexpected user inputs. Despite their prevalence, there currently lacks an accurate survey of dialogue noise, nor is there a clear sense of the impact of each…

Computation and Language · Computer Science 2023-08-01 Derek Chen , Zhou Yu

Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these…

Computation and Language · Computer Science 2021-08-06 Jing Xu , Da Ju , Margaret Li , Y-Lan Boureau , Jason Weston , Emily Dinan

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

Computation and Language · Computer Science 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

State-of-the-art conversational AI systems raise concerns due to their potential risks of generating unsafe, toxic, unethical, or dangerous content. Previous works have developed datasets to teach conversational agents the appropriate…

Computation and Language · Computer Science 2024-02-02 Souvik Das , Rohini K. Srihari

The use of dialogue systems as a medium for human-machine interaction is an increasingly prevalent paradigm. A growing number of dialogue systems use conversation strategies that are learned from large datasets. There are well documented…

Computation and Language · Computer Science 2017-11-27 Peter Henderson , Koustuv Sinha , Nicolas Angelard-Gontier , Nan Rosemary Ke , Genevieve Fried , Ryan Lowe , Joelle Pineau

Accurate prediction of conversation topics can be a valuable signal for creating coherent and engaging dialog systems. In this work, we focus on context-aware topic classification methods for identifying topics in free-form human-chatbot…

Computation and Language · Computer Science 2018-10-22 Chandra Khatri , Rahul Goel , Behnam Hedayatnia , Angeliki Metanillou , Anushree Venkatesh , Raefer Gabriel , Arindam Mandal

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

Chat-based language models are designed to be helpful, yet they should not comply with every user request. While most existing work primarily focuses on refusal of "unsafe" queries, we posit that the scope of noncompliance should be…

During the past decade, several areas of speech and language understanding have witnessed substantial breakthroughs from the use of data-driven models. In the area of dialogue systems, the trend is less obvious, and most practical systems…

Computation and Language · Computer Science 2017-03-22 Iulian Vlad Serban , Ryan Lowe , Peter Henderson , Laurent Charlin , Joelle Pineau

The use of natural language interfaces in the field of human-computer interaction is undergoing intense study through dedicated scientific and industrial research. The latest contributions in the field, including deep learning approaches…

Computation and Language · Computer Science 2024-02-07 Quim Motger , Xavier Franch , Jordi Marco

Despite advancements in conversational AI, language models encounter challenges to handle diverse conversational tasks, and existing dialogue dataset collections often lack diversity and comprehensiveness. To tackle these issues, we…

Computation and Language · Computer Science 2024-02-06 Jianguo Zhang , Kun Qian , Zhiwei Liu , Shelby Heinecke , Rui Meng , Ye Liu , Zhou Yu , Huan Wang , Silvio Savarese , Caiming Xiong

Understanding what constitutes safe text is an important issue in natural language processing and can often prevent the deployment of models deemed harmful and unsafe. One such type of safety that has been scarcely studied is commonsense…

Computation and Language · Computer Science 2022-10-19 Sharon Levy , Emily Allaway , Melanie Subbiah , Lydia Chilton , Desmond Patton , Kathleen McKeown , William Yang Wang

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and…

Computation and Language · Computer Science 2020-03-31 Fabian Galetzka , Chukwuemeka U. Eneh , David Schlangen

Recent advancements in instruction-tuning datasets have predominantly focused on specific tasks like mathematical or logical reasoning. There has been a notable gap in data designed for aligning language models to maintain topic relevance…

Computation and Language · Computer Science 2024-06-24 Makesh Narsimhan Sreedhar , Traian Rebedea , Shaona Ghosh , Jiaqi Zeng , Christopher Parisien

As Large Language Models (LLMs) continue to advance in understanding and generating long sequences, new safety concerns have been introduced through the long context. However, the safety of LLMs in long-context tasks remains under-explored,…

Computation and Language · Computer Science 2025-02-25 Yida Lu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Cunxiang Wang , Xiaotao Gu , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

Recent advancements in model architectures and length extrapolation techniques have significantly extended the context length of large language models (LLMs), paving the way for their application in increasingly complex tasks. However,…

‹ Prev 1 2 3 10 Next ›