English
Related papers

Related papers: Recipes for Safety in Open-domain Chatbots

200 papers

Chatbots have the risk of generating offensive utterances, which must be avoided. Post-deployment, one way for a chatbot to continuously improve is to source utterance/label pairs from feedback by live users. However, among users are…

Computation and Language · Computer Science 2023-10-31 Michael John Ilagan

Recent advances in large language models (LLMs) have led to the development of powerful AI chatbots capable of engaging in natural and human-like conversations. However, these chatbots can be potentially harmful, exhibiting manipulative,…

Artificial Intelligence · Computer Science 2023-04-04 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi , Kush R. Varshney

With the availability of massive general-domain dialogue data, pre-trained dialogue generation appears to be super appealing to transfer knowledge from the general domain to downstream applications. In most existing work, such transferable…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Lemao Liu , Tingchen Fu , Shuming Shi , Dongyan Zhao , Rui Yan

We demonstrate that large language models are able to simulate Task Oriented Dialogues in novel domains, provided only with an API implementation and a list of goals. We show these simulations can formulate online, automatic metrics that…

Computation and Language · Computer Science 2021-10-14 Moya Chen , Paul A. Crook , Stephen Roller

Large Language Models (LLMs) are known to be vulnerable to backdoor attacks, where triggers embedded in poisoned samples can maliciously alter LLMs' behaviors. In this paper, we move beyond attacking LLMs and instead examine backdoor…

Cryptography and Security · Computer Science 2025-02-18 Huaizhi Ge , Yiming Li , Qifan Wang , Yongfeng Zhang , Ruixiang Tang

This study presents a unique framework that applies and extends Solove (2006)'s taxonomy to address privacy concerns in interactions with text-based AI chatbots. As chatbot prevalence grows, concerns about user privacy have heightened.…

Human-Computer Interaction · Computer Science 2024-02-16 Ece Gumusel , Kyrie Zhixuan Zhou , Madelyn Rose Sanfilippo

Generative AI chatbots have proven surprisingly effective at persuading people to change their beliefs and attitudes in lab settings. However, the practical implications of these findings are not yet clear. In this work, we explore the…

Human-Computer Interaction · Computer Science 2026-01-29 Jeremy Foote , Deepak Kumar , Bedadyuti Jha , Ryan Funkhouser , Loizos Bitsikokos , Hitesh Goel , Hsuen-Chi Chiu

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

Computation and Language · Computer Science 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini

Chatbots based on large language models offer cheap conversation practice opportunities for language learners. However, they are hard to control for linguistic forms that correspond to learners' current needs, such as grammar. We control…

Computation and Language · Computer Science 2025-02-12 Dominik Glandorf , Peng Cui , Detmar Meurers , Mrinmaya Sachan

Dialogue state modules are a useful component in a task-oriented dialogue system. Traditional methods find dialogue states by manually labeling training corpora, upon which neural models are trained. However, the labeling process can be…

Computation and Language · Computer Science 2020-08-14 Qingkai Min , Libo Qin , Zhiyang Teng , Xiao Liu , Yue Zhang

Despite the multi-turn open-domain dialogue systems have attracted more and more attention and made great progress, the existing dialogue systems are still very boring. Nearly all the existing dialogue models only provide a response when…

Computation and Language · Computer Science 2019-12-23 Tian Lan , Xianling Mao , Heyan Huang , Wei Wei

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

Training dialogue systems often entails dealing with noisy training examples and unexpected user inputs. Despite their prevalence, there currently lacks an accurate survey of dialogue noise, nor is there a clear sense of the impact of each…

Computation and Language · Computer Science 2023-08-01 Derek Chen , Zhou Yu

This thesis investigates the controllability of deep learning-based, end-to-end, generative dialogue systems in both task-oriented and chit-chat scenarios. In particular, we study the different aspects of controlling generative dialogue…

Computation and Language · Computer Science 2021-08-25 Andrea Madotto

Progress in natural language generation research has been shaped by the ever-growing size of language models. While large language models pre-trained on web data can generate human-sounding text, they also reproduce social biases and…

Computation and Language · Computer Science 2023-06-06 Celine Wald , Lukas Pfahler

Neural generative models have been become increasingly popular when building conversational agents. They offer flexibility, can be easily adapted to new domains, and require minimal domain engineering. A common criticism of these systems is…

Computation and Language · Computer Science 2019-07-29 Chinnadhurai Sankar , Sandeep Subramanian , Christopher Pal , Sarath Chandar , Yoshua Bengio

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and…

Computation and Language · Computer Science 2023-09-26 Tong Wu , Hao Wang , Zhongshen Zeng , Wei Wang , Hai-Tao Zheng , Jiaxing Zhang

Safety fine-tuning helps align Large Language Models (LLMs) with human preferences for their safe deployment. To better understand the underlying factors that make models safe via safety fine-tuning, we design a synthetic data generation…

Machine Learning · Computer Science 2024-08-22 Samyak Jain , Ekdeep Singh Lubana , Kemal Oksuz , Tom Joy , Philip H. S. Torr , Amartya Sanyal , Puneet K. Dokania

Utilizing Large Language Models (LLMs) facilitates the creation of flexible and natural dialogues, a task that has been challenging with traditional rule-based dialogue systems. However, LLMs also have the potential to produce unexpected…