中文
相关论文

相关论文: Recipes for Safety in Open-domain Chatbots

200 篇论文

Automatic evaluation of open-domain dialogue response generation is very challenging because there are many appropriate responses for a given context. Existing evaluation models merely compare the generated response with the ground truth…

计算与语言 · 计算机科学 2020-06-15 JinYeong Bak , Alice Oh

We investigate the task of modeling open-domain, multi-turn, unstructured, multi-participant, conversational dialogue. We specifically study the effect of incorporating different elements of the conversation. Unlike previous efforts, which…

计算与语言 · 计算机科学 2016-06-02 Rami Al-Rfou , Marc Pickett , Javier Snaider , Yun-hsuan Sung , Brian Strope , Ray Kurzweil

Building open-domain dialogue systems capable of rich human-like conversational ability is one of the fundamental challenges in language generation. However, even with recent advancements in the field, existing open-domain generative models…

计算与语言 · 计算机科学 2022-06-14 Ritvik Choudhary , Daisuke Kawahara

Context: Online collaborative creation of models is becoming commonplace. Collaborative modeling using chatbots and natural language may lower the barriers to modeling for users from different domains. Objective: We compare the perceived…

人机交互 · 计算机科学 2024-08-27 Ranci Ren , John W. Castro , Santiago R. Acuña , Oscar Dieste , Silvia T. Acuña

Conversational large language models are trained to refuse to answer harmful questions. However, emergent jailbreaking techniques can still elicit unsafe outputs, presenting an ongoing challenge for model alignment. To better understand how…

计算与语言 · 计算机科学 2024-10-08 Sarah Ball , Frauke Kreuter , Nina Panickssery

While communication strategies of Large Language Models (LLMs) are crucial for human-LLM interactions, they can also be weaponized to elicit private information, yet such stealthy attacks remain under-explored. This paper introduces the…

人机交互 · 计算机科学 2025-11-18 Shuning Zhang , Jiaqi Bai , Linzhi Wang , Shixuan Li , Xin Yi , Hewu Li

Conversational grounding is a collaborative mechanism for establishing mutual knowledge among participants engaged in a dialogue. This experimental study analyzes information-seeking conversations to investigate the capabilities of large…

计算与语言 · 计算机科学 2024-06-05 Kristiina Jokinen , Phillip Schneider , Taiga Mori

Dialogue models are able to generate coherent and fluent responses, but they can still be challenging to control and may produce non-engaging, unsafe results. This unpredictability diminishes user trust and can hinder the use of the models…

Much literature has shown that prompt-based learning is an efficient method to make use of the large pre-trained language model. Recent works also exhibit the possibility of steering a chatbot's output by plugging in an appropriate prompt.…

计算与语言 · 计算机科学 2022-10-14 Hsuan Su , Pohan Chi , Shih-Cheng Huang , Chung Ho Lam , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

This study explores real-world human interactions with large language models (LLMs) in diverse, unconstrained settings in contrast to most prior research focusing on ethically trimmed models like ChatGPT for specific tasks. We aim to…

人机交互 · 计算机科学 2024-07-09 Johannes Schneider , Arianna Casanova Flores , Anne-Catherine Kranz

Autonomous vehicles currently suffer from a time-inefficient driving style caused by uncertainty about human behavior in traffic interactions. Accurate and reliable prediction models enabling more efficient trajectory planning could make…

机器人学 · 计算机科学 2023-02-21 Julian Frederik Schumann , Jens Kober , Arkady Zgonnikov

With the increasing prevalence and diversity of robots interacting in the real world, there is need for flexible, on-the-fly planning and cooperation. Large Language Models are starting to be explored in a multimodal setup for…

机器人学 · 计算机科学 2024-03-01 William Hunt , Toby Godfrey , Mohammad D. Soorati

We present on-going work of evaluating the, to our knowledge, first large generative language model trained to converse in Swedish, using data from the online discussion forum Flashback. We conduct a human evaluation pilot study that…

计算与语言 · 计算机科学 2021-04-13 Tobias Norlund , Agnes Stenbom

We propose an online, end-to-end, neural generative conversational model for open-domain dialogue. It is trained using a unique combination of offline two-phase supervised learning and online human-in-the-loop active learning. While most…

计算与语言 · 计算机科学 2017-06-19 Nabiha Asghar , Pascal Poupart , Xin Jiang , Hang Li

Knowledge-grounded dialogue systems are intended to convey information that is based on evidence provided in a given source text. We discuss the challenges of training a generative neural dialogue model for such systems that is controlled…

计算与语言 · 计算机科学 2021-07-16 Hannah Rashkin , David Reitter , Gaurav Singh Tomar , Dipanjan Das

The overarching research direction of this work is the development of a ''Responsible Intelligence'' framework designed to reconcile the immense generative power of Large Language Models (LLMs) with the stringent requirements of real-world…

计算与语言 · 计算机科学 2026-02-17 Somnath Banerjee

Human-in-the-loop topic modelling incorporates users' knowledge into the modelling process, enabling them to refine the model iteratively. Recent research has demonstrated the value of user feedback, but there are still issues to consider,…

计算与语言 · 计算机科学 2023-04-05 Zheng Fang , Lama Alqazlan , Du Liu , Yulan He , Rob Procter

Social chatbots, also known as chit-chat chatbots, evolve rapidly with large pretrained language models. Despite the huge progress, privacy concerns have arisen recently: training data of large language models can be extracted via model…

计算与语言 · 计算机科学 2022-05-23 Haoran Li , Yangqiu Song , Lixin Fan

Currently, large models are prone to generating harmful content when faced with complex attack instructions, significantly reducing their defensive capabilities. To address this issue, this paper proposes a method based on constructing data…

密码学与安全 · 计算机科学 2025-01-03 Keke Zhai

Human feedback on conversations with language language models (LLMs) is central to how these systems learn about the world, improve their capabilities, and are steered toward desirable and safe behaviors. However, this feedback is mostly…