English
Related papers

Related papers: Recipes for building an open-domain chatbot

200 papers

To explore the limit of dialogue generation pre-training, we present the models of PLATO-XL with up to 11 billion parameters, trained on both Chinese and English social media conversations. To train such large models, we adopt the…

Computation and Language · Computer Science 2022-10-20 Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang , Wenquan Wu , Zhihua Wu , Zhen Guo , Hua Lu , Xinxian Huang , Xin Tian , Xinchao Xu , Yingzhan Lin , Zheng-Yu Niu

Most often, chat-bots are built to solve the purpose of a search engine or a human assistant: Their primary goal is to provide information to the user or help them complete a task. However, these chat-bots are incapable of responding to…

Artificial Intelligence · Computer Science 2018-11-26 Parag Agrawal , Anshuman Suri , Tulasi Menon

Recently, chatbots received an increased attention from industry and diverse research communities as a dialogue-based interface providing advanced human-computer interactions. On the other hand, Open Data continues to be an important trend…

Information Retrieval · Computer Science 2019-09-13 Sophia Keyner , Vadim Savenkov , Svitlana Vakulenko

To build a satisfying chatbot that has the ability of managing a goal-oriented multi-turn dialogue, accurate modeling of human conversation is crucial. In this paper we concentrate on the task of response selection for multi-turn…

Computation and Language · Computer Science 2018-02-19 Guozhen An , Mehrnoosh Shafiee , Davood Shamsi

Evaluating the quality of open-domain chatbots has become increasingly reliant on LLMs acting as automatic judges. However, existing meta-evaluation benchmarks are static, outdated, and lacking in multilingual coverage, limiting their…

Computation and Language · Computer Science 2026-01-23 John Mendonça , Alon Lavie , Isabel Trancoso

Driven by ongoing improvements in machine learning, chatbots have increasingly grown from experimental interface prototypes to reliable and robust tools for process automation. Building on these advances, companies have identified various…

Human-Computer Interaction · Computer Science 2023-02-02 Alessandro Casadei , Stephan Schlögl , Markus Bergmann

Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisfaction. Despite recent developments in RL and language…

Machine Learning · Computer Science 2023-10-31 Dhawal Gupta , Yinlam Chow , Aza Tulepbergenov , Mohammad Ghavamzadeh , Craig Boutilier

This work introduces LAB (Large-scale Alignment for chatBots), a novel methodology designed to overcome the scalability challenges in the instruction-tuning phase of large language model (LLM) training. Leveraging a taxonomy-guided…

Computation and Language · Computer Science 2024-05-01 Shivchander Sudalairaj , Abhishek Bhandwaldar , Aldo Pareja , Kai Xu , David D. Cox , Akash Srivastava

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

Computation and Language · Computer Science 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

Each day, individuals set behavioral goals such as eating healthier, exercising regularly, or increasing productivity. While psychological frameworks (i.e., goal setting and implementation intentions) can be helpful, they often need…

Human-Computer Interaction · Computer Science 2026-02-10 Michel Schimpf , Sebastian Maier , Anton Wyrowski , Lara Christoforakos , Stefan Feuerriegel , Thomas Bohné

Large language models (LLMs), such as ChatGPT, have demonstrated impressive performance in the text generation task, showing the ability to understand and respond to complex instructions. However, the performance of naive LLMs in speciffc…

Computation and Language · Computer Science 2025-12-12 HuangChao Xu , Baohua Zhang , Zhong Jin , Tiannian Zhu , Quansheng Wu , Hongming Weng

Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite significant achievements, they rely on enormous training data to acquire a broad spectrum of open-domain knowledge. Besides, their…

Software Engineering · Computer Science 2025-02-18 Xiaodong Gu , Meng Chen , Yalan Lin , Yuhan Hu , Hongyu Zhang , Chengcheng Wan , Zhao Wei , Yong Xu , Juhong Wang

Open-domain dialogue systems aim to interact with humans through natural language texts in an open-ended fashion. Despite the recent success of super large dialogue systems such as ChatGPT, using medium-to-small-sized dialogue systems…

Computation and Language · Computer Science 2023-03-28 Yuqiao Wen , Yongchang Hao , Yanshuai Cao , Lili Mou

Open source large language models (LLMs) have shown great improvements in recent times. However, many of these models are focused solely on popular spoken languages. We present a high quality dataset of more than 70k prompt-response pairs…

Computation and Language · Computer Science 2024-05-22 Peter Devine

A good conversation requires balance -- between simplicity and detail; staying on topic and changing it; asking questions and answering them. Although dialogue agents are commonly evaluated via human judgments of overall quality, the…

Computation and Language · Computer Science 2019-04-11 Abigail See , Stephen Roller , Douwe Kiela , Jason Weston

Chatbots are conversational software applications designed to interact dialectically with users for a plethora of different purposes. Surprisingly, these colloquial agents have only recently been coupled with computational models of…

Artificial Intelligence · Computer Science 2024-08-07 Federico Castagna , Nadin Kokciyan , Isabel Sassoon , Simon Parsons , Elizabeth Sklar

Recent conditional language models are able to continue any kind of text source in an often seemingly fluent way. This fact encouraged research in the area of open-domain conversational systems that are based on powerful language models and…

Computation and Language · Computer Science 2023-08-14 Fabian Galetzka , Anne Beyer , David Schlangen

Predictive human models often need to adapt their parameters online from human data. This raises previously ignored safety-related questions for robots relying on these models such as what the model could learn online and how quickly could…

Robotics · Computer Science 2021-10-01 Andrea Bajcsy , Anand Siththaranjan , Claire J. Tomlin , Anca D. Dragan

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…