English
Related papers

Related papers: PLATO: Pre-trained Dialogue Generation Model with …

200 papers

We introduce a new conversation head generation benchmark for synthesizing behaviors of a single interlocutor in a face-to-face conversation. The capability to automatically synthesize interlocutors which can participate in long and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Mohan Zhou , Yalong Bai , Wei Zhang , Ting Yao , Tiejun Zhao

Training the generative models with minimal corpus is one of the critical challenges for building open-domain dialogue systems. Existing methods tend to use the meta-learning framework which pre-trains the parameters on all non-target tasks…

Computation and Language · Computer Science 2020-05-14 Yiping Song , Zequn Liu , Wei Bi , Rui Yan , Ming Zhang

Building a persona-based conversation agent is challenging owing to the lack of large amounts of speaker-specific conversation data for model training. This paper addresses the problem by proposing a multi-task learning approach to training…

Computation and Language · Computer Science 2017-10-23 Yi Luan , Chris Brockett , Bill Dolan , Jianfeng Gao , Michel Galley

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

This paper introduces a simple yet effective data-centric approach for the task of improving persona-conditioned dialogue agents. Prior model-centric approaches unquestioningly depend on the raw crowdsourced benchmark datasets such as…

Computation and Language · Computer Science 2022-02-17 Minju Kim , Beong-woo Kwak , Youngwook Kim , Hong-in Lee , Seung-won Hwang , Jinyoung Yeo

The finetuning of pretrained transformer-based language generation models are typically conducted in an end-to-end manner, where the model learns to attend to relevant parts of the input by itself. However, there does not exist a mechanism…

Artificial Intelligence · Computer Science 2022-03-03 Jiabao Ji , Yoon Kim , James Glass , Tianxing He

Natural language generation plays a critical role in spoken dialogue systems. We present a new approach to natural language generation for task-oriented dialogue using recurrent neural networks in an encoder-decoder framework. In contrast…

Computation and Language · Computer Science 2017-04-25 Shikhar Sharma , Jing He , Kaheer Suleman , Hannes Schulz , Philip Bachman

Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is…

Computation and Language · Computer Science 2024-07-30 Yi-Pei Chen , Noriki Nishida , Hideki Nakayama , Yuji Matsumoto

Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and…

Computation and Language · Computer Science 2022-06-01 Avinash Madasu , Mauajama Firdaus , Asif Eqbal

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally,…

Computation and Language · Computer Science 2026-05-29 Heydar Soudani , Roxana Petcu , Evangelos Kanoulas , Faegheh Hasibi

Prompt-tuning has become an increasingly popular parameter-efficient method for adapting large pretrained language models to downstream tasks. However, both discrete prompting and continuous prompting assume fixed prompts for all data…

Computation and Language · Computer Science 2023-07-12 Runcheng Liu , Ahmad Rashid , Ivan Kobyzev , Mehdi Rezagholizadeh , Pascal Poupart

Recent language models have achieved impressive performance in natural language tasks by incorporating instructions with task input during fine-tuning. Since all samples in the same natural language task can be explained with the same task…

Computation and Language · Computer Science 2023-11-14 Jin Myung Kwak , Minseon Kim , Sung Ju Hwang

Existing knowledge-grounded dialogue systems typically use finetuned versions of a pretrained language model (LM) and large-scale knowledge bases. These models typically fail to generalize on topics outside of the knowledge base, and…

Computation and Language · Computer Science 2022-03-17 Zihan Liu , Mostofa Patwary , Ryan Prenger , Shrimai Prabhumoye , Wei Ping , Mohammad Shoeybi , Bryan Catanzaro

Towards building intelligent dialogue agents, there has been a growing interest in introducing explicit personas in generation models. However, with limited persona-based dialogue data at hand, it may be difficult to train a dialogue…

Computation and Language · Computer Science 2022-04-22 Yu Cao , Wei Bi , Meng Fang , Shuming Shi , Dacheng Tao

In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (SA-BERT), is proposed in order to make the model aware of the…

Computation and Language · Computer Science 2020-07-31 Jia-Chen Gu , Tianda Li , Quan Liu , Zhen-Hua Ling , Zhiming Su , Si Wei , Xiaodan Zhu

In task-oriented dialogue systems, spoken language understanding (SLU) is a critical component, which consists of two sub-tasks, intent detection and slot filling. Most existing methods focus on the single-intent SLU, where each utterance…

Computation and Language · Computer Science 2026-02-13 Liz Li , Wei Zhu

Responding with knowledge has been recognized as an important capability for an intelligent conversational agent. Yet knowledge-grounded dialogues, as training data for learning such a response generation model, are difficult to obtain.…

Computation and Language · Computer Science 2020-02-25 Xueliang Zhao , Wei Wu , Chongyang Tao , Can Xu , Dongyan Zhao , Rui Yan

While neural conversation models have shown great potentials towards generating informative and engaging responses via introducing external knowledge, learning such a model often requires knowledge-grounded dialogues that are difficult to…

Computation and Language · Computer Science 2021-05-17 Linxiao Li , Can Xu , Wei Wu , Yufan Zhao , Xueliang Zhao , Chongyang Tao

Task-oriented dialogue systems use four connected modules, namely, Natural Language Understanding (NLU), a Dialogue State Tracking (DST), Dialogue Policy (DP) and Natural Language Generation (NLG). A research challenge is to learn each…

Computation and Language · Computer Science 2020-08-21 Andrea Madotto , Zihan Liu , Zhaojiang Lin , Pascale Fung

There is growing interest in the automated extraction of relevant information from clinical dialogues. However, it is difficult to collect and construct large annotated resources for clinical dialogue tasks. Recent developments in natural…

Computation and Language · Computer Science 2022-06-07 Zhengyuan Liu , Pavitra Krishnaswamy , Nancy F. Chen