English
Related papers

Related papers: DialoGPT: Large-Scale Generative Pre-training for …

200 papers

Response generation is a task in natural language processing (NLP) where a model is trained to respond to human statements. Conversational response generators take this one step further with the ability to respond within the context of…

Computation and Language · Computer Science 2022-04-07 Gabriel Louis Tan , Adrian Paule Ty , Schuyler Ng , Denzel Adrian Co , Jan Christian Blaise Cruz , Charibeth Cheng

Building a dialogue system that can communicate naturally with humans is a challenging yet interesting problem of agent-based computing. The rapid growth in this area is usually hindered by the long-standing problem of data scarcity as…

Computation and Language · Computer Science 2021-04-23 Munazza Zaib , Quan Z. Sheng , Wei Emma Zhang

Existing knowledge-grounded dialogue systems typically use finetuned versions of a pretrained language model (LM) and large-scale knowledge bases. These models typically fail to generalize on topics outside of the knowledge base, and…

Computation and Language · Computer Science 2022-03-17 Zihan Liu , Mostofa Patwary , Ryan Prenger , Shrimai Prabhumoye , Wei Ping , Mohammad Shoeybi , Bryan Catanzaro

Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many…

Computation and Language · Computer Science 2024-08-01 Xi Wang , Procheta Sen , Ruizhe Li , Emine Yilmaz

Turn-taking prediction models are essential components in spoken dialogue systems and conversational robots. Recent approaches leverage transformer-based architectures to predict speech activity continuously and in real-time. In this study,…

Computation and Language · Computer Science 2025-07-04 Koji Inoue , Mikey Elmers , Yahui Fu , Zi Haur Pang , Divesh Lala , Keiko Ochi , Tatsuya Kawahara

Conversational question answering systems often rely on semantic parsing to enable interactive information retrieval, which involves the generation of structured database queries from a natural language input. For information-seeking…

Computation and Language · Computer Science 2024-01-04 Phillip Schneider , Manuel Klettner , Kristiina Jokinen , Elena Simperl , Florian Matthes

In real-world scenarios, human dialogues are multi-round and diverse. Furthermore, human instructions can be unclear and human responses are unrestricted. Interactive robots face difficulties in understanding human intents and generating…

Robotics · Computer Science 2023-08-09 Zhe Zhang , Wei Chai , Jiankun Wang

Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target…

Computation and Language · Computer Science 2020-10-27 Yan Zeng , Jian-Yun Nie

Generative pre-trained transformer (GPT) models have revolutionized the field of natural language processing (NLP) with remarkable performance in various tasks and also extend their power to multimodal domains. Despite their success, large…

Computation and Language · Computer Science 2023-08-29 Kaiyuan Gao , Sunan He , Zhenyu He , Jiacheng Lin , QiZhi Pei , Jie Shao , Wei Zhang

Understanding emotions and responding accordingly is one of the biggest challenges of dialog systems. This paper presents EmpTransfo, a multi-head Transformer architecture for creating an empathetic dialog system. EmpTransfo utilizes…

Computation and Language · Computer Science 2020-03-09 Rohola Zandie , Mohammad H. Mahoor

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Collecting human-chatbot dialogues typically demands substantial manual effort and is time-consuming, which limits and poses challenges for research on conversational AI. In this work, we propose DialogueForge - a framework for generating…

Computation and Language · Computer Science 2025-07-22 Ruizhe Zhu , Hao Zhu , Yaxuan Li , Syang Zhou , Shijing Cai , Malgorzata Lazuka , Elliott Ash

Large language models, pivotal in artificial intelligence, find diverse applications. ChatGPT (Chat Generative Pre-trained Transformer), an OpenAI creation, stands out as a widely adopted, powerful tool. It excels in chatbots, content…

Computation and Language · Computer Science 2025-05-28 Walid Hariri

We introduce dGSLM, the first "textless" model able to generate audio samples of naturalistic spoken dialogues. It uses recent work on unsupervised spoken unit discovery coupled with a dual-tower transformer architecture with…

Neural conversation models tend to generate safe, generic responses for most inputs. This is due to the limitations of likelihood-based decoding objectives in generation tasks with diverse outputs, such as conversation. To address this…

Computation and Language · Computer Science 2018-09-06 Ashutosh Baheti , Alan Ritter , Jiwei Li , Bill Dolan

The development of conversational agents to interact with patients and deliver clinical advice has attracted the interest of many researchers, particularly in light of the COVID-19 pandemic. The training of an end-to-end neural based dialog…

Computation and Language · Computer Science 2022-12-13 Deeksha Varshney , Aizan Zafar , Niranshu Kumar Behra , Asif Ekbal

Dialogue benchmarks are crucial in training and evaluating chatbots engaging in domain-specific conversations. Knowledge graphs (KGs) represent semantically rich and well-organized data spanning various domains, such as DBLP, DBpedia, and…

Computation and Language · Computer Science 2025-01-20 Reham Omar , Omij Mangukiya , Essam Mansour

Recently, research on open domain dialogue systems have attracted extensive interests of academic and industrial researchers. The goal of an open domain dialogue system is to imitate humans in conversations. Previous works on single turn…

Computation and Language · Computer Science 2024-10-29 Wei-Nan Zhang , Yiming Cui , Kaiyan Zhang , Yifa Wang , Qingfu Zhu , Lingzhi Li , Ting Liu

Response generation is one of the critical components in task-oriented dialog systems. Existing studies have shown that large pre-trained language models can be adapted to this task. The typical paradigm of adapting such extremely large…

Computation and Language · Computer Science 2023-02-14 Sandesh Swamy , Narges Tabari , Chacha Chen , Rashmi Gangadharaiah

This work aims to create a multimodal AI system that chats with humans and shares relevant photos. While earlier works were limited to dialogues about specific objects or scenes within images, recent works have incorporated images into…

Computation and Language · Computer Science 2023-05-08 Min Young Lee