English
Related papers

Related papers: Retrieval-Augmented Transformer-XL for Close-Domai…

200 papers

To diversify and enrich generated dialogue responses, knowledge-grounded dialogue has been investigated in recent years. The existing methods tackle the knowledge grounding challenge by retrieving the relevant sentences over a large corpus…

Computation and Language · Computer Science 2022-04-26 Yan Xu , Etsuko Ishii , Samuel Cahyawijaya , Zihan Liu , Genta Indra Winata , Andrea Madotto , Dan Su , Pascale Fung

In open-domain dialogue response generation, a dialogue context can be continued with diverse responses, and the dialogue models should capture such one-to-many relations. In this work, we first analyze the training objective of dialogue…

Computation and Language · Computer Science 2020-10-20 Tianyu Zhao , Tatsuya Kawahara

This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary of existing LLMs and…

Computation and Language · Computer Science 2025-08-18 Zihao Yi , Jiarui Ouyang , Zhe Xu , Yuwen Liu , Tianhao Liao , Haohao Luo , Ying Shen

Retrieving proper domain knowledge from an external database lies at the heart of end-to-end task-oriented dialog systems to generate informative responses. Most existing systems blend knowledge retrieval with response generation and…

Computation and Language · Computer Science 2023-05-18 Fanqi Wan , Weizhou Shen , Ke Yang , Xiaojun Quan , Wei Bi

Tool-Augmented Language Models (TALMs) leverage external APIs to answer user queries across various domains. However, existing benchmark datasets for TALM research often feature simplistic dialogues that do not reflect real-world scenarios,…

Computation and Language · Computer Science 2025-03-04 Jeonghoon Shim , Gyuhyeon Seo , Cheongsu Lim , Yohan Jo

In the retrieval-based multi-turn dialogue modeling, it remains a challenge to select the most appropriate response according to extracting salient features in context utterances. As a conversation goes on, topic shift at discourse-level…

Computation and Language · Computer Science 2020-12-18 Yi Xu , Hai Zhao , Zhuosheng Zhang

Multimodal search-based dialogue is a challenging new task: It extends visually grounded question answering systems into multi-turn conversations with access to an external database. We address this new challenge by learning a neural…

Computation and Language · Computer Science 2018-11-22 Shubham Agarwal , Ondrej Dusek , Ioannis Konstas , Verena Rieser

We introduce a dialogue policy based on a transformer architecture, where the self-attention mechanism operates over the sequence of dialogue turns. Recent work has used hierarchical recurrent neural networks to encode multiple utterances…

Computation and Language · Computer Science 2020-05-04 Vladimir Vlasov , Johannes E. M. Mosig , Alan Nichol

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging…

Open-domain multi-turn conversations mainly have three features, which are hierarchical semantic structure, redundant information, and long-term dependency. Grounded on these, selecting relevant context becomes a challenge step for…

Computation and Language · Computer Science 2021-02-19 Lei Shen , Haolan Zhan , Xin Shen , Yang Feng

Data augmentation has been shown to effectively improve the performance of multimodal machine learning models. This paper introduces a generative model for data augmentation by leveraging the correlations among multiple modalities.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zixu Wang , Yishu Miao , Lucia Specia

Transformer is a deep neural network that employs a self-attention mechanism to comprehend the contextual relationships within sequential data. Unlike conventional neural networks or updated versions of Recurrent Neural Networks (RNNs) such…

Machine Learning · Computer Science 2023-06-14 Saidul Islam , Hanae Elmekki , Ahmed Elsebai , Jamal Bentahar , Najat Drawel , Gaith Rjoub , Witold Pedrycz

Audio Visual Scene-aware Dialog (AVSD) is the task of generating a response for a question with a given scene, video, audio, and the history of previous turns in the dialog. Existing systems for this task employ the transformers or…

Computation and Language · Computer Science 2020-04-20 Hwanhee Lee , Seunghyun Yoon , Franck Dernoncourt , Doo Soon Kim , Trung Bui , Kyomin Jung

Conversation generation as a challenging task in Natural Language Generation (NLG) has been increasingly attracting attention over the last years. A number of recent works adopted sequence-to-sequence structures along with external…

Computation and Language · Computer Science 2021-08-23 Changzhen Ji , Yating Zhang , Xiaozhong Liu , Adam Jatowt , Changlong Sun , Conghui Zhu , Tiejun Zhao

Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are…

Computation and Language · Computer Science 2021-10-06 Jing Yang Lee , Kong Aik Lee , Woon Seng Gan

In this work, we propose contextual language models that incorporate dialog level discourse information into language modeling. Previous works on contextual language model treat preceding utterances as a sequence of inputs, without…

Computation and Language · Computer Science 2017-01-17 Bing Liu , Ian Lane

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is a great challenging task. Existing studies focus on building a context-response matching model with various neural…

Computation and Language · Computer Science 2020-09-15 Ruijian Xu , Chongyang Tao , Daxin Jiang , Xueliang Zhao , Dongyan Zhao , Rui Yan

This paper presents a novel open-domain dialogue generation model emphasizing the differentiation of speakers in multi-turn conversations. Differing from prior work that solely relies on the content of conversation history to generate a…

Computation and Language · Computer Science 2021-10-18 Zihao Wang , Ming Jiang , Junli Wang

Transformer-based pre-trained language models boost the performance of open-domain dialogue systems. Prior works leverage Transformer-based pre-trained language models to generate texts with desired attributes in two general approaches: (1)…

Computation and Language · Computer Science 2022-09-27 Wanyu Du , Yangfeng Ji