English
Related papers

Related papers: Knowledge-Grounded Dialogue Generation with Pre-tr…

200 papers

Grounded language models use external sources of information, such as knowledge graphs, to meet some of the general challenges associated with pre-training. By extending previous work on compositional generalization in semantic parsing, we…

Computation and Language · Computer Science 2024-06-10 Sondre Wold , Étienne Simon , Lucas Georges Gabriel Charpentier , Egor V. Kostylev , Erik Velldal , Lilja Øvrelid

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Current end-to-end neural conversation models inherently lack the flexibility to impose semantic control in the response generation process, often resulting in uninteresting responses. Attempts to boost informativeness alone come at the…

Evaluating the quality of a dialogue interaction between two agents is a difficult task, especially in open-domain chit-chat style dialogue. There have been recent efforts to develop automatic dialogue evaluation metrics, but most of them…

Computation and Language · Computer Science 2020-05-05 Koustuv Sinha , Prasanna Parthasarathi , Jasmine Wang , Ryan Lowe , William L. Hamilton , Joelle Pineau

Transformer-based language models have shown to be very powerful for natural language generation (NLG). However, text generation conditioned on some user inputs, such as topics or attributes, is non-trivial. Past approach relies on either…

Computation and Language · Computer Science 2020-11-17 Fan-Keng Sun , Cheng-I Lai

We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up…

Computation and Language · Computer Science 2016-04-08 Iulian V. Serban , Alessandro Sordoni , Yoshua Bengio , Aaron Courville , Joelle Pineau

Language models have achieved impressive performances on dialogue generation tasks. However, when generating responses for a conversation that requires factual knowledge, they are far from perfect, due to an absence of mechanisms to…

Computation and Language · Computer Science 2023-05-31 Minki Kang , Jin Myung Kwak , Jinheon Baek , Sung Ju Hwang

Non-goal oriented, generative dialogue systems lack the ability to generate answers with grounded facts. A knowledge graph can be considered an abstraction of the real world consisting of well-grounded facts. This paper addresses the…

Computation and Language · Computer Science 2019-10-18 Debanjan Chaudhuri , Md Rashad Al Hasan Rony , Simon Jordan , Jens Lehmann

Implicit knowledge, such as common sense, is key to fluid human conversations. Current neural response generation (RG) models are trained to generate responses directly, omitting unstated implicit knowledge. In this paper, we present…

Computation and Language · Computer Science 2023-09-13 Pei Zhou , Karthik Gopalakrishnan , Behnam Hedayatnia , Seokhwan Kim , Jay Pujara , Xiang Ren , Yang Liu , Dilek Hakkani-Tur

Reasoning about events and tracking their influences is fundamental to understanding processes. In this paper, we present EIGEN - a method to leverage pre-trained language models to generate event influences conditioned on a context, nature…

Computation and Language · Computer Science 2020-10-23 Aman Madaan , Dheeraj Rajagopal , Yiming Yang , Abhilasha Ravichander , Eduard Hovy , Shrimai Prabhumoye

End-to-end generation-based approaches have been investigated and applied in task-oriented dialogue systems. However, in industrial scenarios, existing methods face the bottlenecks of controllability (e.g., domain-inconsistent responses,…

Computation and Language · Computer Science 2023-04-04 Yuncheng Hua , Xiangyu Xi , Zheng Jiang , Guanwei Zhang , Chaobo Sun , Guanglu Wan , Wei Ye

Large language models (LLMs) demonstrate remarkable text comprehension and generation capabilities but often lack the ability to utilize up-to-date or domain-specific knowledge not included in their training data. To address this gap, we…

Computation and Language · Computer Science 2025-09-26 Bo Zhang , Hui Ma , Dailin Li , Jian Ding , Jian Wang , Bo Xu , HongFei Lin

Knowledge-driven dialog system has recently made remarkable breakthroughs. Compared with general dialog systems, superior knowledge-driven dialog systems can generate more informative and knowledgeable responses with pre-provided knowledge.…

Computation and Language · Computer Science 2023-02-24 Zhongtian Hu , Lifang Wang , Yangqi Chen , Yushuang Liu , Ronghan Li , Meng Zhao , Xinyu Lu , Zejun Jiang

Task-oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to generate response given dialogue history and knowledge access.…

Computation and Language · Computer Science 2020-12-23 Chao-Hong Tan , Xiaoyu Yang , Zi'ou Zheng , Tianda Li , Yufei Feng , Jia-Chen Gu , Quan Liu , Dan Liu , Zhen-Hua Ling , Xiaodan Zhu

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Longitudinal Dialogues (LD) are the most challenging type of conversation for human-machine dialogue systems. LDs include the recollections of events, personal thoughts, and emotions specific to each individual in a sparse sequence of…

Computation and Language · Computer Science 2023-11-01 Seyed Mahed Mousavi , Simone Caldarella , Giuseppe Riccardi

Generating knowledge grounded responses in both goal and non-goal oriented dialogue systems is an important research challenge. Knowledge Graphs (KG) can be viewed as an abstraction of the real world, which can potentially facilitate a…

Computation and Language · Computer Science 2021-03-31 Debanjan Chaudhuri , Md Rashad Al Hasan Rony , Jens Lehmann

The natural language generation (NLG) component of a spoken dialogue system (SDS) usually needs a substantial amount of handcrafting or a well-labeled dataset to be trained on. These limitations add significantly to development costs and…

Computation and Language · Computer Science 2015-08-10 Tsung-Hsien Wen , Milica Gasic , Dongho Kim , Nikola Mrksic , Pei-Hao Su , David Vandyke , Steve Young

The prevalence of mental disorders has become a significant issue, leading to the increased focus on Emotional Support Conversation as an effective supplement for mental health support. Existing methods have achieved compelling results,…

Computation and Language · Computer Science 2023-10-12 Mengzhao Jia , Qianglong Chen , Liqiang Jing , Dawei Fu , Renyu Li

In open-domain dialogue intelligent agents should exhibit the use of knowledge, however there are few convincing demonstrations of this to date. The most popular sequence to sequence models typically "generate and hope" generic utterances…

Computation and Language · Computer Science 2019-02-25 Emily Dinan , Stephen Roller , Kurt Shuster , Angela Fan , Michael Auli , Jason Weston