English
Related papers

Related papers: Hexa: Self-Improving for Knowledge-Grounded Dialog…

200 papers

Effective conversation requires common ground: a shared understanding between the participants. Common ground, however, does not emerge spontaneously in conversation. Speakers and listeners work together to both identify and construct a…

Computation and Language · Computer Science 2024-04-04 Omar Shaikh , Kristina Gligorić , Ashna Khetan , Matthias Gerstgrasser , Diyi Yang , Dan Jurafsky

Existing open-domain dialogue generation models are usually trained to mimic the gold response in the training set using cross-entropy loss on the vocabulary. However, a good response does not need to resemble the gold response, since there…

Computation and Language · Computer Science 2020-10-06 Wei-Jen Ko , Avik Ray , Yilin Shen , Hongxia Jin

Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of…

Computation and Language · Computer Science 2021-04-16 Kurt Shuster , Spencer Poff , Moya Chen , Douwe Kiela , Jason Weston

Large language models can produce fluent dialogue but often hallucinate factual inaccuracies. While retrieval-augmented models help alleviate this issue, they still face a difficult challenge of both reasoning to provide correct knowledge…

Computation and Language · Computer Science 2021-11-10 Leonard Adolphs , Kurt Shuster , Jack Urbanek , Arthur Szlam , Jason Weston

Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many…

Computation and Language · Computer Science 2024-08-01 Xi Wang , Procheta Sen , Ruizhe Li , Emine Yilmaz

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up…

Computation and Language · Computer Science 2016-04-08 Iulian V. Serban , Alessandro Sordoni , Yoshua Bengio , Aaron Courville , Joelle Pineau

To build a conversational agent that interacts fluently with humans, previous studies blend knowledge or personal profile into the pre-trained language model. However, the model that considers knowledge and persona at the same time is still…

Computation and Language · Computer Science 2023-01-09 Jungwoo Lim , Myunghoon Kang , Yuna Hur , Seungwon Jung , Jinsung Kim , Yoonna Jang , Dongyub Lee , Hyesung Ji , Donghoon Shin , Seungryong Kim , Heuiseok Lim

Efforts towards endowing robots with the ability to speak have benefited from recent advancements in natural language processing, in particular large language models. However, current language models are not fully incremental, as their…

Computation and Language · Computer Science 2025-04-03 Casey Kennington , Pierre Lison , David Schlangen

Recently, the practical deployment of open-domain dialogue systems has been plagued by the knowledge issue of information deficiency and factual inaccuracy. To this end, we introduce PLATO-K based on two-stage dialogic learning to…

Computation and Language · Computer Science 2022-11-03 Siqi Bao , Huang He , Jun Xu , Hua Lu , Fan Wang , Hua Wu , Han Zhou , Wenquan Wu , Zheng-Yu Niu , Haifeng Wang

Open-domain dialogue systems aim to generate relevant, informative and engaging responses. Seq2seq neural response generation approaches do not have explicit mechanisms to control the content or style of the generated response, and…

Artificial Intelligence · Computer Science 2020-08-26 Behnam Hedayatnia , Karthik Gopalakrishnan , Seokhwan Kim , Yang Liu , Mihail Eric , Dilek Hakkani-Tur

Several recent advances in AI systems solve problems by providing a "scaffolding" program that structures multiple calls to language models (LMs) to generate better outputs. A scaffolding program is written in a programming language such as…

Computation and Language · Computer Science 2024-08-19 Eric Zelikman , Eliana Lorch , Lester Mackey , Adam Tauman Kalai

Prior work on training generative Visual Dialog models with reinforcement learning(Das et al.) has explored a Qbot-Abot image-guessing game and shown that this 'self-talk' approach can lead to improved performance at the downstream…

Machine Learning · Computer Science 2019-10-04 Vishvak Murahari , Prithvijit Chattopadhyay , Dhruv Batra , Devi Parikh , Abhishek Das

Response generation is a task in natural language processing (NLP) where a model is trained to respond to human statements. Conversational response generators take this one step further with the ability to respond within the context of…

Computation and Language · Computer Science 2022-04-07 Gabriel Louis Tan , Adrian Paule Ty , Schuyler Ng , Denzel Adrian Co , Jan Christian Blaise Cruz , Charibeth Cheng

The largest store of continually updating knowledge on our planet can be accessed via internet search. In this work we study giving access to this information to conversational agents. Large language models, even though they store an…

Artificial Intelligence · Computer Science 2021-07-19 Mojtaba Komeili , Kurt Shuster , Jason Weston

The goal-oriented document-grounded dialogue aims at responding to the user query based on the dialogue context and supporting document. Existing studies tackle this problem by decomposing it into two sub-tasks: knowledge identification and…

Computation and Language · Computer Science 2022-04-19 Chang Gao , Wenxuan Zhang , Wai Lam

Most existing task-oriented dialog (TOD) systems track dialog states in terms of slots and values and use them to query a database to get relevant knowledge to generate responses. In real-life applications, user utterances are noisier, and…

Computation and Language · Computer Science 2023-05-23 Yucheng Cai , Hong Liu , Zhijian Ou , Yi Huang , Junlan Feng

Although people have the ability to engage in vapid dialogue without effort, this may not be a uniquely human trait. Since the 1960's researchers have been trying to create agents that can generate artificial conversation. These programs…

Computation and Language · Computer Science 2021-06-07 Thomas Conley , Jack St. Clair , Jugal Kalita

Identifying relevant persona or knowledge for conversational systems is critical to grounded dialogue response generation. However, each grounding has been mostly researched in isolation with more practical multi-context dialogue tasks…

Computation and Language · Computer Science 2024-08-13 Minsik Oh , Joosung Lee , Jiwei Li , Guoyin Wang

Knowledge selection is the key in knowledge-grounded dialogues (KGD), which aims to select an appropriate knowledge snippet to be used in the utterance based on dialogue history. Previous studies mainly employ the classification approach to…

Computation and Language · Computer Science 2023-04-12 Weiwei Sun , Pengjie Ren , Zhaochun Ren