English
Related papers

Related papers: Multimodal Dialog Systems with Dual Knowledge-enha…

200 papers

This work combines information about the dialogue history encoded by pre-trained model with a meaning representation of the current system utterance to realize contextual language generation in task-oriented dialogues. We utilize the…

Computation and Language · Computer Science 2021-11-30 Ye Liu , Wolfgang Maier , Wolfgang Minker , Stefan Ultes

Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to…

Computation and Language · Computer Science 2021-04-27 Yan Zeng , Jian-Yun Nie

Existing pipelined task-oriented dialogue systems usually have difficulties adapting to unseen domains, whereas end-to-end systems are plagued by large-scale knowledge bases in practice. In this paper, we introduce a novel query-driven…

Computation and Language · Computer Science 2022-10-17 Xin Tian , Yingzhan Lin , Mengfei Song , Siqi Bao , Fan Wang , Huang He , Shuqi Sun , Hua Wu

Although many pretrained models exist for text or images, there have been relatively fewer attempts to train representations specifically for dialog understanding. Prior works usually relied on finetuned representations based on generic…

Computation and Language · Computer Science 2022-05-04 Bishal Santra , Sumegh Roychowdhury , Aishik Mandal , Vasu Gurram , Atharva Naik , Manish Gupta , Pawan Goyal

Data scarcity is a long-standing and crucial challenge that hinders quick development of task-oriented dialogue systems across multiple domains: task-oriented dialogue models are expected to learn grammar, syntax, dialogue reasoning,…

Computation and Language · Computer Science 2019-08-06 Paweł Budzianowski , Ivan Vulić

To effectively engage in human society, the ability to adapt, filter information, and make informed decisions in ever-changing situations is critical. As robots and intelligent agents become more integrated into human life, there is a…

Artificial Intelligence · Computer Science 2025-11-13 Mingyang Mao , Mariela M. Perez-Cabarcas , Utteja Kallakuri , Nicholas R. Waytowich , Xiaomin Lin , Tinoosh Mohsenin

The need for high-quality data has been a key issue hindering the research of dialogue tasks. Recent studies try to build datasets through manual, web crawling, and large pre-trained models. However, man-made data is expensive and data…

Computation and Language · Computer Science 2023-10-18 Hang Yin , Pinren Lu , Ziang Li , Bin Sun , Kan Li

To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually use word or sentence…

Computation and Language · Computer Science 2022-12-13 Yue Feng , Gerasimos Lampouras , Ignacio Iacobacci

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Responding with knowledge has been recognized as an important capability for an intelligent conversational agent. Yet knowledge-grounded dialogues, as training data for learning such a response generation model, are difficult to obtain.…

Computation and Language · Computer Science 2020-02-25 Xueliang Zhao , Wei Wu , Chongyang Tao , Can Xu , Dongyan Zhao , Rui Yan

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

Computation and Language · Computer Science 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Knowledge-enhanced text generation aims to enhance the quality of generated text by utilizing internal or external knowledge sources. While language models have demonstrated impressive capabilities in generating coherent and fluent text,…

Computation and Language · Computer Science 2026-01-15 Shuqi Liu , Han Wu , Guanzhi Deng , Jianshu Chen , Xiaoyang Wang , Linqi Song

Natural Language Understanding (NLU) and Natural Language Generation (NLG) are the two critical components of every conversational system that handles the task of understanding the user by capturing the necessary information in the form of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Mauajama Firdaus , Avinash Madasu , Asif Ekbal

Multi-turn dialogue reading comprehension aims to teach machines to read dialogue contexts and solve tasks such as response selection and answering questions. The major challenges involve noisy history contexts and especial prerequisites of…

Computation and Language · Computer Science 2021-02-11 Zhuosheng Zhang , Junlong Li , Hai Zhao

Accurate knowledge selection is critical in knowledge-grounded dialogue systems. Towards a closer look at it, we offer a novel perspective to organize existing literature, i.e., knowledge selection coupled with, after, and before…

Computation and Language · Computer Science 2023-10-23 Lang Qin , Yao Zhang , Hongru Liang , Jun Wang , Zhenglu Yang

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

We present a novel training framework for neural sequence models, particularly for grounded dialog generation. The standard training paradigm for these models is maximum likelihood estimation (MLE), or minimizing the cross-entropy of the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Jiasen Lu , Anitha Kannan , Jianwei Yang , Devi Parikh , Dhruv Batra

Pre-training models have been proved effective for a wide range of natural language processing tasks. Inspired by this, we propose a novel dialogue generation pre-training framework to support various kinds of conversations, including…

Computation and Language · Computer Science 2020-05-01 Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

Existing knowledge-grounded conversation systems generate responses typically in a retrieve-then-generate manner. They require a large knowledge base and a strong knowledge retrieval component, which is time- and resource-consuming. In this…

Computation and Language · Computer Science 2023-06-28 Jiaqi Bai , Zhao Yan , Jian Yang , Xinnian Liang , Hongcheng Guo , Zhoujun Li

While neural conversation models have shown great potentials towards generating informative and engaging responses via introducing external knowledge, learning such a model often requires knowledge-grounded dialogues that are difficult to…

Computation and Language · Computer Science 2021-05-17 Linxiao Li , Can Xu , Wei Wu , Yufan Zhao , Xueliang Zhao , Chongyang Tao