English
Related papers

Related papers: Dual Semantic Knowledge Composed Multimodal Dialog…

200 papers

Recently, knowledge-grounded conversations in the open domain gain great attention from researchers. Existing works on retrieval-based dialogue systems have paid tremendous efforts to utilize neural networks to build a matching model, where…

Computation and Language · Computer Science 2025-09-30 Kai Hua , Zhiyuan Feng , Chongyang Tao , Rui Yan , Lu Zhang

Most prior work on task-oriented dialogue systems are restricted to limited coverage of domain APIs. However, users oftentimes have requests that are out of the scope of these APIs. This work focuses on responding to these…

Computation and Language · Computer Science 2021-06-18 Di Jin , Seokhwan Kim , Dilek Hakkani-Tur

Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to…

Computation and Language · Computer Science 2021-04-27 Yan Zeng , Jian-Yun Nie

Although many pretrained models exist for text or images, there have been relatively fewer attempts to train representations specifically for dialog understanding. Prior works usually relied on finetuned representations based on generic…

Computation and Language · Computer Science 2022-05-04 Bishal Santra , Sumegh Roychowdhury , Aishik Mandal , Vasu Gurram , Atharva Naik , Manish Gupta , Pawan Goyal

Emotional support (ES) systems alleviate users' mental distress by generating strategic supportive dialogues based on diverse user situations. However, ES systems are limited in their ability to generate effective ES dialogues that include…

Computation and Language · Computer Science 2025-03-24 Shi Yin Hong , Uttamasha Oyshi , Quan Mai , Gibson Nkhata , Susan Gauch

Generating varied scenarios through simulation is crucial for training and evaluating safety-critical systems, such as autonomous vehicles. Yet, the task of modeling the trajectories of other vehicles to simulate diverse and meaningful…

Robotics · Computer Science 2024-06-07 Phat Nguyen , Tsun-Hsuan Wang , Zhang-Wei Hong , Sertac Karaman , Daniela Rus

Incorporating external knowledge into dialogue generation has been proven to benefit the performance of an open-domain Dialogue System (DS), such as generating informative or stylized responses, controlling conversation topics. In this…

Computation and Language · Computer Science 2024-11-15 Longxuan Ma , Mingda Li , Weinan Zhang , Jiapeng Li , Ting Liu

Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns.…

Computation and Language · Computer Science 2026-04-21 Bo Li , Shikun Zhang , Wei Ye

The inevitable modality imperfection in real-world scenarios poses significant challenges for Multimodal Sentiment Analysis (MSA). While existing methods tailor reconstruction or joint representation learning strategies to restore missing…

Multimedia · Computer Science 2025-08-05 Hu Zhangfeng , Shi mengxin

Medical dialogue systems (MDS) have emerged as crucial online platforms for enabling multi-turn, context-aware conversations with patients. However, existing MDS often struggle to (1) identify relevant medical knowledge and (2) generate…

Computation and Language · Computer Science 2025-06-13 Hongda Sun , Jiaren Peng , Wenzhong Yang , Liang He , Bo Du , Rui Yan

We present a knowledge-grounded dialog system developed for the ninth Dialog System Technology Challenge (DSTC9) Track 1 - Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access. We leverage transfer…

Computation and Language · Computer Science 2021-06-29 Weijie Zhang , Jiaoxuan Chen , Haipang Wu , Sanhui Wan , Gongfeng Li

Users interacting with voice assistants today need to phrase their requests in a very specific manner to elicit an appropriate response. This limits the user experience, and is partly due to the lack of reasoning capabilities of dialogue…

Computation and Language · Computer Science 2022-03-22 Yi-Lin Tuan , Sajjad Beygi , Maryam Fazel-Zarandi , Qiaozi Gao , Alessandra Cervone , William Yang Wang

We study response generation for open domain conversation in chatbots. Existing methods assume that words in responses are generated from an identical vocabulary regardless of their inputs, which not only makes them vulnerable to generic…

Computation and Language · Computer Science 2017-12-01 Yu Wu , Wei Wu , Dejian Yang , Can Xu , Zhoujun Li , Ming Zhou

Beyond current conversational chatbots or task-oriented dialogue systems that have attracted increasing attention, we move forward to develop a dialogue system for automatic medical diagnosis that converses with patients to collect…

Computation and Language · Computer Science 2019-03-19 Lin Xu , Qixian Zhou , Ke Gong , Xiaodan Liang , Jianheng Tang , Liang Lin

Contextually aware intelligent agents are often required to understand the users and their surroundings in real-time. Our goal is to build Artificial Intelligence (AI) systems that can assist children in their learning process. Within such…

Computation and Language · Computer Science 2022-05-10 Eda Okur , Saurav Sahay , Lama Nachman

To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually use word or sentence…

Computation and Language · Computer Science 2022-12-13 Yue Feng , Gerasimos Lampouras , Ignacio Iacobacci

Selecting an appropriate response from many candidates given the utterances in a multi-turn dialogue is the key problem for a retrieval-based dialogue system. Existing work formalizes the task as matching between the utterances and a…

Computation and Language · Computer Science 2022-03-03 Wentao Zhang , Shuang Xu , Haoran Huang

In knowledge grounded conversation, domain knowledge plays an important role in a special domain such as Music. The response of knowledge grounded conversation might contain multiple answer entities or no entity at all. Although existing…

Computation and Language · Computer Science 2017-09-14 Wenya Zhu , Kaixiang Mo , Yu Zhang , Zhangbin Zhu , Xuezheng Peng , Qiang Yang

A critical point of multi-document summarization (MDS) is to learn the relations among various documents. In this paper, we propose a novel abstractive MDS model, in which we represent multiple documents as a heterogeneous graph, taking…

Computation and Language · Computer Science 2021-10-22 Peng Cui , Le Hu

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang