English
Related papers

Related papers: OmniDialog: An Omnipotent Pre-training Model for T…

200 papers

Building an end-to-end conversational agent for multi-domain task-oriented dialogues has been an open challenge for two main reasons. First, tracking dialogue states of multiple domains is non-trivial as the dialogue agent must obtain…

Computation and Language · Computer Science 2020-11-17 Hung Le , Doyen Sahoo , Chenghao Liu , Nancy F. Chen , Steven C. H. Hoi

This paper examines various unsupervised pretraining objectives for learning dialog context representations. Two novel methods of pretraining dialog context encoders are proposed, and a total of four methods are examined. Each pretraining…

Computation and Language · Computer Science 2019-06-05 Shikib Mehri , Evgeniia Razumovskaia , Tiancheng Zhao , Maxine Eskenazi

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain…

Computation and Language · Computer Science 2020-10-07 Oluwatobi O. Olabiyi , Prarthana Bhattarai , C. Bayan Bruss , Zachary Kulis

Unified multimodal models (UMMs) have achieved remarkable progress yet remain constrained by a single-turn interaction paradigm, effectively functioning as solvers for independent requests rather than assistants in continuous dialogue. To…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Wenxun Dai , Zhiyuan Zhao , Yule Zhong , Yiji Cheng , Jianwei Zhang , Linqing Wang , Shiyi Zhang , Yunlong Lin , Runze He , Fellix Song , Wayne Zhuang , Yong Liu , Haoji Zhang , Yansong Tang , Qinglin Lu , Chunyu Wang

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

Recently, the development of large language models (LLMs) has been significantly enhanced the question answering and dialogue generation, and makes them become increasingly popular in current practical scenarios. While unlike the general…

Computation and Language · Computer Science 2023-09-19 Zhiyuan Hu , Yue Feng , Yang Deng , Zekun Li , See-Kiong Ng , Anh Tuan Luu , Bryan Hooi

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

With the development of pre-trained language models, remarkable success has been witnessed in dialogue understanding (DU). However, current DU approaches usually employ independent models for each distinct DU task without considering shared…

Computation and Language · Computer Science 2022-07-26 Zhi Chen , Lu Chen , Bei Chen , Libo Qin , Yuncong Liu , Su Zhu , Jian-Guang Lou , Kai Yu

With the advances in deep learning, tremendous progress has been made with chit-chat dialogue systems and task-oriented dialogue systems. However, these two systems are often tackled separately in current methods. To achieve more natural…

Computation and Language · Computer Science 2021-10-18 Xinyan Zhao , Bin He , Yasheng Wang , Yitong Li , Fei Mi , Yajiao Liu , Xin Jiang , Qun Liu , Huanhuan Chen

The advent of Large Language Models (LLMs) has drastically enhanced dialogue systems. However, comprehensively evaluating the dialogue abilities of LLMs remains a challenge. Previous benchmarks have primarily focused on single-turn…

Computation and Language · Computer Science 2024-11-06 Ge Bai , Jie Liu , Xingyuan Bu , Yancheng He , Jiaheng Liu , Zhanhui Zhou , Zhuoran Lin , Wenbo Su , Tiezheng Ge , Bo Zheng , Wanli Ouyang

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

Data scarcity is a long-standing and crucial challenge that hinders quick development of task-oriented dialogue systems across multiple domains: task-oriented dialogue models are expected to learn grammar, syntax, dialogue reasoning,…

Computation and Language · Computer Science 2019-08-06 Paweł Budzianowski , Ivan Vulić

This paper describes our submission for the End-to-end Multi-domain Task Completion Dialog shared task at the 9th Dialog System Technology Challenge (DSTC-9). Participants in the shared task build an end-to-end task completion dialog system…

Computation and Language · Computer Science 2021-02-10 Boliang Zhang , Ying Lyu , Ning Ding , Tianhao Shen , Zhaoyang Jia , Kun Han , Kevin Knight

Perceiving multi-modal information and fulfilling dialogues with humans is a long-term goal of artificial intelligence. Pre-training is commonly regarded as an effective approach for multi-modal dialogue. However, due to the limited…

Computation and Language · Computer Science 2023-06-14 Yunshui Li , Binyuan Hui , ZhiChao Yin , Min Yang , Fei Huang , Yongbin Li

In multi-turn dialog, utterances do not always take the full form of sentences \cite{Carbonell1983DiscoursePA}, which naturally makes understanding the dialog context more difficult. However, it is essential to fully grasp the dialog…

Computation and Language · Computer Science 2020-12-15 Xiuying Chen , Zhi Cui , Jiayi Zhang , Chen Wei , Jianwei Cui , Bin Wang , Dongyan Zhao , Rui Yan

With the availability of massive general-domain dialogue data, pre-trained dialogue generation appears to be super appealing to transfer knowledge from the general domain to downstream applications. In most existing work, such transferable…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Lemao Liu , Tingchen Fu , Shuming Shi , Dongyan Zhao , Rui Yan

LLMs have shown promising results in task planning due to their strong natural language understanding and reasoning capabilities. However, issues such as hallucinations, ambiguities in human instructions, environmental constraints, and…

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen

We present DIALIGHT, a toolkit for developing and evaluating multilingual Task-Oriented Dialogue (ToD) systems which facilitates systematic evaluations and comparisons between ToD systems using fine-tuning of Pretrained Language Models…

Computation and Language · Computer Science 2024-01-05 Songbo Hu , Xiaobin Wang , Zhangdie Yuan , Anna Korhonen , Ivan Vulić

Building a universal conversational agent has been a long-standing goal of the dialogue research community. Most previous works only focus on a small set of dialogue tasks. In this work, we aim to build a unified dialogue foundation model…

Computation and Language · Computer Science 2022-10-11 Zhi Chen , Jijia Bao , Lu Chen , Yuncong Liu , Da Ma , Bei Chen , Mengyue Wu , Su Zhu , Xin Dong , Fujiang Ge , Qingliang Miao , Jian-Guang Lou , Kai Yu