English
Related papers

Related papers: SPACE-3: Unified Dialog Model Pre-training for Tas…

200 papers

The design of dialogue flows is a critical but time-consuming task when developing task-oriented dialogue (TOD) systems. We propose an approach for the unsupervised discovery of flows from dialogue history, thus making the process…

Computation and Language · Computer Science 2024-05-03 Patrícia Ferreira , Daniel Martins , Ana Alves , Catarina Silva , Hugo Gonçalo Oliveira

Recently, pre-trained language models mostly follow the pre-train-then-fine-tuning paradigm and have achieved great performance on various downstream tasks. However, since the pre-training stage is typically task-agnostic and the…

Computation and Language · Computer Science 2020-10-08 Yuxian Gu , Zhengyan Zhang , Xiaozhi Wang , Zhiyuan Liu , Maosong Sun

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2019-11-12 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Recent research in dialogue systems and corpora has focused on two main categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems help users accomplish specific tasks, while open-domain systems aim to create…

Computation and Language · Computer Science 2024-04-30 Wen-Yu Chang , Yun-Nung Chen

In this paper, we study the problem of data augmentation for language understanding in task-oriented dialogue system. In contrast to previous work which augments an utterance without considering its relation with other utterances, we…

Computation and Language · Computer Science 2018-07-05 Yutai Hou , Yijia Liu , Wanxiang Che , Ting Liu

Response generation is one of the critical components in task-oriented dialog systems. Existing studies have shown that large pre-trained language models can be adapted to this task. The typical paradigm of adapting such extremely large…

Computation and Language · Computer Science 2023-02-14 Sandesh Swamy , Narges Tabari , Chacha Chen , Rashmi Gangadharaiah

This paper studies the exposure bias problem in task-oriented dialog systems, where the model's generated content over multiple turns drives the dialog context away from the ground-truth distribution at training time, introducing error…

Computation and Language · Computer Science 2022-09-16 Yunyi Yang , Hong Ding , Qingyi Liu , Xiaojun Quan

As labeling cost for different modules in task-oriented dialog (ToD) systems is high, a major challenge in practice is to learn different tasks with the least amount of labeled data. Recently, prompting methods over pre-trained language…

Computation and Language · Computer Science 2022-03-22 Fei Mi , Yitong Li , Yasheng Wang , Xin Jiang , Qun Liu

Motivated by the success of T5 (Text-To-Text Transfer Transformer) in pre-trained natural language processing models, we propose a unified-modal SpeechT5 framework that explores the encoder-decoder pre-training for self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-25 Junyi Ao , Rui Wang , Long Zhou , Chengyi Wang , Shuo Ren , Yu Wu , Shujie Liu , Tom Ko , Qing Li , Yu Zhang , Zhihua Wei , Yao Qian , Jinyu Li , Furu Wei

Recent work on speech representation models jointly pre-trained with text has demonstrated the potential of improving speech representations by encoding speech and text in a shared space. In this paper, we leverage such shared…

Computation and Language · Computer Science 2023-10-10 Chung-Ming Chien , Mingjiamei Zhang , Ju-Chieh Chou , Karen Livescu

Dialogue policy optimization often obtains feedback until task completion in task-oriented dialogue systems. This is insufficient for training intermediate dialogue turns since supervision signals (or rewards) are only provided at the end…

Computation and Language · Computer Science 2020-05-12 Xinting Huang , Jianzhong Qi , Yu Sun , Rui Zhang

Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research. Recently large language models (LLMs) have demonstrated exceptional…

Computation and Language · Computer Science 2023-05-17 Xiaoying Zhang , Baolin Peng , Kun Li , Jingyan Zhou , Helen Meng

Learning high quality sentence embeddings from dialogues has drawn increasing attentions as it is essential to solve a variety of dialogue-oriented tasks with low annotation cost. Annotating and gathering utterance relationships in…

Computation and Language · Computer Science 2026-04-14 Minsik Oh , Jiwei Li , Guoyin Wang

Task-oriented dialogue (ToD) systems have been mostly created for high-resource languages, such as English and Chinese. However, there is a need to develop ToD systems for other regional or local languages to broaden their ability to…

Computation and Language · Computer Science 2023-11-03 Muhammad Dehan Al Kautsar , Rahmah Khoirussyifa' Nurdini , Samuel Cahyawijaya , Genta Indra Winata , Ayu Purwarianti

Constructing a robust dialogue system on spoken conversations bring more challenge than written conversation. In this respect, DSTC10-Track2-Task2 is proposed, which aims to build a task-oriented dialogue (TOD) system incorporating…

Computation and Language · Computer Science 2022-09-07 Janghoon Han , Joongbo Shin , Hosung Song , Hyunjik Jo , Gyeonghun Kim , Yireun Kim , Stanley Jungkyu Choi

Task-oriented dialogue systems (TODS) are continuing to rise in popularity as various industries find ways to effectively harness their capabilities, saving both time and money. However, even state-of-the-art TODS are not yet reaching their…

Computation and Language · Computer Science 2022-09-07 Ryan Fellows , Hisham Ihshaish , Steve Battle , Ciaran Haines , Peter Mayhew , J. Ignacio Deza

We present a new pre-training strategy called M$^{3}$3D ($\underline{M}$ulti-$\underline{M}$odal $\underline{M}$asked $\underline{3D}$) built based on Multi-modal masked autoencoders that can leverage 3D priors and learned cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Muhammad Abdullah Jamal , Omid Mohareri

Task-oriented dialogue (TOD) models have made significant progress in recent years. However, previous studies primarily focus on datasets written by annotators, which has resulted in a gap between academic research and real-world spoken…

Computation and Language · Computer Science 2025-06-25 Shuzheng Si , Wentao Ma , Haoyu Gao , Yuchuan Wu , Ting-En Lin , Yinpei Dai , Hangyu Li , Rui Yan , Fei Huang , Yongbin Li

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Sequence labelling tasks like Dialog Act and Emotion/Sentiment identification are a key component of spoken dialog systems. In this work, we propose a new approach to learn generic representations adapted to spoken dialog, which we evaluate…

Computation and Language · Computer Science 2021-02-09 Emile Chapuis , Pierre Colombo , Matteo Manica , Matthieu Labeau , Chloe Clavel