English
Related papers

Related papers: Zero-Shot Generalizable End-to-End Task-Oriented D…

200 papers

In this paper, we present a neural network based task-oriented dialogue system that can be optimized end-to-end with deep reinforcement learning (RL). The system is able to track dialogue state, interface with knowledge bases, and…

Computation and Language · Computer Science 2017-12-04 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Recently, two approaches, fine-tuning large pre-trained language models and variational training, have attracted significant interests, separately, for semi-supervised end-to-end task-oriented dialog (TOD) systems. In this paper, we propose…

Computation and Language · Computer Science 2023-01-30 Hong Liu , Yucheng Cai , Zhenru Lin , Zhijian Ou , Yi Huang , Junlan Feng

We investigate the use of zero-shot text-to-speech (ZS-TTS) as a data augmentation source for low-resource personalized speech synthesis. While synthetic augmentation can provide linguistically rich and phonetically diverse speech, naively…

Sound · Computer Science 2026-03-05 Youngwon Choi , Jinwoo Oh , Hwayeon Kim , Hyeonyu Kim

One of the major drawbacks of modularized task-completion dialogue systems is that each module is trained individually, which presents several challenges. For example, downstream modules are affected by earlier modules, and the performance…

Computation and Language · Computer Science 2018-02-13 Xiujun Li , Yun-Nung Chen , Lihong Li , Jianfeng Gao , Asli Celikyilmaz

Generating spoken dialogue is inherently more complex than monologue text-to-speech (TTS), as it demands both realistic turn-taking and the maintenance of distinct speaker timbres. While existing autoregressive (AR) models have made…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-15 Han Zhu , Wei Kang , Liyong Guo , Zengwei Yao , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Dong Zhang , Xin Zhang , Xingchen Song , Lingxuan Ye , Long Lin , Daniel Povey

Converting a model's internals to text can yield human-understandable insights about the model. Inspired by the recent success of training-free approaches for image captioning, we propose ZS-A2T, a zero-shot framework that translates the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Leonard Salewski , A. Sophia Koepke , Hendrik P. A. Lensch , Zeynep Akata

Building Task-Oriented Dialogue (TOD) systems that generalize across different tasks remains a challenging problem. Data-driven approaches often struggle to transfer effectively to unseen tasks. While recent schema-based TOD frameworks…

Computation and Language · Computer Science 2026-04-21 Radin Shayanfar , Chu Fei Luo , Rohan Bhambhoria , Samuel Dahan , Xiaodan Zhu

Traditional dialog systems used in goal-oriented applications require a lot of domain-specific handcrafting, which hinders scaling up to new domains. End-to-end dialog systems, in which all components are trained from the dialogs…

Computation and Language · Computer Science 2017-04-03 Antoine Bordes , Y-Lan Boureau , Jason Weston

Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating…

Computation and Language · Computer Science 2023-11-28 Yuxiang Wu , Guanting Dong , Weiran Xu

Building a semantic parser quickly in a new domain is a fundamental challenge for conversational interfaces, as current semantic parsers require expensive supervision and lack the ability to generalize to new domains. In this paper, we…

Computation and Language · Computer Science 2018-09-25 Jonathan Herzig , Jonathan Berant

Recent studies have shown remarkable success in end-to-end task-oriented dialog system. However, most neural models rely on large training data, which are only available for a certain number of task domains, such as navigation and…

Computation and Language · Computer Science 2020-06-12 Libo Qin , Xiao Xu , Wanxiang Che , Yue Zhang , Ting Liu

Zero-shot text-to-speech (TTS) aims to synthesize voices with unseen speech prompts, which significantly reduces the data and computation requirements for voice cloning by skipping the fine-tuning process. However, the prompting mechanisms…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-11 Ziyue Jiang , Jinglin Liu , Yi Ren , Jinzheng He , Zhenhui Ye , Shengpeng Ji , Qian Yang , Chen Zhang , Pengfei Wei , Chunfeng Wang , Xiang Yin , Zejun Ma , Zhou Zhao

Dialogue systems (DS), including the task-oriented dialogue system (TOD) and the open-domain dialogue system (ODD), have always been a fundamental task in natural language processing (NLP), allowing various applications in practice. Owing…

Computation and Language · Computer Science 2025-07-22 Hongru Wang , Lingzhi Wang , Yiming Du , Liang Chen , Jingyan Zhou , Yufei Wang , Kam-Fai Wong

Consistency Identification has obtained remarkable success on open-domain dialogue, which can be used for preventing inconsistent response generation. However, in contrast to the rapid development in open-domain dialogue, few efforts have…

Computation and Language · Computer Science 2021-09-24 Libo Qin , Tianbao Xie , Shijue Huang , Qiguang Chen , Xiao Xu , Wanxiang Che

To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually use word or sentence…

Computation and Language · Computer Science 2022-12-13 Yue Feng , Gerasimos Lampouras , Ignacio Iacobacci

Task-oriented dialogue (TOD) systems function as digital assistants, guiding users through various tasks such as booking flights or finding restaurants. Existing toolkits for building TOD systems often fall short of in delivering…

Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context…

Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external factual knowledge…

Spoken dialogue systems (SDSs) have been separately developed under two different categories, task-oriented and chit-chat. The former focuses on achieving functional goals and the latter aims at creating engaging social conversations…

Computation and Language · Computer Science 2023-07-06 Ye Liu , Stefan Ultes , Wolfgang Minker , Wolfgang Maier

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this problem. In this paper, we hypothesize that dialogue summaries…

Computation and Language · Computer Science 2022-03-04 Jamin Shin , Hangyeol Yu , Hyeongdon Moon , Andrea Madotto , Juneyoung Park