English
Related papers

Related papers: Exploring the Robustness of Task-oriented Dialogue…

200 papers

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Task-oriented Dialogue Systems (TODS) often face the challenge of encountering new intents. New Intent Discovery (NID) is a crucial task that aims to identify these novel intents while maintaining the capability to recognize existing ones.…

Computation and Language · Computer Science 2025-04-01 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

Task-oriented dialogue (TOD) systems function as digital assistants, guiding users through various tasks such as booking flights or finding restaurants. Existing toolkits for building TOD systems often fall short of in delivering…

Training an end-to-end (E2E) neural network speech-to-intent (S2I) system that directly extracts intents from speech requires large amounts of intent-labeled speech data, which is time consuming and expensive to collect. Initializing the…

Computation and Language · Computer Science 2020-10-12 Yinghui Huang , Hong-Kwang Kuo , Samuel Thomas , Zvi Kons , Kartik Audhkhasi , Brian Kingsbury , Ron Hoory , Michael Picheny

Spoken language understanding (SLU) typically includes two subtasks: intent detection and slot filling. Currently, it has achieved great success in high-resource languages, but it still remains challenging in low-resource languages due to…

Computation and Language · Computer Science 2023-10-05 Tianjun Mao , Chenghong Zhang

As the functionality of dialogue systems evolves, hybrid dialogue systems that accomplish user-specific goals and participate in open-topic chitchat with users are attracting growing attention. Existing research learns both tasks…

Computation and Language · Computer Science 2022-12-15 Shimin Li , Qinyuan Cheng , Linyang Li , Xipeng Qiu

The latency in the current neural based dialogue state tracking models prohibits them from being used efficiently for deployment in production systems, albeit their highly accurate performance. This paper proposes a new scalable and…

Computation and Language · Computer Science 2018-12-04 Elnaz Nouri , Ehsan Hosseini-Asl

Transfer learning is an exciting area of Natural Language Processing that has the potential to both improve model performance and increase data efficiency. This study explores the effects of varying quantities of target task training data…

Computation and Language · Computer Science 2022-10-24 Josiah Ross , Luke Yoffe , Alon Albalak , William Yang Wang

Reliable evaluation of modern zero-shot text-to-speech (TTS) models remains challenging. Subjective tests are costly and hard to reproduce, while objective metrics often saturate, failing to distinguish SOTA systems. To address this, we…

Sound · Computer Science 2026-03-26 Shengfan Shen , Di Wu , Xingchen Song , Dinghao Zhou , Liumeng Xue , Meng Meng , Jian Luan , Shuai Wang

We conduct in this work an evaluation study comparing offline and online neural machine translation architectures. Two sequence-to-sequence models: convolutional Pervasive Attention (Elbayad et al. 2018) and attention-based Transformer…

Transformer-based Neural Language Models achieve state-of-the-art performance on various natural language processing tasks. However, an open question is the extent to which these models rely on word-order/syntactic or word…

Computation and Language · Computer Science 2024-03-05 Vasudevan Nedumpozhimana , John D. Kelleher

Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recognition models and dialog policy learning algorithms. The…

Computation and Language · Computer Science 2019-12-24 Saurav Sahay , Shachi H Kumar , Eda Okur , Haroon Syed , Lama Nachman

We present two categories of model-agnostic adversarial strategies that reveal the weaknesses of several generative, task-oriented dialogue models: Should-Not-Change strategies that evaluate over-sensitivity to small and…

Computation and Language · Computer Science 2018-09-07 Tong Niu , Mohit Bansal

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Neural machine translation systems typically are trained on curated corpora and break when faced with non-standard orthography or punctuation. Resilience to spelling mistakes and typos, however, is crucial as machine translation systems are…

Computation and Language · Computer Science 2020-09-15 Toms Bergmanis , Artūrs Stafanovičs , Mārcis Pinnis

In a realistic dialogue system, the input information from users is often subject to various types of input perturbations, which affects the slot-filling task. Although rule-based data augmentation methods have achieved satisfactory…

Computation and Language · Computer Science 2024-03-07 Jinxu Zhao , Guanting Dong , Yueyan Qiu , Tingfeng Hui , Xiaoshuai Song , Daichi Guo , Weiran Xu

Continual learning in task-oriented dialogue systems can allow us to add new domains and functionalities through time without incurring the high cost of a whole system retraining. In this paper, we propose a continual learning benchmark for…

Computation and Language · Computer Science 2021-01-01 Andrea Madotto , Zhaojiang Lin , Zhenpeng Zhou , Seungwhan Moon , Paul Crook , Bing Liu , Zhou Yu , Eunjoon Cho , Zhiguang Wang

Cross-lingual adaptation has proven effective in spoken language understanding (SLU) systems with limited resources. Existing methods are frequently unsatisfactory for intent detection and slot filling, particularly for distant languages…

Computation and Language · Computer Science 2023-08-08 Zhanyu Ma , Jian Ye , Shuang Cheng

In a human-machine dialog scenario, deciding the appropriate time for the machine to take the turn is an open research problem. In contrast, humans engaged in conversations are able to timely decide when to interrupt the speaker for…

Computation and Language · Computer Science 2019-07-12 Andrei C. Coman , Koichiro Yoshino , Yukitoshi Murase , Satoshi Nakamura , Giuseppe Riccardi

Task-oriented dialogue (ToD) systems help users execute well-defined tasks across a variety of domains (e.g., $\textit{flight booking}$ or $\textit{food ordering}$), with their Natural Language Understanding (NLU) components being dedicated…

Computation and Language · Computer Science 2024-04-10 Evgeniia Razumovskaia , Goran Glavaš , Anna Korhonen , Ivan Vulić