English
Related papers

Related papers: "How Robust r u?": Evaluating Task-Oriented Dialog…

200 papers

Training dialogue systems often entails dealing with noisy training examples and unexpected user inputs. Despite their prevalence, there currently lacks an accurate survey of dialogue noise, nor is there a clear sense of the impact of each…

Computation and Language · Computer Science 2023-08-01 Derek Chen , Zhou Yu

With robotics rapidly advancing, more effective human-robot interaction is increasingly needed to realize the full potential of robots for society. While spoken language must be part of the solution, our ability to provide spoken language…

Robotics · Computer Science 2024-03-25 Matthew Marge , Carol Espy-Wilson , Nigel Ward

Task-oriented dialogue (TOD) models have made significant progress in recent years. However, previous studies primarily focus on datasets written by annotators, which has resulted in a gap between academic research and real-world spoken…

Computation and Language · Computer Science 2025-06-25 Shuzheng Si , Wentao Ma , Haoyu Gao , Yuchuan Wu , Ting-En Lin , Yinpei Dai , Hangyu Li , Rui Yan , Fei Huang , Yongbin Li

Reinforcement learning has been widely adopted to model dialogue managers in task-oriented dialogues. However, the user simulator provided by state-of-the-art dialogue frameworks are only rough approximations of human behaviour. The ability…

Computation and Language · Computer Science 2023-02-23 Thibault Cordier , Tanguy Urvoy , Fabrice Lefevre , Lina M. Rojas-Barahona

Existing conversational datasets consist either of written proxies for dialog or small-scale transcriptions of natural speech. We introduce 'Interview': a large-scale (105K conversations) media dialog dataset collected from news interview…

Computation and Language · Computer Science 2020-04-08 Bodhisattwa Prasad Majumder , Shuyang Li , Jianmo Ni , Julian McAuley

Pre-trained models have proved to be powerful in enhancing task-oriented dialog systems. However, current pre-training methods mainly focus on enhancing dialog understanding and generation tasks while neglecting the exploitation of dialog…

Computation and Language · Computer Science 2022-03-30 Wanwei He , Yinpei Dai , Yinhe Zheng , Yuchuan Wu , Zheng Cao , Dermot Liu , Peng Jiang , Min Yang , Fei Huang , Luo Si , Jian Sun , Yongbin Li

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three…

Computation and Language · Computer Science 2024-07-02 Lucas Druart , Valentin Vielzeuf , Yannick Estève

Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost-efficiency, making it a viable choice for large-scale…

Information Retrieval · Computer Science 2021-05-11 Weiwei Sun , Shuo Zhang , Krisztian Balog , Zhaochun Ren , Pengjie Ren , Zhumin Chen , Maarten de Rijke

An intelligent dialogue system in a multi-turn setting should not only generate the responses which are of good quality, but it should also generate the responses which can lead to long-term success of the dialogue. Although, the current…

Computation and Language · Computer Science 2023-01-12 Anant Khandelwal

In this paper we describe the linguistic processor of a spoken dialogue system. The parser receives a word graph from the recognition module as its input. Its task is to find the best path through the graph. If no complete solution can be…

cmp-lg · Computer Science 2008-02-03 Gerhard Hanrieder , Guenther Goerz

Functionality and dialogue experience are two important factors of task-oriented dialogue systems. Conventional approaches with closed schema (e.g., conversational semantic parsing) often fail as both the functionality and dialogue…

Computation and Language · Computer Science 2022-12-21 Raphael Shu , Elman Mansimov , Tamer Alkhouli , Nikolaos Pappas , Salvatore Romeo , Arshit Gupta , Saab Mansour , Yi Zhang , Dan Roth

Automated metrics such as BLEU are widely used in the machine translation literature. They have also been used recently in the dialogue community for evaluating dialogue response generation. However, previous work in dialogue response…

Computation and Language · Computer Science 2017-06-30 Shikhar Sharma , Layla El Asri , Hannes Schulz , Jeremie Zumer

Task-oriented dialog systems have been applied in various tasks, such as automated personal assistants, customer service providers and tutors. These systems work well when users have clear and explicit intentions that are well-aligned to…

Computation and Language · Computer Science 2018-01-09 Zhou Yu , Alan W Black , Alexander I. Rudnicky

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and…

Computation and Language · Computer Science 2020-03-31 Fabian Galetzka , Chukwuemeka U. Eneh , David Schlangen

Capitalization and punctuation are important cues for comprehending written texts and conversational transcripts. Yet, many ASR systems do not produce punctuated and case-formatted speech transcripts. We propose to use a multi-task system…

Computation and Language · Computer Science 2021-09-14 Raghavendra Pappagari , Piotr Żelasko , Agnieszka Mikołajczyk , Piotr Pęzik , Najim Dehak

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

Dialogue data in real scenarios tend to be sparsely available, rendering data-starved end-to-end dialogue systems trained inadequately. We discover that data utilization efficiency in low-resource scenarios can be enhanced by mining…

Computation and Language · Computer Science 2023-05-26 Shimin Li , Xiaotian Zhang , Yanjun Zheng , Linyang Li , Xipeng Qiu

In recent years, large pretrained models have been used in dialogue systems to improve successful task completion rates. However, lack of reasoning capabilities of dialogue platforms make it difficult to provide relevant and fluent…

Computation and Language · Computer Science 2022-02-10 Sajjad Beygi , Maryam Fazel-Zarandi , Alessandra Cervone , Prakash Krishnan , Siddhartha Reddy Jonnalagadda

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work…

Computation and Language · Computer Science 2021-07-19 Jing Xu , Arthur Szlam , Jason Weston

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully…

Computation and Language · Computer Science 2024-09-17 Eunice Akani , Benoit Favre , Frederic Bechet , Romain Gemignani