English
Related papers

Related papers: Towards Automatic Evaluation of Task-Oriented Dial…

200 papers

Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost-efficiency, making it a viable choice for large-scale…

Information Retrieval · Computer Science 2021-05-11 Weiwei Sun , Shuo Zhang , Krisztian Balog , Zhaochun Ren , Pengjie Ren , Zhumin Chen , Maarten de Rijke

There is an increasing demand for task-oriented dialogue systems which can assist users in various activities such as booking tickets and restaurant reservations. In order to complete dialogues effectively, dialogue policy plays a key role…

Computation and Language · Computer Science 2019-09-23 Tian Lan , Xianling Mao , Heyan Huang

Training task-oriented dialogue systems is both costly and time-consuming, due to the need for high-quality datasets encompassing diverse intents. Traditional methods depend on extensive human annotation, while recent advancements leverage…

Computation and Language · Computer Science 2025-01-22 Maya Medjad , Hugo Imbert , Bruno Yun , Raphaël Szymocha , Frédéric Armetta

Understanding how data moves, transforms, and persists, known as data flow, is fundamental to reasoning in procedural tasks. Despite their fluency in natural and programming languages, large language models (LLMs), although increasingly…

Artificial Intelligence · Computer Science 2025-06-02 Vishal Pallagani , Nitin Gupta , John Aydin , Biplav Srivastava

The development of Large Language Models (LLMs) has catalyzed automation in customer service, yet benchmarking their performance remains challenging. Existing benchmarks predominantly rely on static paradigms and single-dimensional metrics,…

Artificial Intelligence · Computer Science 2026-04-13 Ling Shi , Yuqin Dai , Ziyin Wang , Ning Gao , Wei Zhang , Chaozheng Wang , Yujie Wang , Wei He , Jinpeng Wang , Deiyi Xiong

Dialogue systems are usually categorized into two types, open-domain and task-oriented. The first one focuses on chatting with users and making them engage in the conversations, where selecting a proper topic to fit the dialogue context is…

Computation and Language · Computer Science 2022-04-25 Ssu Chiu , Maolin Li , Yen-Ting Lin , Yun-Nung Chen

Recent approaches have attempted to personalize dialogue systems by leveraging profile information into models. However, this knowledge is scarce and difficult to obtain, which makes the extraction/generation of profile information from…

Computation and Language · Computer Science 2023-08-29 Rui Ribeiro , Joao P. Carvalho , Luísa Coheur

Full-duplex spoken dialogue systems (FDSDS) enable more natural human-machine interactions by allowing real-time user interruptions and backchanneling, compared to traditional SDS that rely on turn-taking. However, existing benchmarks lack…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-28 Yizhou Peng , Yi-Wen Chao , Dianwen Ng , Yukun Ma , Chongjia Ni , Bin Ma , Eng Siong Chng

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

With the development of pre-trained language models, remarkable success has been witnessed in dialogue understanding (DU). However, current DU approaches usually employ independent models for each distinct DU task without considering shared…

Computation and Language · Computer Science 2022-07-26 Zhi Chen , Lu Chen , Bei Chen , Libo Qin , Yuncong Liu , Su Zhu , Jian-Guang Lou , Kai Yu

Medical dialogue systems (MDS) aim to provide patients with medical services, such as diagnosis and prescription. Since most patients cannot precisely describe their symptoms, dialogue understanding is challenging for MDS. Previous studies…

Computation and Language · Computer Science 2023-05-30 Kaishuai Xu , Wenjun Hou , Yi Cheng , Jian Wang , Wenjie Li

Directed fuzzing performs best for targeted program testing via estimating the impact of each input in reaching predefined program points. But due to insufficient analysis of the program structure and lack of flexibility and configurability…

Cryptography and Security · Computer Science 2025-07-08 Darya Parygina , Timofey Mezhuev , Daniil Kuts

Machine learning approaches for building task-oriented dialogue systems require large conversational datasets with labels to train on. We are interested in building task-oriented dialogue systems from human-human conversations, which may be…

Computation and Language · Computer Science 2019-07-09 Shachi Paul , Rahul Goel , Dilek Hakkani-Tür

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

Abstractive dialogue summarization is the task of distilling conversations into informative and concise summaries. Although reviews have been conducted on this topic, there is a lack of comprehensive work detailing the challenges of…

Computation and Language · Computer Science 2025-04-25 Frederic Kirstein , Jan Philip Wahle , Bela Gipp , Terry Ruas

Recent advances in large-scale language modeling and generation have enabled the creation of dialogue agents that exhibit human-like responses in a wide range of conversational scenarios spanning a diverse set of tasks, from general…

Computation and Language · Computer Science 2022-05-12 Abraham Sanders , Tomek Strzalkowski , Mei Si , Albert Chang , Deepanshu Dey , Jonas Braasch , Dakuo Wang

The article proposes a system for knowledge-based conversation designed for Social Robots and other conversational agents. The proposed system relies on an Ontology for the description of all concepts that may be relevant conversation…

Robotics · Computer Science 2022-08-23 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

With the advances in deep learning, tremendous progress has been made with chit-chat dialogue systems and task-oriented dialogue systems. However, these two systems are often tackled separately in current methods. To achieve more natural…

Computation and Language · Computer Science 2021-10-18 Xinyan Zhao , Bin He , Yasheng Wang , Yitong Li , Fei Mi , Yajiao Liu , Xin Jiang , Qun Liu , Huanhuan Chen

Though widely used in industry, traditional task-oriented dialogue systems suffer from three bottlenecks: (i) difficult ontology construction (e.g., intents and slots); (ii) poor controllability and interpretability; (iii)…

Computation and Language · Computer Science 2022-05-16 Xiangyu Xi , Chenxu Lv , Yuncheng Hua , Wei Ye , Chaobo Sun , Shuaipeng Liu , Fan Yang , Guanglu Wan

Automated metrics such as BLEU are widely used in the machine translation literature. They have also been used recently in the dialogue community for evaluating dialogue response generation. However, previous work in dialogue response…

Computation and Language · Computer Science 2017-06-30 Shikhar Sharma , Layla El Asri , Hannes Schulz , Jeremie Zumer