English
Related papers

Related papers: Comparing Data Augmentation Methods for End-to-End…

200 papers

In the realm of dialogue systems, user simulation techniques have emerged as a game-changer, redefining the evaluation and enhancement of task-oriented dialogue (TOD) systems. These methods are crucial for replicating real user…

Traditional task-oriented dialog (ToD) systems rely heavily on labor-intensive turn-level annotations, such as dialogue states and policy labels, for training. This work explores whether large language models (LLMs) can be fine-tuned solely…

Computation and Language · Computer Science 2025-02-20 Adib Mosharrof , Moghis Fereidouni , A. B. Siddique

Collecting data for training dialog systems can be extremely expensive due to the involvement of human participants and need for extensive annotation. Especially in document-grounded dialog systems, human experts need to carefully read the…

Computation and Language · Computer Science 2021-12-16 Qingyang Wu , Song Feng , Derek Chen , Sachindra Joshi , Luis A. Lastras , Zhou Yu

The recent advent of neural approaches for developing each dialog component in task-oriented dialog systems has remarkably improved, yet optimizing the overall system performance remains a challenge. Besides, previous research on modeling…

Computation and Language · Computer Science 2021-08-27 Hwaran Lee , Seokhwan Jo , HyungJun Kim , Sangkeun Jung , Tae-Yoon Kim

Much recent progress in task-oriented dialogue (ToD) systems has been driven by available annotation data across multiple domains for training. Over the last few years, there has been a move towards data curation for multilingual ToD…

Computation and Language · Computer Science 2022-04-04 Bosheng Ding , Junjie Hu , Lidong Bing , Sharifah Mahani Aljunied , Shafiq Joty , Luo Si , Chunyan Miao

As the labeling cost for different modules in task-oriented dialog (ToD) systems is expensive, a major challenge is to train different modules with the least amount of labeled data. Recently, large-scale pre-trained language models, have…

Computation and Language · Computer Science 2021-08-31 Fei Mi , Wanhao Zhou , Fengyu Cai , Lingjing Kong , Minlie Huang , Boi Faltings

For each goal-oriented dialog task of interest, large amounts of data need to be collected for end-to-end learning of a neural dialog system. Collecting that data is a costly and time-consuming process. Instead, we show that we can use only…

Computation and Language · Computer Science 2021-11-01 Janarthanan Rajendran , Jonathan K. Kummerfeld , Satinder Singh

One of the major drawbacks of modularized task-completion dialogue systems is that each module is trained individually, which presents several challenges. For example, downstream modules are affected by earlier modules, and the performance…

Computation and Language · Computer Science 2018-02-13 Xiujun Li , Yun-Nung Chen , Lihong Li , Jianfeng Gao , Asli Celikyilmaz

Data augmentation methods have been a promising direction to improve the performance of small models for low-resource dialogue state tracking. However, traditional methods rely on pre-defined user goals and neglect the importance of data…

Computation and Language · Computer Science 2024-06-14 Ming Gu , Yan Yang

End-to-end Task-Oriented Dialog (TOD) systems typically require extensive training datasets to perform well. In contrast, large language model (LLM) based TOD systems can excel even with limited data due to their ability to learn tasks…

Computation and Language · Computer Science 2024-10-21 Vishal Vivek Saley , Rocktim Jyoti Das , Dinesh Raghu , Mausam

Data Augmentation (DA) has become a critical approach in Time Series Classification (TSC), primarily for its capacity to expand training datasets, enhance model robustness, introduce diversity, and reduce overfitting. However, the current…

Machine Learning · Computer Science 2025-07-01 Zijun Gao , Haibao Liu , Lingbo Li

The success of Large Language Models (LLMs) is inherently linked to the availability of vast, diverse, and high-quality data for training and evaluation. However, the growth rate of high-quality data is significantly outpaced by the…

Computation and Language · Computer Science 2024-10-18 Ke Wang , Jiahui Zhu , Minjie Ren , Zeming Liu , Shiwei Li , Zongye Zhang , Chenkai Zhang , Xiaoyu Wu , Qiqi Zhan , Qingjie Liu , Yunhong Wang

Conversations have an intrinsic one-to-many property, which means that multiple responses can be appropriate for the same dialog context. In task-oriented dialogs, this property leads to different valid dialog policies towards task…

Computation and Language · Computer Science 2019-12-03 Yichi Zhang , Zhijian Ou , Zhou Yu

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer…

Computation and Language · Computer Science 2024-02-23 Junjie Ye , Nuo Xu , Yikun Wang , Jie Zhou , Qi Zhang , Tao Gui , Xuanjing Huang

End-to-end task-oriented dialogue (TOD) systems have achieved promising performance by leveraging sophisticated natural language understanding and natural language generation capabilities of pre-trained models. This work enables the TOD…

Computation and Language · Computer Science 2023-08-17 Jianguo Zhang , Stephen Roller , Kun Qian , Zhiwei Liu , Rui Meng , Shelby Heinecke , Huan Wang , Silvio Savarese , Caiming Xiong

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three…

Computation and Language · Computer Science 2024-07-02 Lucas Druart , Valentin Vielzeuf , Yannick Estève

Task-oriented dialogue (TOD) systems are experiencing a revolution driven by Large Language Models (LLMs), yet the evaluation methodologies for these systems remain insufficient for their growing sophistication. While traditional automatic…

Computation and Language · Computer Science 2025-07-17 Emre Can Acikgoz , Carl Guo , Suvodip Dey , Akul Datta , Takyoung Kim , Gokhan Tur , Dilek Hakkani-Tür

Data augmentation techniques have been widely used to improve machine learning performance as they enhance the generalization capability of models. In this work, to generate high quality synthetic data for low-resource tagging tasks, we…

Computation and Language · Computer Science 2020-11-04 Bosheng Ding , Linlin Liu , Lidong Bing , Canasai Kruengkrai , Thien Hai Nguyen , Shafiq Joty , Luo Si , Chunyan Miao

Data augmentation is proven to be effective in many NLU tasks, especially for those suffering from data scarcity. In this paper, we present a powerful and easy to deploy text augmentation framework, Data Boost, which augments data through…

Computation and Language · Computer Science 2020-12-08 Ruibo Liu , Guangxuan Xu , Chenyan Jia , Weicheng Ma , Lili Wang , Soroush Vosoughi