English
Related papers

Related papers: Effective Data Augmentation Approaches to End-to-E…

200 papers

Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage…

Computation and Language · Computer Science 2023-05-19 Chujie Zheng , Sahand Sabour , Jiaxin Wen , Zheng Zhang , Minlie Huang

In task-oriented dialogs (TOD), reinforcement learning (RL) algorithms train a model to directly optimize response for task-related metrics. However, RL needs to perform exploration, which can be time-consuming due to the slow…

Computation and Language · Computer Science 2023-10-23 Xiao Yu , Qingyang Wu , Kun Qian , Zhou Yu

In current text-based task-oriented dialogue (TOD) systems, user emotion detection (ED) is often overlooked or is typically treated as a separate and independent task, requiring additional training. In contrast, our work demonstrates that…

Computation and Language · Computer Science 2024-07-01 Armand Stricker , Patrick Paroubek

Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data…

Computation and Language · Computer Science 2020-11-11 Rongsheng Zhang , Yinhe Zheng , Jianzhi Shao , Xiaoxi Mao , Yadong Xi , Minlie Huang

This paper proposes a novel end-to-end architecture for task-oriented dialogue systems. It is based on a simple and practical yet very effective sequence-to-sequence approach, where language understanding and state tracking tasks are…

Computation and Language · Computer Science 2019-08-08 Lei Shu , Piero Molino , Mahdi Namazifar , Hu Xu , Bing Liu , Huaixiu Zheng , Gokhan Tur

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

Computation and Language · Computer Science 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

Recently, a more challenging state tracking task, Audio-Video Scene-Aware Dialogue (AVSD), is catching an increasing amount of attention among researchers. Different from purely text-based dialogue state tracking, the dialogue in AVSD…

Computation and Language · Computer Science 2020-07-21 Xiangyang Mou , Brandyn Sigouin , Ian Steenstra , Hui Su

Tutoring is an effective instructional method for enhancing student learning, yet its success relies on the skill and experience of the tutors. This reliance presents challenges for the widespread implementation of tutoring, particularly in…

Human-Computer Interaction · Computer Science 2025-10-21 Chentianye Xu , Jionghao Lin , Tongshuang Wu , Vincent Aleven , Kenneth R. Koedinger

A long-term goal of machine learning is to build intelligent conversational agents. One recent popular approach is to train end-to-end models on a large amount of real dialog transcripts between humans (Sordoni et al., 2015; Vinyals & Le,…

Computation and Language · Computer Science 2016-04-20 Jesse Dodge , Andreea Gane , Xiang Zhang , Antoine Bordes , Sumit Chopra , Alexander Miller , Arthur Szlam , Jason Weston

Recently, end-to-end (E2E) automatic speech recognition (ASR) models have made great strides and exhibit excellent performance in general speech recognition. However, there remain several challenging scenarios that E2E models are not…

Computation and Language · Computer Science 2023-06-16 Zheng Liang , Zheshu Song , Ziyang Ma , Chenpeng Du , Kai Yu , Xie Chen

End-to-end design of dialogue systems has recently become a popular research topic thanks to powerful tools such as encoder-decoder architectures for sequence-to-sequence learning. Yet, most current approaches cast human-machine dialogue…

Computation and Language · Computer Science 2017-03-17 Florian Strub , Harm de Vries , Jeremie Mary , Bilal Piot , Aaron Courville , Olivier Pietquin

Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model…

Computation and Language · Computer Science 2025-02-24 Christopher Richardson , Roshan Sharma , Neeraj Gaur , Parisa Haghani , Anirudh Sundar , Bhuvana Ramabhadran

Recently, the development of large language models (LLMs) has been significantly enhanced the question answering and dialogue generation, and makes them become increasingly popular in current practical scenarios. While unlike the general…

Computation and Language · Computer Science 2023-09-19 Zhiyuan Hu , Yue Feng , Yang Deng , Zekun Li , See-Kiong Ng , Anh Tuan Luu , Bryan Hooi

In spoken Task-Oriented Dialogue (TOD) systems, the choice of the semantic representation describing the users' requests is key to a smooth interaction. Indeed, the system uses this representation to reason over a database and its domain…

Artificial Intelligence · Computer Science 2024-06-21 Lucas Druart , Valentin Vielzeuf , Yannick Estève

As the labeling cost for different modules in task-oriented dialog (ToD) systems is expensive, a major challenge is to train different modules with the least amount of labeled data. Recently, large-scale pre-trained language models, have…

Computation and Language · Computer Science 2021-08-31 Fei Mi , Wanhao Zhou , Fengyu Cai , Lingjing Kong , Minlie Huang , Boi Faltings

Training task-oriented dialogue systems typically requires turn-level annotations for interacting with their APIs: e.g. a dialogue state and the system actions taken at each step. These annotations can be costly to produce, error-prone, and…

Computation and Language · Computer Science 2024-10-17 Brendan King , Jeffrey Flanigan

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

Data augmentation is widely used as a part of the training process applied to deep learning models, especially in the computer vision domain. Currently, common data augmentation techniques are designed manually. Therefore they require…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Irynei Baran , Orest Kupyn , Arseny Kravchenko

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

Computation and Language · Computer Science 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

Neural network models have demonstrated impressive performance in predicting pathologies and outcomes from the 12-lead electrocardiogram (ECG). However, these models often need to be trained with large, labelled datasets, which are not…

Machine Learning · Computer Science 2022-04-12 Aniruddh Raghu , Divya Shanmugam , Eugene Pomerantsev , John Guttag , Collin M. Stultz