English
Related papers

Related papers: Data Manipulation: Towards Effective Instance Lear…

200 papers

Dynamic data selection aims to accelerate training with lossless performance. However, reducing training data inherently limits data diversity, potentially hindering generalization. While data augmentation is widely used to enhance…

Machine Learning · Computer Science 2025-05-13 Suorong Yang , Peng Ye , Furao Shen , Dongzhan Zhou

Learning with limited data is one of the biggest problems of machine learning. Current approaches to this issue consist in learning general representations from huge amounts of data before fine-tuning the model on a small dataset of…

Machine Learning · Computer Science 2023-02-22 Grégoire Mialon

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role…

Computation and Language · Computer Science 2024-05-31 Jian Wang , Chak Tou Leong , Jiashuo Wang , Dongding Lin , Wenjie Li , Xiao-Yong Wei

Spoken Language Understanding (SLU) is one essential step in building a dialogue system. Due to the expensive cost of obtaining the labeled data, SLU suffers from the data scarcity problem. Therefore, in this paper, we focus on data…

Computation and Language · Computer Science 2021-09-03 Haitao Lin , Lu Xiang , Yu Zhou , Jiajun Zhang , Chengqing Zong

Current neural network-based conversational models lack diversity and generate boring responses to open-ended utterances. Priors such as persona, emotion, or topic provide additional information to dialog models to aid response generation,…

Computation and Language · Computer Science 2019-08-05 Richard Csaky , Patrik Purgai , Gabor Recski

The DIAlogue MOdel Learning Environment supports an engineering-oriented approach towards dialogue modelling for a spoken-language interface. Major steps towards dialogue models is to know about the basic units that are used to construct a…

cmp-lg · Computer Science 2008-02-03 Jens-Uwe Moeller

Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples to build new training instances. Continued training with…

Computation and Language · Computer Science 2023-06-12 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

Large language models (LLMs) have demonstrated remarkable performance across a wide range of tasks and domains, with data playing a central role in enabling these advances. Despite this success, the preparation and effective utilization of…

Computation and Language · Computer Science 2026-03-17 Hao Liang , Zhengyang Zhao , Zhaoyang Han , Meiyi Qiang , Xiaochen Ma , Bohan Zeng , Qifeng Cai , Zhiyu Li , Linpeng Tang , Weinan E , Wentao Zhang

Existing NLP datasets contain various biases, and models tend to quickly learn those biases, which in turn limits their robustness. Existing approaches to improve robustness against dataset biases mostly focus on changing the training…

Computation and Language · Computer Science 2020-10-26 Nafise Sadat Moosavi , Marcel de Boer , Prasetya Ajie Utama , Iryna Gurevych

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

Dialogue state modules are a useful component in a task-oriented dialogue system. Traditional methods find dialogue states by manually labeling training corpora, upon which neural models are trained. However, the labeling process can be…

Computation and Language · Computer Science 2020-08-14 Qingkai Min , Libo Qin , Zhiyang Teng , Xiao Liu , Yue Zhang

The training of task-oriented dialogue systems is often confronted with the lack of annotated data. In contrast to previous work which augments training data through expensive crowd-sourcing efforts, we propose four different automatic…

Computation and Language · Computer Science 2019-12-06 Jun Quan , Deyi Xiong

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

While end-to-end neural conversation models have led to promising advances in reducing hand-crafted features and errors induced by the traditional complex system architecture, they typically require an enormous amount of data due to the…

Computation and Language · Computer Science 2018-01-10 Sungjin Lee

The main limiting factor in the development of robust multilingual dialogue evaluation metrics is the lack of multilingual data and the limited availability of open sourced multilingual dialogue systems. In this work, we propose a…

Computation and Language · Computer Science 2023-09-01 John Mendonça , Alon Lavie , Isabel Trancoso

In this work, we present a hybrid learning method for training task-oriented dialogue systems through online user interactions. Popular methods for learning task-oriented dialogues include applying reinforcement learning with user feedback…

Computation and Language · Computer Science 2018-04-19 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Humans often employ figurative language use in communication, including during interactions with dialog systems. Thus, it is important for real-world dialog systems to be able to handle popular figurative language constructs like metaphor…

Computation and Language · Computer Science 2021-10-05 Harsh Jhamtani , Varun Gangal , Eduard Hovy , Taylor Berg-Kirkpatrick

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen

The rapid evolution of large language models (LLMs) has transformed conversational agents, enabling complex human-machine interactions. However, evaluation frameworks often focus on single tasks, failing to capture the dynamic nature of…

Computation and Language · Computer Science 2025-02-10 Pietro Alessandro Aluffi , Patrick Zietkiewicz , Marya Bazzi , Matt Arderne , Vladimirs Murevics

Deep neural networks (DNN) are quickly becoming the de facto standard modeling method for many natural language generation (NLG) tasks. In order for such models to truly be useful, they must be capable of correctly generating utterances for…

Computation and Language · Computer Science 2019-11-11 Chris Kedzie , Kathleen McKeown