English
Related papers

Related papers: SDA: Improving Text Generation with Self Data Augm…

200 papers

Although data augmentation is a powerful technique for improving the performance of image classification tasks, it is difficult to identify the best augmentation policy. The optimal augmentation policy, which is the latent variable, cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Koichi Kuriyama

Current state-of-the-art neural dialogue models learn from human conversations following the data-driven paradigm. As such, a reliable training corpus is the crux of building a robust and well-behaved dialogue model. However, due to the…

Computation and Language · Computer Science 2020-06-12 Hengyi Cai , Hongshen Chen , Yonghao Song , Cheng Zhang , Xiaofang Zhao , Dawei Yin

Data analysis and machine learning are of preeminent importance in the legal domain, especially in tasks like clustering and text classification. In this study, we harnessed the power of natural language processing tools to enhance datasets…

Computation and Language · Computer Science 2024-04-16 Lucas José Gonçalves Freitas , Thaís Rodrigues , Guilherme Rodrigues , Pamella Edokawa , Ariane Farias

Data augmentation has proven widely effective in computer vision. In Natural Language Processing (NLP) data augmentation remains an area of active research. There is no widely accepted augmentation technique that works well across tasks and…

Computation and Language · Computer Science 2023-03-07 Isabel Garcia Pietri , Kineret Stanley

The limited scale of annotated data constraints existing context-dependent text-to-SQL models because of the complexity of labeling. The data augmentation method is a commonly used method to solve this problem. However, the data generated…

Computation and Language · Computer Science 2023-05-01 Dingzirui Wang , Longxu Dou , Wanxiang Che

Spoken Language Understanding (SLU) converts user utterances into structured semantic representations. Data sparsity is one of the main obstacles of SLU due to the high cost of human annotation, especially when domain changes or a new…

Computation and Language · Computer Science 2019-08-29 Zijian Zhao , Su Zhu , Kai Yu

Semantically meaningful sentence embeddings are important for numerous tasks in natural language processing. To obtain such embeddings, recent studies explored the idea of utilizing synthetically generated data from pretrained language…

Computation and Language · Computer Science 2022-08-31 Taehee Kim , ChaeHun Park , Jimin Hong , Radhika Dua , Edward Choi , Jaegul Choo

Existing data augmentation approaches for neural machine translation (NMT) have predominantly relied on back-translating in-domain (IND) monolingual corpora. These methods suffer from issues associated with a domain information gap, which…

Computation and Language · Computer Science 2020-04-07 Wei Peng , Chongxuan Huang , Tianhao Li , Yun Chen , Qun Liu

Although n-gram language models (LMs) have been outperformed by the state-of-the-art neural LMs, they are still widely used in speech recognition due to its high efficiency in inference. In this paper, we demonstrate that n-gram LM can be…

Computation and Language · Computer Science 2019-12-03 Yiren Wang , Hongzhao Huang , Zhe Liu , Yutong Pang , Yongqiang Wang , ChengXiang Zhai , Fuchun Peng

The generative large language models (LLMs) are increasingly used for data augmentation tasks, where text samples are paraphrased (or generated anew) and then used for classifier fine-tuning. Existing works on augmentation leverage the…

Computation and Language · Computer Science 2024-10-15 Jan Cegin , Branislav Pecher , Jakub Simko , Ivan Srba , Maria Bielikova , Peter Brusilovsky

This study addresses the interaction challenges encountered by spoken dialogue systems (SDSs) when engaging with users who exhibit distinct conversational behaviors, particularly minors, in scenarios where data are scarce. We propose a…

Computation and Language · Computer Science 2024-08-21 Zhiyang Qi , Michimasa Inaba

Automated data augmentation, which aims at engineering augmentation policy automatically, recently draw a growing research interest. Many previous auto-augmentation methods utilized a Density Matching strategy by evaluating policies in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jianwei Zhang , Dong Li , Lituan Wang , Lei Zhang

Data augmentation methods enrich datasets with augmented data to improve the performance of neural networks. Recently, automated data augmentation methods have emerged, which automatically design augmentation strategies. Existing work…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Misgana Negassi , Diane Wagner , Alexander Reiterer

Large language models (LLMs) have shown promising performance on various NLP tasks via task prompting. And their performance can be further improved by appending task demonstrations to the head of the prompt. And usually, a better…

Computation and Language · Computer Science 2023-09-12 Hongyuan Lu , Wai Lam

Synthetic data has the potential to improve the performance, training efficiency, and privacy of real training examples. Nevertheless, existing approaches for synthetic text generation are mostly heuristics and cannot generate…

Machine Learning · Computer Science 2025-06-10 Dang Nguyen , Zeman Li , Mohammadhossein Bateni , Vahab Mirrokni , Meisam Razaviyayn , Baharan Mirzasoleiman

Pretrained large language models (LLMs) are currently state-of-the-art for solving the vast majority of natural language processing tasks. While many real-world applications still require fine-tuning to reach satisfactory levels of…

Text augmentation techniques are widely used in text classification problems to improve the performance of classifiers, especially in low-resource scenarios. Whilst lots of creative text augmentation methods have been designed, they augment…

Computation and Language · Computer Science 2021-09-02 Biyang Guo , Sonqiao Han , Hailiang Huang

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

Information Retrieval · Computer Science 2023-11-28 Abhijit Anand , Jurek Leonhardt , Jaspreet Singh , Koustav Rudra , Avishek Anand

Data augmentation, a technique in which a training set is expanded with class-preserving transformations, is ubiquitous in modern machine learning pipelines. In this paper, we seek to establish a theoretical framework for understanding data…

Machine Learning · Computer Science 2019-03-21 Tri Dao , Albert Gu , Alexander J. Ratner , Virginia Smith , Christopher De Sa , Christopher Ré

Sequential recommender systems have recently achieved significant performance improvements with the exploitation of deep learning (DL) based methods. However, although various DL-based methods have been introduced, most of them only focus…

Information Retrieval · Computer Science 2022-03-29 Joo-yeong Song , Bongwon Suh