English
Related papers

Related papers: Not Enough Data? Deep Learning to the Rescue!

200 papers

Data augmentation is an effective way to improve the performance of many neural text generation models. However, current data augmentation methods need to define or choose proper data mapping functions that map the original samples into the…

Computation and Language · Computer Science 2021-05-31 Wei Bi , Huayang Li , Jiacheng Huang

Data augmentation is a widely employed technique to alleviate the problem of data scarcity. In this work, we propose a prompting-based approach to generate labelled training data for intent classification with off-the-shelf language models…

Computation and Language · Computer Science 2022-04-06 Gaurav Sahu , Pau Rodriguez , Issam H. Laradji , Parmida Atighehchian , David Vazquez , Dzmitry Bahdanau

Detection of some types of toxic language is hampered by extreme scarcity of labeled training data. Data augmentation - generating new synthetic data from a labeled seed dataset - can help. The efficacy of data augmentation on toxic…

Computation and Language · Computer Science 2020-10-27 Mika Juuti , Tommi Gröndahl , Adrian Flanagan , N. Asokan

Data augmentation techniques are widely used in text classification tasks to improve the performance of classifiers, especially in low-resource scenarios. Most previous methods conduct text augmentation without considering the different…

Computation and Language · Computer Science 2022-09-07 Biyang Guo , Songqiao Han , Hailiang Huang

Data Augmentation (DA) is frequently used to provide additional training data without extra human annotation automatically. However, data augmentation may introduce noisy data that impairs training. To guarantee the quality of augmented…

Computation and Language · Computer Science 2024-02-01 Tianqing Fang , Wenxuan Zhou , Fangyu Liu , Hongming Zhang , Yangqiu Song , Muhao Chen

Despite large successes of recent language models on diverse tasks, they suffer from severe performance degeneration in low-resource settings with limited training data available. Many existing works tackle this problem by generating…

Computation and Language · Computer Science 2024-02-22 Minju Seo , Jinheon Baek , James Thorne , Sung Ju Hwang

Prevalent supervised learning methods in natural language processing (NLP) are notoriously data-hungry, which demand large amounts of high-quality annotated data. In practice, acquiring such data is a costly endeavor. Recently, the superior…

Computation and Language · Computer Science 2023-11-01 Ruoyu Zhang , Yanzeng Li , Yongliang Ma , Ming Zhou , Lei Zou

Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks). Existing augmentation techniques either manipulate the words in the original text…

Computation and Language · Computer Science 2023-05-29 Xuming Hu , Yong Jiang , Aiwei Liu , Zhongqiang Huang , Pengjun Xie , Fei Huang , Lijie Wen , Philip S. Yu

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced…

Computation and Language · Computer Science 2020-10-26 David Lowell , Brian E. Howard , Zachary C. Lipton , Byron C. Wallace

Data augmentation is a critical contributing factor to the success of deep learning but heavily relies on prior domain knowledge which is not always available. Recent works on automatic data augmentation learn a policy to form a sequence of…

Machine Learning · Computer Science 2022-11-03 Kaiwen Yang , Yanchao Sun , Jiahao Su , Fengxiang He , Xinmei Tian , Furong Huang , Tianyi Zhou , Dacheng Tao

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples to build new training instances. Continued training with…

Computation and Language · Computer Science 2023-06-12 Tsz Kin Lam , Shigehiko Schamoni , Stefan Riezler

While most generative models show achievements in image data generation, few are developed for tabular data generation. Recently, due to success of large language models (LLM) in diverse tasks, they have also been used for tabular data…

Machine Learning · Computer Science 2024-10-30 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Svetha Venkatesh

With the ascent of large language models (LLM), natural language processing has witnessed enhancements, such as LLM-based data augmentation. Nonetheless, prior research harbors two primary concerns: firstly, a lack of contemplation…

Computation and Language · Computer Science 2024-07-02 Zhenhua Wang , Guang Xu , Ming Ren

In addressing the imbalanced issue of data within the realm of Natural Language Processing, text data augmentation methods have emerged as pivotal solutions. This data imbalance is prevalent in the research proposals submitted during the…

Computation and Language · Computer Science 2023-10-17 Xunxin Cai , Meng Xiao , Zhiyuan Ning , Yuanchun Zhou

Label distribution (LD) uses the description degree to describe instances, which provides more fine-grained supervision information when learning with label ambiguity. Nevertheless, LD is unavailable in many real-world applications. To…

Machine Learning · Computer Science 2023-03-22 Zhiqiang Kou , Yuheng Jia , Jing Wang , Boyu Shi , Xin Geng

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon

In real-world NLP applications, Large Language Models (LLMs) offer promising solutions due to their extensive training on vast datasets. However, the large size and high computation demands of LLMs limit their practicality in many…

Artificial Intelligence · Computer Science 2025-04-01 Juanhui Li , Sreyashi Nag , Hui Liu , Xianfeng Tang , Sheikh Sarwar , Limeng Cui , Hansu Gu , Suhang Wang , Qi He , Jiliang Tang

Deep learning techniques are often criticized to heavily depend on a large quantity of labeled data. This problem is even more challenging in medical image analysis where the annotator expertise is often scarce. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Florian Dubost , Gerda Bortsova , Hieab Adams , M. Arfan Ikram , Wiro Niessen , Meike Vernooij , Marleen de Bruijne

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin
‹ Prev 1 3 4 5 6 7 10 Next ›