English
Related papers

Related papers: Simple is Better! Lightweight Data Augmentation fo…

200 papers

The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora. For low-resource language pairs this is not the case, resulting in poor translation quality. Inspired by work in…

Computation and Language · Computer Science 2018-02-14 Marzieh Fadaee , Arianna Bisazza , Christof Monz

Data augmentation techniques have been widely used to improve machine learning performance as they enhance the generalization capability of models. In this work, to generate high quality synthetic data for low-resource tagging tasks, we…

Computation and Language · Computer Science 2020-11-04 Bosheng Ding , Linlin Liu , Lidong Bing , Canasai Kruengkrai , Thien Hai Nguyen , Shafiq Joty , Luo Si , Chunyan Miao

Efforts to leverage deep learning models in low-resource regimes have led to numerous augmentation studies. However, the direct application of methods such as mixup and cutout to text data, is limited due to their discrete characteristics.…

Computation and Language · Computer Science 2024-03-26 Kyohoon Jin , Junho Lee , Juhwan Choi , Sangmin Song , Youngbin Kim

Data augmentation has the potential to improve the performance of machine learning models by increasing the amount of training data available. In this study, we evaluated the effectiveness of different data augmentation techniques for a…

Machine Learning · Computer Science 2024-06-11 Aashish Arora , Elsbeth Turcan

Data augmentation has been widely used in low-resource NER tasks to tackle the problem of data sparsity. However, previous data augmentation methods have the disadvantages of disrupted syntactic structures, token-label mismatch, and…

Computation and Language · Computer Science 2023-07-18 Sihan Song , Furao Shen , Jian Zhao

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Data augmentation, a widely-employed technique for addressing data scarcity, involves generating synthetic data examples which are then used to augment available training data. Researchers have seen surprising success from simple methods,…

Computation and Language · Computer Science 2025-06-05 Ray Groshan , Michael Ginn , Alexis Palmer

Weak supervision combines the advantages of training on real data with the ability to exploit signal properties. However, training a neural network using weak supervision often requires an excessive amount of signal data, which severely…

High Energy Physics - Phenomenology · Physics 2024-12-23 Zong-En Chen , Cheng-Wei Chiang , Feng-Yang Hsieh

Specializing LLMs in various domain-specific tasks has emerged as a critical step towards achieving high performance. However, the construction and annotation of datasets in specific domains are always very costly. Apart from using superior…

Computation and Language · Computer Science 2024-12-09 Yuanhao Yue , Chengyu Wang , Jun Huang , Peng Wang

The high dimensionality and complexity of neuroimaging data necessitate large datasets to develop robust and high-performing deep learning models. However, the neuroimaging field is notably hampered by the scarcity of such datasets. In this…

Machine Learning · Computer Science 2023-12-15 Yutong Gao , Charles A. Ellis , Vince D. Calhoun , Robyn L. Miller

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

Information Retrieval · Computer Science 2023-11-28 Abhijit Anand , Jurek Leonhardt , Jaspreet Singh , Koustav Rudra , Avishek Anand

The high costs of annotating large datasets suggests a need for effectively training CNNs with limited data, and data augmentation is a promising direction. We study foundational augmentation techniques, including Mixed Sample Data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Swarna Kamlam Ravindran , Carlo Tomasi

Adapting Large Language Models in complex technical service domains is constrained by the absence of explicit cognitive chains in human demonstrations and the inherent ambiguity arising from the diversity of valid responses. These…

Imbalanced datasets present a significant challenge for machine learning models, often leading to biased predictions. To address this issue, data augmentation techniques are widely used in natural language processing (NLP) to generate new…

Computation and Language · Computer Science 2023-04-21 Gabriel O. Assunção , Rafael Izbicki , Marcos O. Prates

A spoken language understanding (SLU) system includes two main tasks, slot filling (SF) and intent detection (ID). The joint model for the two tasks is becoming a tendency in SLU. But the bi-directional interrelated connections between the…

Computation and Language · Computer Science 2019-07-02 Haihong E , Peiqing Niu , Zhongfu Chen , Meina Song

Learning in deep weight spaces (DWS), where neural networks process the weights of other neural networks, is an emerging research direction, with applications to 2D and 3D neural fields (INRs, NeRFs), as well as making inferences about…

Machine Learning · Computer Science 2024-11-12 Aviv Shamsian , Aviv Navon , David W. Zhang , Yan Zhang , Ethan Fetaya , Gal Chechik , Haggai Maron

OpenNotes enables patients to access EHR notes, but medical jargon can hinder comprehension. To improve understanding, we evaluated closed- and open-source LLMs for extracting and prioritizing key medical terms using prompting, fine-tuning,…

Computation and Language · Computer Science 2026-05-08 Won Seok Jang , Sharmin Sultana , Zonghai Yao , Hieu Tran , Zhichao Yang , Sunjae Kwon , Hong Yu

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer…

Computation and Language · Computer Science 2024-02-23 Junjie Ye , Nuo Xu , Yikun Wang , Jie Zhou , Qi Zhang , Tao Gui , Xuanjing Huang

While data augmentation is an important trick to boost the accuracy of deep learning methods in computer vision tasks, its study in natural language tasks is still very limited. In this paper, we present a novel data augmentation method for…

Computation and Language · Computer Science 2019-05-28 Jinhua Zhu , Fei Gao , Lijun Wu , Yingce Xia , Tao Qin , Wengang Zhou , Xueqi Cheng , Tie-Yan Liu