English
Related papers

Related papers: Understanding data augmentation for classification…

200 papers

Time-series data augmentation mitigates the issue of insufficient training data for deep learning models. Yet, existing augmentation methods are mainly designed for classification, where class labels can be preserved even if augmentation…

Machine Learning · Computer Science 2023-03-28 Xiyuan Zhang , Ranak Roy Chowdhury , Jingbo Shang , Rajesh Gupta , Dezhi Hong

Data augmentation is a series of techniques that generate high-quality artificial data by manipulating existing data samples. By leveraging data augmentation techniques, AI models can achieve significantly improved applicability in tasks…

Machine Learning · Computer Science 2025-10-16 Zaitian Wang , Pengfei Wang , Kunpeng Liu , Pengyang Wang , Yanjie Fu , Chang-Tien Lu , Charu C. Aggarwal , Jian Pei , Yuanchun Zhou

Based on recent advances in natural language modeling and those in text generation capabilities, we propose a novel data augmentation method for text classification tasks. We use a powerful pre-trained neural network model to artificially…

Computation and Language · Computer Science 2019-11-28 Ateret Anaby-Tavor , Boaz Carmeli , Esther Goldbraich , Amir Kantor , George Kour , Segev Shlomov , Naama Tepper , Naama Zwerdling

Deep learning usually relies on training large-scale data samples to achieve better performance. However, over-fitting based on training data always remains a problem. Scholars have proposed various strategies, such as feature dropping and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Songhao Jiang , Yan Chu , Tianxing Ma , Tianning Zang

Can we improve machine-learning (ML) emulators with synthetic data? If data are scarce or expensive to source and a physical model is available, statistically generated data may be useful for augmenting training sets cheaply. Here we…

Machine Learning · Computer Science 2021-09-28 David Meyer , Thomas Nagler , Robin J. Hogan

Deep learning approaches to breast cancer detection in mammograms have recently shown promising results. However, such models are constrained by the limited size of publicly available mammography datasets, in large part due to privacy…

Computer Vision and Pattern Recognition · Computer Science 2018-08-27 Eric Wu , Kevin Wu , David Cox , William Lotter

Recent advances in the field of artificial intelligence have been made possible by deep neural networks. In applications where data are scarce, transfer learning and data augmentation techniques are commonly used to improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Mohammad Saeed Abrishami , Amir Erfan Eshratifar , David Eigen , Yanzhi Wang , Shahin Nazarian , Massoud Pedram

Large-batch SGD is important for scaling training of deep neural networks. However, without fine-tuning hyperparameter schedules, the generalization of the model may be hampered. We propose to use batch augmentation: replicating instances…

Machine Learning · Computer Science 2019-01-29 Elad Hoffer , Tal Ben-Nun , Itay Hubara , Niv Giladi , Torsten Hoefler , Daniel Soudry

Data augmentation is usually adopted to increase the amount of training data, prevent overfitting and improve the performance of deep models. However, in practice, random data augmentation, such as random image cropping, is low-efficiency…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Tao Hu , Honggang Qi , Qingming Huang , Yan Lu

Many real world data analysis problems exhibit invariant structure, and models that take advantage of this structure have shown impressive empirical performance, particularly in deep learning. While the literature contains a variety of…

Machine Learning · Computer Science 2020-05-04 Clare Lyle , Mark van der Wilk , Marta Kwiatkowska , Yarin Gal , Benjamin Bloem-Reddy

The deep Convolutional Neural Network (CNN) became very popular as a fundamental technique for image classification and objects recognition. To improve the recognition accuracy for the more complex tasks, deeper networks have being…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Hideki Oki , Takio Kurita

We propose a novel class incremental learning approach by incorporating a feature augmentation technique motivated by adversarial attacks. We employ a classifier learned in the past to complement training examples rather than simply play a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Taehoon Kim , Jaeyoo Park , Bohyung Han

Neural networks need big annotated datasets for training. However, manual annotation can be too expensive or even unfeasible for certain tasks, like multi-person 2D pose estimation with severe occlusions. A remedy for this is synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 David T. Hoffmann , Dimitrios Tzionas , Micheal J. Black , Siyu Tang

The generative large language models (LLMs) are increasingly used for data augmentation tasks, where text samples are paraphrased (or generated anew) and then used for classifier fine-tuning. Existing works on augmentation leverage the…

Computation and Language · Computer Science 2024-10-15 Jan Cegin , Branislav Pecher , Jakub Simko , Ivan Srba , Maria Bielikova , Peter Brusilovsky

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Lorenzo Tronchin , Minh H. Vu , Paolo Soda , Tommy Löfstedt

Recent progress in material data mining has been driven by high-capacity models trained on large datasets. However, collecting experimental data (real data) has been extremely costly since the amount of human effort and expertise required.…

Representation learning methods utilizing the InfoNCE loss have demonstrated considerable capacity in reducing human annotation effort by training invariant neural feature extractors. Although different variants of the training objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanyang Chen , Yanchao Yang

Data augmentations are useful in closing the sim-to-real domain gap when training on synthetic data. This is because they widen the training data distribution, thus encouraging the model to generalize better to other domains. Many image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bram Vanherle , Nick Michiels , Frank Van Reeth

Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hungry models by…

Computation and Language · Computer Science 2023-11-14 Seokjin Oh , Su Ah Lee , Woohwan Jung

Contrastive Learning has emerged as a powerful representation learning method and facilitates various downstream tasks especially when supervised data is limited. How to construct efficient contrastive samples through data augmentation is…

Computation and Language · Computer Science 2021-11-30 Yangkai Du , Tengfei Ma , Lingfei Wu , Fangli Xu , Xuhong Zhang , Bo Long , Shouling Ji