English
Related papers

Related papers: Tied-Augment: Controlling Representation Similarit…

200 papers

Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Ryuichiro Hataya , Jan Zdenek , Kazuki Yoshizoe , Hideki Nakayama

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

We propose a new regularization method to alleviate over-fitting in deep neural networks. The key idea is utilizing randomly transformed training samples to regularize a set of sub-networks, which are originated by sampling the width of the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Taojiannan Yang , Sijie Zhu , Chen Chen

Machine learning (ML) on tabular data is ubiquitous, yet obtaining abundant high-quality tabular data for model training remains a significant obstacle. Numerous works have focused on tabular data augmentation (TDA) to enhance the original…

Machine Learning · Computer Science 2024-08-01 Lingxi Cui , Huan Li , Ke Chen , Lidan Shou , Gang Chen

The advent of accessible Generative AI tools enables anyone to create and spread synthetic images on social media, often with the intention to mislead, thus posing a significant threat to online information integrity. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Efthymia Amarantidou , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Data augmentation is usually adopted to increase the amount of training data, prevent overfitting and improve the performance of deep models. However, in practice, random data augmentation, such as random image cropping, is low-efficiency…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Tao Hu , Honggang Qi , Qingming Huang , Yan Lu

Data augmentation is an important technique to reduce overfitting and improve learning performance, but existing works on data augmentation for 3D point cloud data are based on heuristics. In this work, we instead propose to automatically…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Wanyue Zhang , Xun Xu , Fayao Liu , Le Zhang , Chuan-Sheng Foo

Contrary to most machine learning models, modern deep artificial neural networks typically include multiple components that contribute to regularization. Despite the fact that some (explicit) regularization techniques, such as weight decay…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Alex Hernández-García , Peter König

Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies…

Quantitative Methods · Quantitative Biology 2020-06-03 Ruqian Hao , Khashayar Namdar , Lin Liu , Masoom A. Haider , Farzad Khalvati

Data augmentation is a key element for training accurate models by reducing overfitting and improving generalization. For image classification, the most popular data augmentation techniques range from simple photometric and geometrical…

Machine Learning · Computer Science 2022-11-02 Avery Ma , Nikita Dvornik , Ran Zhang , Leila Pishdad , Konstantinos G. Derpanis , Afsaneh Fazly

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced…

Computation and Language · Computer Science 2020-10-26 David Lowell , Brian E. Howard , Zachary C. Lipton , Byron C. Wallace

Deep learning has recently been applied to automatically classify the modulation categories of received radio signals without manual experience. However, training deep learning models requires massive volume of data. An insufficient…

Signal Processing · Electrical Eng. & Systems 2019-12-11 Liang Huang , Weijian Pan , You Zhang , LiPing Qian , Nan Gao , Yuan Wu

Synthetic images are an option for augmenting limited medical imaging datasets to improve the performance of various machine learning models. A common metric for evaluating synthetic image quality is the Fr\'echet Inception Distance (FID)…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Thomas Wallace , Ik Siong Heng , Senad Subasic , Chris Messenger

Automated data augmentation has shown superior performance in image recognition. Existing works search for dataset-level augmentation policies without considering individual sample variations, which are likely to be sub-optimal. On the…

Machine Learning · Computer Science 2020-12-23 Fengwei Zhou , Jiawei Li , Chuanlong Xie , Fei Chen , Lanqing Hong , Rui Sun , Zhenguo Li

Image classification has been a popular task due to its feasibility in real-world applications. Training neural networks by feeding them RGB images has demonstrated success over it. Nevertheless, improving the classification accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Tianhao Bu , Michalis Lazarou , Tania Stathaki

Recent works have shown that powerful pre-trained language models (PLM) can be fooled by small perturbations or intentional attacks. To solve this issue, various data augmentation techniques are proposed to improve the robustness of PLMs.…

Computation and Language · Computer Science 2021-09-14 Kun Zhou , Wayne Xin Zhao , Sirui Wang , Fuzheng Zhang , Wei Wu , Ji-Rong Wen

Data augmentation is a simple yet effective way to improve the robustness of deep neural networks (DNNs). Diversity and hardness are two complementary dimensions of data augmentation to achieve robustness. For example, AugMix explores…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Haotao Wang , Chaowei Xiao , Jean Kossaifi , Zhiding Yu , Anima Anandkumar , Zhangyang Wang

Data augmentation is a commonly used technique for increasing both the size and the diversity of labeled training sets by leveraging input transformations that preserve output labels. In computer vision domain, image augmentations have…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Alexander Buslaev , Alex Parinov , Eugene Khvedchenya , Vladimir I. Iglovikov , Alexandr A. Kalinin

Data augmentation improves the generalization power of deep learning models by synthesizing more training samples. Sample-mixing is a popular data augmentation approach that creates additional data by combining existing samples. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Tsz-Him Cheung , Dit-Yan Yeung