English
Related papers

Related papers: Automatic Data Augmentation via Invariance-Constra…

200 papers

Recently, data augmentation (DA) has emerged as a method for leveraging domain knowledge to inexpensively generate additional data in reinforcement learning (RL) tasks, often yielding substantial improvements in data efficiency. While prior…

Machine Learning · Computer Science 2024-03-19 Nicholas E. Corrado , Josiah P. Hanna

Data augmentation is essential when applying Machine Learning in small-data regimes. It generates new samples following the observed data distribution while increasing their diversity and variability to help researchers and practitioners…

Machine Learning · Computer Science 2023-04-10 Audrey Poinsot , Alessandro Leite

Data augmentation has become a standard practice in software engineering to address limited or imbalanced data sets, particularly in specialized domains like test classification and bug detection where data can be scarce. Although…

Software Engineering · Computer Science 2025-02-05 Riddhi More , Jeremy S. Bradbury

Exploiting symmetry in dynamical systems is a powerful way to improve the generalization of deep learning. The model learns to be invariant to transformation and hence is more robust to distribution shift. Data augmentation and equivariant…

Machine Learning · Computer Science 2022-06-22 Rui Wang , Robin Walters , Rose Yu

Meta learning recently has been heavily researched and helped advance the contemporary machine learning. However, achieving well-performing meta-learning model requires a large amount of training tasks with high-quality meta-data…

Machine Learning · Computer Science 2023-05-16 Jun Shu , Xiang Yuan , Deyu Meng , Zongben Xu

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

Computation and Language · Computer Science 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

Solving image classification tasks given small training datasets remains an open challenge for modern computer vision. Aggressive data augmentation and generative models are among the most straightforward approaches to overcoming the lack…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Lorenzo Brigato , Stavroula Mougiakakou

Existing automatic data augmentation (DA) methods either ignore updating DA's parameters according to the target model's state during training or adopt update strategies that are not effective enough. In this work, we design a novel data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xiaogang Xu , Hengshuang Zhao

Data augmentation (DA) techniques aim to increase data variability, and thus train deep networks with better generalisation. The pioneering AutoAugment automated the search for optimal DA policies with reinforcement learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Yonggang Li , Guosheng Hu , Yongtao Wang , Timothy Hospedales , Neil M. Robertson , Yongxin Yang

We consider the task of training machine learning models with data-dependent constraints. Such constraints often arise as empirical versions of expected value constraints that enforce fairness or stability goals. We reformulate…

Machine Learning · Statistics 2023-01-18 Songkai Xue , Yuekai Sun , Mikhail Yurochkin

Deep Learning (DL) methods have emerged as one of the most powerful tools for functional approximation and prediction. While the representation properties of DL have been well studied, uncertainty quantification remains challenging and…

Machine Learning · Statistics 2022-10-25 Yuexi Wang , Nicholas G. Polson , Vadim O. Sokolov

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

In contrastive representation learning, data representation is trained so that it can classify the image instances even when the images are altered by augmentations. However, depending on the datasets, some augmentations can damage the…

Machine Learning · Statistics 2021-11-16 Masanori Koyama , Kentaro Minami , Takeru Miyato , Yarin Gal

Data augmentation in deep neural networks is the process of generating artificial data in order to reduce the variance of the classifier with the goal to reduce the number of errors. This idea has been shown to improve deep neural network's…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller

Data augmentation has been an indispensable tool to improve the performance of deep neural networks, however the augmentation can hardly transfer among different tasks and datasets. Consequently, a recent trend is to adopt AutoML technique…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aoming Liu , Zehao Huang , Zhiwu Huang , Naiyan Wang

Data augmentation methods have been shown to be a fundamental technique to improve generalization in tasks such as image, text and audio classification. Recently, automated augmentation methods have led to further improvements on image…

Machine Learning · Computer Science 2021-02-17 Elizabeth Fons , Paula Dawson , Xiao-jun Zeng , John Keane , Alexandros Iosifidis

A key challenge in leveraging data augmentation for neural network training is choosing an effective augmentation policy from a large search space of candidate operations. Properly chosen augmentation policies can lead to significant…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Daniel Ho , Eric Liang , Ion Stoica , Pieter Abbeel , Xi Chen

The use of deep learning for radio modulation recognition has become prevalent in recent years. This approach automatically extracts high-dimensional features from large datasets, facilitating the accurate classification of modulation…

Machine Learning · Computer Science 2023-11-08 Tao Chen , Shilian Zheng , Kunfeng Qiu , Luxin Zhang , Qi Xuan , Xiaoniu Yang

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares