English
Related papers

Related papers: SLACK: Stable Learning of Augmentations with Cold-…

200 papers

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Recently, a number of new Semi-Supervised Learning methods have emerged. As the accuracy for ImageNet and similar datasets increased over time, the performance on tasks beyond the classification of natural images is yet to be explored. Most…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Tim Frommknecht , Pedro Alves Zipf , Quanfu Fan , Nina Shvetsova , Hilde Kuehne

Data augmentation is commonly applied to improve performance of deep learning by enforcing the knowledge that certain transformations on the input preserve the output. Currently, the data augmentation parameters are chosen by human effort…

While recent automated data augmentation methods lead to state-of-the-art results, their design spaces and the derived data augmentation strategies still incorporate strong human priors. In this work, instead of fixing a set of hand-picked…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Yu Zheng , Zhi Zhang , Shen Yan , Mi Zhang

Although data augmentation is a powerful technique for improving the performance of image classification tasks, it is difficult to identify the best augmentation policy. The optimal augmentation policy, which is the latent variable, cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Koichi Kuriyama

Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Ju Xu , Mengzhang Li , Zhanxing Zhu

Data augmentation is widely used for training a neural network given little labeled data. A common practice of augmentation training is applying a composition of multiple transformations sequentially to the data. Existing augmentation…

Machine Learning · Computer Science 2024-08-27 Dongyue Li , Kailai Chen , Predrag Radivojac , Hongyang R. Zhang

Previous attempts for data augmentation are designed manually, and the augmentation policies are dataset-specific. Recently, an automatic data augmentation approach, named AutoAugment, is proposed using reinforcement learning. AutoAugment…

Machine Learning · Computer Science 2018-11-13 Mingyang Geng , Kele Xu , Bo Ding , Huaimin Wang , Lei Zhang

Aiming to produce sufficient and diverse training samples, data augmentation has been demonstrated for its effectiveness in training deep models. Regarding that the criterion of the best augmentation is challenging to define, we in this…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Yinghuan Shi , Tiexin Qin , Yong Liu , Jiwen Lu , Yang Gao , Dinggang Shen

Data augmentation is widely used as a part of the training process applied to deep learning models, especially in the computer vision domain. Currently, common data augmentation techniques are designed manually. Therefore they require…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Irynei Baran , Orest Kupyn , Arseny Kravchenko

In many scenarios, one uses a large training set to train a model with the goal of performing well on a smaller testing set with a different distribution. Learning a weight for each data point of the training set is an appealing solution,…

Machine Learning · Statistics 2023-10-27 Anastasia Ivanova , Pierre Ablin

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

Computation and Language · Computer Science 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

Dynamic data selection aims to accelerate training with lossless performance. However, reducing training data inherently limits data diversity, potentially hindering generalization. While data augmentation is widely used to enhance…

Machine Learning · Computer Science 2025-05-13 Suorong Yang , Peng Ye , Furao Shen , Dongzhan Zhou

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

In active learning, the focus is mainly on the selection strategy of unlabeled data for enhancing the generalization capability of the next learning cycle. For this, various uncertainty measurement methods have been proposed. On the other…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 SeulGi Hong , Heonjin Ha , Junmo Kim , Min-Kook Choi

In recent years, deep learning has achieved remarkable achievements in many fields, including computer vision, natural language processing, speech recognition and others. Adequate training data is the key to ensure the effectiveness of the…

Machine Learning · Computer Science 2019-05-24 Chunxu Zhang , Jiaxu Cui , Bo Yang

A key challenge in leveraging data augmentation for neural network training is choosing an effective augmentation policy from a large search space of candidate operations. Properly chosen augmentation policies can lead to significant…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Daniel Ho , Eric Liang , Ion Stoica , Pieter Abbeel , Xi Chen

Conventional data augmentation realized by performing simple pre-processing operations (\eg, rotation, crop, \etc) has been validated for its advantage in enhancing the performance for medical image segmentation. However, the data generated…

Image and Video Processing · Electrical Eng. & Systems 2020-02-25 Tiexin Qin , Ziyuan Wang , Kelei He , Yinghuan Shi , Yang Gao , Dinggang Shen

The success of deep learning depends heavily on the availability of large datasets, but in robotic manipulation there are many learning problems for which such datasets do not exist. Collecting these datasets is time-consuming and…

Robotics · Computer Science 2022-07-21 Peter Mitrano , Dmitry Berenson

Recent work has shown that data augmentation has the potential to significantly improve the generalization of deep learning models. Recently, automated augmentation strategies have led to state-of-the-art results in image classification and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Ekin D. Cubuk , Barret Zoph , Jonathon Shlens , Quoc V. Le