English
Related papers

Related papers: A Preliminary Study on Data Augmentation of Deep L…

200 papers

Data scarcity is a problem that occurs in languages and tasks where we do not have large amounts of labeled data but want to use state-of-the-art models. Such models are often deep learning models that require a significant amount of data…

Computation and Language · Computer Science 2023-02-23 Domagoj Pluščec , Jan Šnajder

Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Ju Xu , Mengzhang Li , Zhanxing Zhu

Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Lok Hin Lee , Yuan Gao , J. Alison Noble

Data augmentations are effective in improving the invariance of learning machines. We argue that the core challenge of data augmentations lies in designing data transformations that preserve labels. This is relatively straightforward for…

Machine Learning · Computer Science 2023-03-01 Youzhi Luo , Michael McThrow , Wing Yee Au , Tao Komikado , Kanji Uchino , Koji Maruhashi , Shuiwang Ji

Data augmentation is a ubiquitous technique for improving image classification when labeled data is scarce. Constraining the model predictions to be invariant to diverse data augmentations effectively injects the desired representational…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Yuliang Zou , Jinwoo Choi , Qitong Wang , Jia-Bin Huang

Training accurate intent classifiers requires labeled data, which can be costly to obtain. Data augmentation methods may ameliorate this issue, but the quality of the generated data varies significantly across techniques. We study the…

Computation and Language · Computer Science 2022-06-14 Derek Chen , Claire Yin

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Machine Learning · Statistics 2018-12-10 Alexander J. Ratner , Henry R. Ehrenberg , Zeshan Hussain , Jared Dunnmon , Christopher Ré

The excellent performance of deep neural networks is usually accompanied by a large number of parameters and computations, which have limited their usage on the resource-limited edge devices. To address this issue, abundant methods such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Muzhou Yu , Linfeng Zhang , Kaisheng Ma

Our study investigates the impact of data augmentation on the performance of multivariate time series models, focusing on datasets from the UCR archive. Despite the limited size of these datasets, we achieved classification accuracy…

Machine Learning · Computer Science 2024-06-11 Romain Ilbert , Thai V. Hoang , Zonghua Zhang

Data augmentation is a cornerstone of the machine learning pipeline, yet its theoretical underpinnings remain unclear. Is it merely a way to artificially augment the data set size? Or is it about encouraging the model to satisfy certain…

Machine Learning · Computer Science 2022-09-22 Ruoqi Shen , Sébastien Bubeck , Suriya Gunasekar

Deep learning models have a large number of free parameters that must be estimated by efficient training of the models on a large number of training data samples to increase their generalization performance. In real-world applications, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Hojjat Salehinejad , Shahrokh Valaee , Timothy Dowdell , Joseph Barfett

Data augmentation is a commonly applied technique with two seemingly related advantages. With this method one can increase the size of the training set generating new samples and also increase the invariance of the network against the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jalal Al-afandi , Bálint Magyar , András Horváth

Data augmentation is a commonly used approach to improving the generalization of deep learning models. Recent works show that learned data augmentation policies can achieve better generalization than hand-crafted ones. However, most of…

Machine Learning · Computer Science 2021-07-14 Ya Wang , Hesen Chen , Fangyi Zhang , Yaohua Wang , Xiuyu Sun , Ming Lin , Hao Li

Data augmentation has proved extremely useful by increasing training data variance to alleviate overfitting and improve deep neural networks' generalization performance. In medical image analysis, a well-designed augmentation policy usually…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yunhe Gao , Zhiqiang Tang , Mu Zhou , Dimitris Metaxas

Deep learning models can perform well when evaluated on images from the same distribution as the training set. However, applying small perturbations in the forms of noise, artifacts, occlusions, blurring, etc. to a model's input image and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Zahra Golpayegani , Patrick St-Amant , Nizar Bouguila

Data augmentation is a key element of deep learning pipelines, as it informs the network during training about transformations of the input data that keep the label unchanged. Manually finding adequate augmentation methods and parameters…

Machine Learning · Computer Science 2022-02-09 Cédric Rommel , Thomas Moreau , Joseph Paillard , Alexandre Gramfort

In the realm of medical imaging, the training of machine learning models necessitates a large and varied training dataset to ensure robustness and interoperability. However, acquiring such diverse and heterogeneous data can be difficult due…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Manuel Cossio

Data augmentation is commonly used to encode invariances in learning methods. However, this process is often performed in an inefficient manner, as artificial examples are created by applying a number of transformations to all points in the…

Machine Learning · Computer Science 2019-03-04 Michael Kuchnik , Virginia Smith

In computer vision, it is standard practice to draw a single sample from the data augmentation procedure for each unique image in the mini-batch. However recent work has suggested drawing multiple samples can achieve higher test accuracies.…

Machine Learning · Computer Science 2022-02-25 Stanislav Fort , Andrew Brock , Razvan Pascanu , Soham De , Samuel L. Smith

Graph classification, which aims to identify the category labels of graphs, plays a significant role in drug classification, toxicity detection, protein analysis etc. However, the limitation of scale of benchmark datasets makes it easy for…

Social and Information Networks · Computer Science 2020-09-22 Jiajun Zhou , Jie Shen , Qi Xuan