English
Related papers

Related papers: Adaptive Weighting Scheme for Automatic Time-Serie…

200 papers

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

Machine Learning · Computer Science 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas

A major problem in data augmentation is to ensure that the generated new samples cover the search space. This is a challenging problem and requires exploration for data augmentation policies to ensure their effectiveness in covering the…

Machine Learning · Computer Science 2020-10-08 Alireza Naghizadeh , Mohammadsajad Abavisani , Dimitris N. Metaxas

Data augmentation plays a key role in modern machine learning pipelines. While numerous augmentation strategies have been studied in the context of computer vision and natural language processing, less is known for other data modalities.…

Machine Learning · Statistics 2022-05-23 Elliott Gordon-Rodriguez , Thomas P. Quinn , John P. Cunningham

Test-time augmentation -- the aggregation of predictions across transformed versions of a test input -- is a common practice in image classification. Traditionally, predictions are combined using a simple average. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Divya Shanmugam , Davis Blalock , Guha Balakrishnan , John Guttag

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

Computation and Language · Computer Science 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks. This challenge is especially prominent in the few-shot learning scenario, where the data…

AutoAugment has sparked an interest in automated augmentation methods for deep learning models. These methods estimate image transformation policies for train data that improve generalization to test data. While recent papers evolved in the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Denis Gudovskiy , Luca Rigazio , Shun Ishizaka , Kazuki Kozuka , Sotaro Tsukizawa

Modern techniques like contrastive learning have been effectively used in many areas, including computer vision, natural language processing, and graph-structured data. Creating positive examples that assist the model in learning robust and…

Machine Learning · Computer Science 2024-02-19 Xu Zheng , Tianchun Wang , Wei Cheng , Aitian Ma , Haifeng Chen , Mo Sha , Dongsheng Luo

In the Machine Learning research community, there is a consensus regarding the relationship between model complexity and the required amount of data and computation power. In real world applications, these computational requirements are not…

Machine Learning · Computer Science 2022-08-03 Joao Fonseca , Fernando Bacao

Deep learning (DL) models have gained prominence in domains such as computer vision and natural language processing but remain underutilized for regression tasks involving tabular data. In these cases, traditional machine learning (ML)…

Machine Learning · Computer Science 2025-01-08 Assaf Shmuel , Oren Glickman , Teddy Lazebnik

Generative image models are increasingly being used for training data augmentation in vision tasks. In the context of automotive object detection, methods usually focus on producing augmented frames that look as realistic as possible, for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Jens Petersen , Davide Abati , Amirhossein Habibian , Auke Wiggers

Deep learning models have a large number of freeparameters that need to be calculated by effective trainingof the models on a great deal of training data to improvetheir generalization performance. However, data obtaining andlabeling is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Benlin Hu , Cheng Lei , Dong Wang , Shu Zhang , Zhenyu Chen

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Lok Hin Lee , Yuan Gao , J. Alison Noble

The standard approach to tackling computer vision problems is to train deep convolutional neural network (CNN) models using large-scale image datasets which are representative of the target task. However, in many scenarios, it is often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Alhassan Mumuni , Fuseini Mumuni , Nana Kobina Gerrar

Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies…

Quantitative Methods · Quantitative Biology 2020-06-03 Ruqian Hao , Khashayar Namdar , Lin Liu , Masoom A. Haider , Farzad Khalvati

This study presents the development of a spatially adaptive weighting strategy for Total Variation regularization, aimed at addressing under-determined linear inverse problems. The method leverages the rapid computation of an accurate…

Numerical Analysis · Mathematics 2025-01-20 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon