English
Related papers

Related papers: Ctrl-A: Control-Driven Online Data Augmentation

200 papers

Automatic augmentation methods have recently become a crucial pillar for strong model performance in vision tasks. While existing automatic augmentation methods need to trade off simplicity, cost and performance, we present a most simple…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Samuel G. Müller , Frank Hutter

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

Deep neural networks have become popular in many supervised learning tasks, but they may suffer from overfitting when the training dataset is limited. To mitigate this, many researchers use data augmentation, which is a widely used and…

Machine Learning · Computer Science 2022-05-27 Jianhan Wu , Shijing Si , Jianzong Wang , Jing Xiao

We propose a novel algorithm for data augmentation in nonlinear over-parametrized regression. Our data augmentation algorithm borrows from the literature on causality and extends the recently proposed Anchor regression (AR) method for data…

Machine Learning · Computer Science 2023-11-29 Nora Schneider , Shirin Goshtasbpour , Fernando Perez-Cruz

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Data augmentation (DA) plays a critical role in improving the generalization of deep learning models. Recent works on automatically searching for DA policies from data have achieved great success. However, existing automated DA methods…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Shiqi Lin , Tao Yu , Ruoyu Feng , Xin Li , Xin Jin , Zhibo Chen

Automatic data augmentation (AutoAugment) (Cubuk et al., 2019) searches for optimal perturbation policies via a controller trained using performance rewards of a sampled policy on the target task, hence reducing data-level model bias. While…

Computation and Language · Computer Science 2019-10-01 Tong Niu , Mohit Bansal

Medical image data are often limited due to the expensive acquisition and annotation process. Hence, training a deep-learning model with only raw data can easily lead to overfitting. One solution to this problem is to augment the raw data…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Xinyue Xu , Yuhan Hsi , Haonan Wang , Xiaomeng Li

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

Data augmentation reduces the generalization error by forcing a model to learn invariant representations given different transformations of the input image. In computer vision, on top of the standard image processing functions, data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Rowel Atienza

In this work, a novel and model-based artificial neural network (ANN) training method is developed supported by optimal control theory. The method augments training labels in order to robustly guarantee training loss convergence and improve…

Optimization and Control · Mathematics 2023-03-17 Viktor Andersson , Balázs Varga , Vincent Szolnoky , Andreas Syrén , Rebecka Jörnsten , Balázs Kulcsár

Data augmentation serves as a popular regularization technique to combat overfitting challenges in neural networks. While automatic augmentation has demonstrated success in image classification tasks, its application to time-series…

Machine Learning · Computer Science 2025-06-19 Liran Nochumsohn , Omri Azencot

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Many fine-grained classification tasks, like rare animal identification, have limited training data and consequently classifiers trained on these datasets often fail to generalize to variations in the domain like changes in weather or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Lisa Dunlap , Alyssa Umino , Han Zhang , Jiezhi Yang , Joseph E. Gonzalez , Trevor Darrell

Data augmentation is a key element in training high-dimensional models. In this approach, one synthesizes new observations by applying pre-specified transformations to the original training data; e.g.~new images are formed by rotating old…

Computer Vision and Pattern Recognition · Computer Science 2016-07-01 Søren Hauberg , Oren Freifeld , Anders Boesen Lindbo Larsen , John W. Fisher , Lars Kai Hansen

We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms so as to improve the exploration of the state-space, and substantially reduce learning times by leveraging some…

Optimization and Control · Mathematics 2019-12-13 Francesco De Lellis , Fabrizia Auletta , Giovanni Russo , Piero De Lellis , Mario di Bernardo

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Panagiotis Alimisis , Ioannis Mademlis , Panagiotis Radoglou-Grammatikis , Panagiotis Sarigiannidis , Georgios Th. Papadopoulos

Automated data augmentation, which aims at engineering augmentation policy automatically, recently draw a growing research interest. Many previous auto-augmentation methods utilized a Density Matching strategy by evaluating policies in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jianwei Zhang , Dong Li , Lituan Wang , Lei Zhang

Image augmentation techniques apply transformation functions such as rotation, shearing, or color distortion on an input image. These augmentations were proven useful in improving neural networks' generalization ability. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Moab Arar , Ariel Shamir , Amit Bermano

In computer vision, contrastive learning is the most advanced unsupervised learning framework. Yet most previous methods simply apply fixed composition of data augmentations to improve data efficiency, which ignores the changes in their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yuhan Zhang , He Zhu , Shan Yu