English
Related papers

Related papers: Improving Model Generalization by Agreement of Lea…

200 papers

Vision Transformers (ViT) have been shown to attain highly competitive performance for a wide range of vision applications, such as image classification, object detection and semantic image segmentation. In comparison to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Andreas Steiner , Alexander Kolesnikov , Xiaohua Zhai , Ross Wightman , Jakob Uszkoreit , Lucas Beyer

The moments (a.k.a., mean and standard deviation) of latent features are often removed as noise when training image recognition models, to increase stability and reduce training time. However, in the field of image generation, the moments…

Machine Learning · Computer Science 2021-04-01 Boyi Li , Felix Wu , Ser-Nam Lim , Serge Belongie , Kilian Q. Weinberger

In recent years, many data augmentation techniques have been proposed to increase the diversity of input data and reduce the risk of overfitting on deep neural networks. In this work, we propose an easy-to-implement and model-free data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Kun He , Chang Liu , Stephen Lin , John E. Hopcroft

We present an automated data augmentation approach for image classification. We formulate the problem as Monte Carlo sampling where our goal is to approximate the optimal augmentation policies. We propose a particle filtering scheme for the…

Machine Learning · Computer Science 2021-10-18 Alexander Tsaregorodtsev , Vasileios Belagiannis

Data augmentation (DA) is a widely used technique for enhancing the training of deep neural networks. Recent DA techniques which achieve state-of-the-art performance always meet the need for diversity in augmented training samples. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chenyang Wang , Junjun Jiang , Xiong Zhou , Xianming Liu

Data augmentation is a widely used trick when training deep neural networks: in addition to the original data, properly transformed data are also added to the training set. However, to the best of our knowledge, a clear mathematical…

Machine Learning · Statistics 2020-11-10 Shuxiao Chen , Edgar Dobriban , Jane H Lee

Data augmentation is one of the most widely used techniques to improve generalization in modern machine learning, often justified by its ability to promote invariance to label-irrelevant transformations. However, its theoretical role…

Machine Learning · Computer Science 2026-02-17 Abdelali Bouyahia , Frédéric LeBlanc , Mario Marchand

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Deep Convolutional Neural Networks have made an incredible progress in many Computer Vision tasks. This progress, however, often relies on the availability of large amounts of the training data, required to prevent over-fitting, which in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Dominik Lewy , Jacek Mańdziuk

The popularity of data augmentation techniques in machine learning has increased in recent years, as they enable the creation of new samples from existing datasets. Rotational augmentation, in particular, has shown great promise by…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Unai Muñoz-Aseguinolaza , Basilio Sierra , Naiara Aginako

Forecasting models that are trained across sets of many time series, known as Global Forecasting Models (GFM), have shown recently promising results in forecasting competitions and real-world applications, outperforming many…

Machine Learning · Computer Science 2020-08-07 Kasun Bandara , Hansika Hewamalage , Yuan-Hao Liu , Yanfei Kang , Christoph Bergmeir

Data augmentation is widely used for machine learning; however, an effective method to apply data augmentation has not been established even though it includes several factors that should be tuned carefully. One such factor is sample…

Machine Learning · Computer Science 2020-10-30 Tomoumi Takase , Ryo Karakida , Hideki Asoh

Recent studies emphasize the crucial role of data augmentation in enhancing the performance of object detection models. However,existing methodologies often struggle to effectively harmonize dataset diversity with semantic coordination.To…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Sen Nie , Zhuo Wang , Xinxin Wang , Kun He

The rapid progress in machine learning methods has been empowered by i) huge datasets that have been collected and annotated, ii) improved engineering (e.g. data pre-processing/normalization). The existing datasets typically include several…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Grigorios G. Chrysos , Yannis Panagakis , Stefanos Zafeiriou

We propose a new regularization method to alleviate over-fitting in deep neural networks. The key idea is utilizing randomly transformed training samples to regularize a set of sub-networks, which are originated by sampling the width of the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Taojiannan Yang , Sijie Zhu , Chen Chen

Data augmentation is a ubiquitous technique for improving image classification when labeled data is scarce. Constraining the model predictions to be invariant to diverse data augmentations effectively injects the desired representational…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Yuliang Zou , Jinwoo Choi , Qitong Wang , Jia-Bin Huang

Data augmentation is a popular tool for single source domain generalization, which expands the source domain by generating simulated ones, improving generalization on unseen target domains. In this work, we show that the performance of such…

Machine Learning · Computer Science 2025-05-20 Dong Kyu Cho , Inwoo Hwang , Sanghack Lee

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

With the rapid development of deep learning, automatic modulation recognition (AMR), as an important task in cognitive radio, has gradually transformed from traditional feature extraction and classification to automatic classification by…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Xinjie Xu , Zhuangzhi Chen , Dongwei Xu , Huaji Zhou , Shanqing Yu , Shilian Zheng , Qi Xuan , Xiaoniu Yang

Mixup is a data augmentation technique that creates new examples as convex combinations of training points and labels. This simple technique has empirically shown to improve the accuracy of many state-of-the-art models in different settings…

Machine Learning · Computer Science 2026-05-28 Luigi Carratino , Moustapha Cissé , Rodolphe Jenatton , Jean-Philippe Vert