English
Related papers

Related papers: A Survey on Mixup Augmentations and Beyond

200 papers

Deep learning approaches are increasingly used to tackle forecasting tasks involving datasets with multiple univariate time series. A key factor in the successful application of these methods is a large enough training sample size, which is…

Machine Learning · Computer Science 2025-01-06 Vitor Cerqueira , Moisés Santos , Luis Roque , Yassine Baghoussi , Carlos Soares

Deep neural networks (DNNs) often rely on massive labelled data for training, which is inaccessible in many applications. Data augmentation (DA) tackles data scarcity by creating new labelled data from available ones. Different DA methods…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Binyan Hu , Yu Sun , A. K. Qin

Data augmentation is one of the most effective techniques to improve the generalization performance of deep neural networks. Yet, despite often facing limited data availability in medical image analysis, it is frequently underutilized. This…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Adam Tupper , Christian Gagné

Data augmentation methods have played an important role in the recent advance of deep learning models, and have become an indispensable component of state-of-the-art models in semi-supervised, self-supervised, and supervised training for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Emirhan Kurtulus , Zichao Li , Yann Dauphin , Ekin Dogus Cubuk

Despite dropout's ubiquity in machine learning, its effectiveness as a form of data augmentation remains under-explored. We address two key questions: (i) When is dropout effective as an augmentation strategy? (ii) Is dropout uniquely…

Machine Learning · Computer Science 2025-06-02 Rickard Brüel-Gabrielsson , Tongzhou Wang , Manel Baradad , Justin Solomon

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Shaoyu Zhang , Chen Chen , Xiujuan Zhang , Silong Peng

Deep learning models have demonstrated remarkable performance across various computer vision tasks, yet their vulnerability to distribution shifts remains a critical challenge. Despite sophisticated neural network architectures, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Hafiz Mughees Ahmad , Dario Morle , Afshin Rahimi

Data augmentation is arguably the most important regularization technique commonly used to improve generalization performance of machine learning models. It primarily involves the application of appropriate data transformation operations to…

Machine Learning · Computer Science 2025-03-07 Alhassan Mumuni , Fuseini Mumuni

Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common…

Machine Learning · Computer Science 2020-04-08 Gustavo A Valencia-Zapata , Daniel Mejia , Gerhard Klimeck , Michael Zentner , Okan Ersoy

Data augmentation is an effective regularization strategy for mitigating overfitting in deep neural networks, and it plays a crucial role in 3D vision tasks, where the point cloud data is relatively limited. While mixing-based augmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Yi Wang , Jiaze Wang , Jinpeng Li , Zixu Zhao , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

In the rapidly evolving field of large language models (LLMs), data augmentation (DA) has emerged as a pivotal technique for enhancing model performance by diversifying training examples without the need for additional data collection. This…

Computation and Language · Computer Science 2024-07-03 Bosheng Ding , Chengwei Qin , Ruochen Zhao , Tianze Luo , Xinze Li , Guizhen Chen , Wenhan Xia , Junjie Hu , Anh Tuan Luu , Shafiq Joty

Mixup is a widely adopted strategy for training deep networks, where additional samples are augmented by interpolating inputs and labels of training pairs. Mixup has shown to improve classification performance, network calibration, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Thomas Mensink , Pascal Mettes

Over the past decade, deep neural networks have demonstrated significant success using the training scheme that involves mini-batch stochastic gradient descent on extensive datasets. Expanding upon this accomplishment, there has been a…

Machine Learning · Computer Science 2024-11-11 Jaehyeon Son , Soochan Lee , Gunhee Kim

Highly imbalanced datasets are ubiquitous in medical image classification problems. In such problems, it is often the case that rare classes associated to less prevalent diseases are severely under-represented in labeled databases,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Adrian Galdran , Gustavo Carneiro , Miguel A. González Ballester

Data augmentation has proven its usefulness to improve model generalization and performance. While it is commonly applied in computer vision application when it comes to multi-view systems, it is rarely used. Indeed geometric data…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Martin Engilberge , Haixin Shi , Zhiye Wang , Pascal Fua

In this paper, we investigate the challenges of complementary-label learning (CLL), a specialized form of weakly-supervised learning (WSL) where models are trained with labels indicating classes to which instances do not belong, rather than…

Machine Learning · Computer Science 2026-02-03 Tan-Ha Mai , Hsuan-Tien Lin

Mixup - a neural network regularization technique based on linear interpolation of labeled sample pairs - has stood out by its capacity to improve model's robustness and generalizability through a surprisingly simple formalism. However, its…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Shahine Bouabid , Vincent Delaitre

Large-scale, high-quality data are considered an essential factor for the successful application of many deep learning techniques. Meanwhile, numerous real-world deep learning tasks still have to contend with the lack of sufficient amounts…

Machine Learning · Computer Science 2023-10-26 Ou Wu , Rujing Yao

Deep architecture have proven capable of solving many tasks provided a sufficient amount of labeled data. In fact, the amount of available labeled data has become the principal bottleneck in low label settings such as Semi-Supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Rémy Sun , Clément Masson , Gilles Hénaff , Nicolas Thome , Matthieu Cord