English
Related papers

Related papers: MixupE: Understanding and Improving Mixup from Dir…

200 papers

Deep neural networks excel at learning the training data, but often provide incorrect and confident predictions when evaluated on slightly different test examples. This includes distribution shifts, outliers, and adversarial examples. To…

Despite substantial progress in the field of deep learning, overfitting persists as a critical challenge, and data augmentation has emerged as a particularly promising approach due to its capacity to enhance model generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Wen Liang , Youzhi Liang , Jianguo Jia

Mixup data augmentation approaches have been applied for various tasks of deep learning to improve the generalization ability of deep neural networks. Some existing approaches CutMix, SaliencyMix, etc. randomly replace a patch in one image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Huafeng Qin , Xin Jin , Hongyu Zhu , Hongchao Liao , Mounîm A. El-Yacoubi , Xinbo Gao

We present a simple and yet effective interpolation-based regularization technique, aiming to improve the generalization of Graph Neural Networks (GNNs) on supervised graph classification. We leverage Mixup, an effective regularizer for…

Machine Learning · Computer Science 2022-11-28 Hongyu Guo , Yongyi Mao

For classifying digital whole slide images in the absence of pixel level annotation, typically multiple instance learning methods are applied. Due to the generic applicability, such methods are currently of very high interest in the…

This paper introduces a simple extension of mixup (Zhang et al., 2018) data augmentation to enhance generalization in visual recognition tasks. Unlike the vanilla mixup method, which blends entire images, our approach focuses on combining…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Saptarshi Saha , Utpal Garain

Obtaining object response maps is one important step to achieve weakly-supervised semantic segmentation using image-level labels. However, existing methods rely on the classification task, which could result in a response map only attending…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yu-Ting Chang , Qiaosong Wang , Wei-Chih Hung , Robinson Piramuthu , Yi-Hsuan Tsai , Ming-Hsuan Yang

In the Mixup training paradigm, a model is trained using convex combinations of data points and their associated labels. Despite seeing very few true data points during training, models trained using Mixup seem to still minimize the…

Machine Learning · Computer Science 2022-02-22 Muthu Chidambaram , Xiang Wang , Yuzheng Hu , Chenwei Wu , Rong Ge

Modern deep learning training procedures rely on model regularization techniques such as data augmentation methods, which generate training samples that increase the diversity of data and richness of label information. A popular recent…

Machine Learning · Computer Science 2022-04-08 Kumar Abhishek , Colin J. Brown , Ghassan Hamarneh

Training with noisy class labels impairs neural networks' generalization performance. In this context, mixup is a popular regularization technique to improve training robustness by making memorizing false class labels more difficult.…

Machine Learning · Computer Science 2024-05-07 Marek Herde , Lukas Lührs , Denis Huseljic , Bernhard Sick

Mixup is a data augmentation strategy that employs convex combinations of training instances and their respective labels to augment the robustness and calibration of deep neural networks. Despite its widespread adoption, the nuanced…

Machine Learning · Computer Science 2024-02-12 Quinn Fisher , Haoming Meng , Vardan Papyan

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbations still remain as…

Machine Learning · Computer Science 2021-02-08 Jang-Hyun Kim , Wonho Choo , Hosan Jeong , Hyun Oh Song

In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen…

Machine Learning · Statistics 2024-03-20 Luhuan Wu , Sinead Williamson

Respiratory sound classification plays a pivotal role in diagnosing respiratory diseases. While deep learning models have shown success with various respiratory sound datasets, our experiments indicate that models trained on one dataset…

Sound · Computer Science 2025-01-03 Shijia Ge , Weixiang Zhang , Shuzhao Xie , Baixu Yan , Zhi Wang

Transferring knowledge from large source datasets is an effective way to fine-tune the deep neural networks of the target task with a small sample size. A great number of algorithms have been proposed to facilitate deep transfer learning,…

Machine Learning · Computer Science 2020-07-21 Xingjian Li , Haoyi Xiong , Haozhe An , Chengzhong Xu , Dejing Dou

Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Shaoyu Zhang , Chen Chen , Xiujuan Zhang , Silong Peng

While deep neural networks achieve great performance on fitting the training distribution, the learned networks are prone to overfitting and are susceptible to adversarial attacks. In this regard, a number of mixup based augmentation…

Machine Learning · Computer Science 2021-01-01 Jang-Hyun Kim , Wonho Choo , Hyun Oh Song

Neural networks are prone to overfitting and memorizing data patterns. To avoid over-fitting and enhance their generalization and performance, various methods have been suggested in the literature, including dropout, regularization, label…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Humza Naveed , Saeed Anwar , Munawar Hayat , Kashif Javed , Ajmal Mian

Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar

The Mixup method (Zhang et al. 2018), which uses linearly interpolated data, has emerged as an effective data augmentation tool to improve generalization performance and the robustness to adversarial examples. The motivation is to curtail…

Machine Learning · Computer Science 2020-12-25 Minjin Kim , Young-geun Kim , Dongha Kim , Yongdai Kim , Myunghee Cho Paik