中文
相关论文

相关论文: How Does Mixup Help With Robustness and Generaliza…

200 篇论文

Domain generalization (DG) aims to learn a generalizable model from multiple training domains such that it can perform well on unseen target domains. A popular strategy is to augment training data to benefit generalization through methods…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Wang Lu , Jindong Wang , Han Yu , Lei Huang , Xiang Zhang , Yiqiang Chen , Xing Xie

Data augmentation (DA) is indispensable in modern machine learning and deep neural networks. The basic idea of DA is to construct new training data to improve the model's generalization by adding slightly disturbed versions of existing data…

机器学习 · 计算机科学 2024-06-05 Chengtai Cao , Fan Zhou , Yurou Dai , Jianping Wang , Kunpeng Zhang

MixUp is a recently proposed data-augmentation scheme, which linearly interpolates a random pair of training examples and correspondingly the one-hot representations of their labels. Training deep neural networks with such additional data…

机器学习 · 计算机科学 2018-11-26 Hongyu Guo , Yongyi Mao , Richong Zhang

We propose \emph{MaxUp}, an embarrassingly simple, highly effective technique for improving the generalization performance of machine learning models, especially deep neural networks. The idea is to generate a set of augmented data with…

机器学习 · 计算机科学 2020-02-24 Chengyue Gong , Tongzheng Ren , Mao Ye , Qiang Liu

We show that the effectiveness of the well celebrated Mixup [Zhang et al., 2018] can be further improved if instead of using it as the sole learning objective, it is utilized as an additional regularizer to the standard cross-entropy loss.…

机器学习 · 计算机科学 2023-02-08 Francesco Pinto , Harry Yang , Ser-Nam Lim , Philip H. S. Torr , Puneet K. Dokania

Data augmentation techniques, such as simple image transformations and combinations, are highly effective at improving the generalization of computer vision models, especially when training data is limited. However, such techniques are…

机器学习 · 计算机科学 2023-11-03 Wenxuan Bao , Francesco Pittaluga , Vijay Kumar B G , Vincent Bindschaedler

It has been widely recognized that adversarial examples can be easily crafted to fool deep networks, which mainly root from the locally non-linear behavior nearby input examples. Applying mixup in training provides an effective mechanism to…

机器学习 · 计算机科学 2020-02-21 Tianyu Pang , Kun Xu , Jun Zhu

MixUp is a data augmentation strategy where additional samples are generated during training by combining random pairs of training samples and their labels. However, selecting random pairs is not potentially an optimal choice. In this work,…

计算与语言 · 计算机科学 2022-05-09 Seo Yeon Park , Cornelia Caragea

We develop a novel data-driven nonlinear mixup mechanism for graph data augmentation and present different mixup functions for sample pairs and their labels. Mixup is a data augmentation method to create new training data by linearly…

机器学习 · 计算机科学 2022-10-31 Madeline Navarro , Santiago Segarra

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

Mixup is a data augmentation strategy that employs convex combinations of training instances and their respective labels to augment the robustness and calibration of deep neural networks. Despite its widespread adoption, the nuanced…

机器学习 · 计算机科学 2024-02-12 Quinn Fisher , Haoming Meng , Vardan Papyan

We propose the first unified theoretical analysis of mixed sample data augmentation (MSDA), such as Mixup and CutMix. Our theoretical results show that regardless of the choice of the mixing strategy, MSDA behaves as a pixel-level…

机器学习 · 计算机科学 2022-08-23 Chanwoo Park , Sangdoo Yun , Sanghyuk Chun

As more and more artificial intelligence (AI) technologies move from the laboratory to real-world applications, the open-set and robustness challenges brought by data from the real world have received increasing attention. Data augmentation…

机器学习 · 计算机科学 2022-12-09 Zhendong Liu , Wenyu Jiang , Min guo , Chongjun Wang

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

机器学习 · 计算机科学 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

While deep neural networks achieve great performance on fitting the training distribution, the learned networks are prone to overfitting and are susceptible to adversarial attacks. In this regard, a number of mixup based augmentation…

机器学习 · 计算机科学 2021-01-01 Jang-Hyun Kim , Wonho Choo , Hyun Oh Song

Mixed Sample Data Augmentation (MSDA) has received increasing attention in recent years, with many successful variants such as MixUp and CutMix. By studying the mutual information between the function learned by a VAE on the original data…

机器学习 · 计算机科学 2021-03-02 Ethan Harris , Antonia Marcu , Matthew Painter , Mahesan Niranjan , Adam Prügel-Bennett , Jonathon Hare

This paper investigates the relationship between graph convolution and Mixup techniques. Graph convolution in a graph neural network involves aggregating features from neighboring samples to learn representative features for a specific node…

While deep AUC maximization (DAM) has shown remarkable success on imbalanced medical tasks, e.g., chest X-rays classification and skin lesions classification, it could suffer from severe overfitting when applied to small datasets due to its…

机器学习 · 计算机科学 2023-10-19 Jianzhi Xv , Gang Li , Tianbao Yang

Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been gradually replaced…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Huafeng Qin , Xin Jin , Yun Jiang , Mounim A. El-Yacoubi , Xinbo Gao

Data augmentation is a common practice to help generalization in the procedure of deep model training. In the context of physiological time series classification, previous research has primarily focused on label-invariant data augmentation…

机器学习 · 计算机科学 2023-09-19 Peikun Guo , Huiyuan Yang , Akane Sano