English
Related papers

Related papers: Harnessing Hard Mixed Samples with Decoupled Regul…

200 papers

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

Mixup is a procedure for data augmentation that trains networks to make smoothly interpolated predictions between datapoints. Adversarial training is a strong form of data augmentation that optimizes for worst-case predictions in a compact…

Machine Learning · Computer Science 2021-03-23 Jason Bunk , Srinjoy Chattopadhyay , B. S. Manjunath , Shivkumar Chandrasekaran

Mixup is a widely adopted data augmentation technique known for enhancing the generalization of machine learning models by interpolating between data points. Despite its success and popularity, limited attention has been given to…

Machine Learning · Computer Science 2025-03-05 Chungpa Lee , Jongho Im , Joseph H. T. Kim

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbations still remain as…

Machine Learning · Computer Science 2021-02-08 Jang-Hyun Kim , Wonho Choo , Hosan Jeong , Hyun Oh Song

We show that the effectiveness of the well celebrated Mixup [Zhang et al., 2018] can be further improved if instead of using it as the sole learning objective, it is utilized as an additional regularizer to the standard cross-entropy loss.…

Machine Learning · Computer Science 2023-02-08 Francesco Pinto , Harry Yang , Ser-Nam Lim , Philip H. S. Torr , Puneet K. Dokania

Mixup - a neural network regularization technique based on linear interpolation of labeled sample pairs - has stood out by its capacity to improve model's robustness and generalizability through a surprisingly simple formalism. However, its…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Shahine Bouabid , Vincent Delaitre

Mixup augmentation has emerged as a widely used technique for improving the generalization ability of deep neural networks (DNNs). However, the lack of standardized implementations and benchmarks has impeded recent progress, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Siyuan Li , Zedong Wang , Zicheng Liu , Juanxi Tian , Di Wu , Cheng Tan , Weiyang Jin , Stan Z. Li

Deep reinforcement learning (RL) agents trained in a limited set of environments tend to suffer overfitting and fail to generalize to unseen testing environments. To improve their generalizability, data augmentation approaches (e.g. cutout…

Machine Learning · Computer Science 2020-10-22 Kaixin Wang , Bingyi Kang , Jie Shao , Jiashi Feng

Highly imbalanced datasets are ubiquitous in medical image classification problems. In such problems, it is often the case that rare classes associated to less prevalent diseases are severely under-represented in labeled databases,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Adrian Galdran , Gustavo Carneiro , Miguel A. González Ballester

Mixup is a popular data augmentation technique based on creating new samples by linear interpolation between two given data samples, to improve both the generalization and robustness of the trained model. Knowledge distillation (KD), on the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Hongjun Choi , Eun Som Jeon , Ankita Shukla , Pavan Turaga

Despite substantial progress in the field of deep learning, overfitting persists as a critical challenge, and data augmentation has emerged as a particularly promising approach due to its capacity to enhance model generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Wen Liang , Youzhi Liang , Jianguo Jia

Mixup, which creates synthetic training instances by linearly interpolating random sample pairs, is a simple and yet effective regularization technique to boost the performance of deep models trained with SGD. In this work, we report a…

Machine Learning · Computer Science 2023-03-03 Zixuan Liu , Ziqiao Wang , Hongyu Guo , Yongyi Mao

Data augmentation plays a crucial role in enhancing the robustness and performance of machine learning models across various domains. In this study, we introduce a novel mixed-sample data augmentation method called RandoMix. RandoMix is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Data augmentation techniques, such as simple image transformations and combinations, are highly effective at improving the generalization of computer vision models, especially when training data is limited. However, such techniques are…

Machine Learning · Computer Science 2023-11-03 Wenxuan Bao , Francesco Pittaluga , Vijay Kumar B G , Vincent Bindschaedler

We develop a novel data-driven nonlinear mixup mechanism for graph data augmentation and present different mixup functions for sample pairs and their labels. Mixup is a data augmentation method to create new training data by linearly…

Machine Learning · Computer Science 2022-10-31 Madeline Navarro , Santiago Segarra

Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Mix-up is a key technique for consistency regularization-based semi-supervised learning methods, blending two or more images to generate strong-perturbed samples for strong-weak pseudo supervision. Existing mix-up operations are performed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zhiqiang Shen , Peng Cao , Junming Su , Jinzhu Yang , Osmar R. Zaiane

Deep Convolutional Neural Networks have made an incredible progress in many Computer Vision tasks. This progress, however, often relies on the availability of large amounts of the training data, required to prevent over-fitting, which in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Dominik Lewy , Jacek Mańdziuk

Inspired by the great success of Deep Neural Networks (DNNs) in natural language processing (NLP), DNNs have been increasingly applied in source code analysis and attracted significant attention from the software engineering community. Due…

Software Engineering · Computer Science 2023-01-11 Zeming Dong , Qiang Hu , Yuejun Guo , Maxime Cordy , Mike Papadakis , Zhenya Zhang , Yves Le Traon , Jianjun Zhao

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou