English
Related papers

Related papers: MixUp as Locally Linear Out-Of-Manifold Regulariza…

200 papers

Mixup generates augmented samples by linearly interpolating inputs and labels with a controllable ratio. However, since it operates in the latent embedding level, the resulting samples are not human-interpretable. In contrast, LLM-based…

Computation and Language · Computer Science 2026-02-09 Fanshuang Kong , Richong Zhang , Qiyu Sun , Zhijie Nie , Ting Deng , Chunming Hu

Data augmentation is a common practice to help generalization in the procedure of deep model training. In the context of physiological time series classification, previous research has primarily focused on label-invariant data augmentation…

Machine Learning · Computer Science 2023-09-19 Peikun Guo , Huiyuan Yang , Akane Sano

Mixup is a data augmentation technique that relies on training using random convex combinations of data points and their labels. In recent years, Mixup has become a standard primitive used in the training of state-of-the-art image…

Machine Learning · Computer Science 2024-11-06 Muthu Chidambaram , Xiang Wang , Chenwei Wu , Rong Ge

In this work, we propose data augmentation methods for embeddings from pre-trained deep learning models that take a weighted combination of a pair of input embeddings, as inspired by Mixup, and combine such augmentation with extra label…

Machine Learning · Computer Science 2020-10-07 Cameron R. Wolfe , Keld T. Lundgaard

In recent years, various deep learning techniques have been exploited in side channel attacks, with the anticipation of obtaining more appreciable attack results. Most of them concentrate on improving network architectures or putting…

Cryptography and Security · Computer Science 2024-01-18 Zhimin Luo , Mengce Zheng , Ping Wang , Minhui Jin , Jiajia Zhang , Honggang Hu

Modern handwritten text recognition techniques employ deep recurrent neural networks. The use of these techniques is especially efficient when a large amount of annotated data is available for parameter estimation. Data augmentation can be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Bastien Moysset , Ronaldo Messina

The Mixup method (Zhang et al. 2018), which uses linearly interpolated data, has emerged as an effective data augmentation tool to improve generalization performance and the robustness to adversarial examples. The motivation is to curtail…

Machine Learning · Computer Science 2020-12-25 Minjin Kim , Young-geun Kim , Dongha Kim , Yongdai Kim , Myunghee Cho Paik

Mixup is a highly successful technique to improve generalization of neural networks by augmenting the training data with combinations of random pairs. Selective mixup is a family of methods that apply mixup to specific pairs, e.g. only…

Machine Learning · Computer Science 2023-06-06 Damien Teney , Jindong Wang , Ehsan Abbasnejad

Mixup is a widely adopted data augmentation technique known for enhancing the generalization of machine learning models by interpolating between data points. Despite its success and popularity, limited attention has been given to…

Machine Learning · Computer Science 2025-03-05 Chungpa Lee , Jongho Im , Joseph H. T. Kim

Improving the generalization of deep networks is an important open challenge, particularly in domains without plentiful data. The mixup algorithm improves generalization by linearly interpolating a pair of examples and their corresponding…

Machine Learning · Computer Science 2022-10-13 Huaxiu Yao , Yiping Wang , Linjun Zhang , James Zou , Chelsea Finn

Image classification with deep neural networks has seen a surge of technological breakthroughs with promising applications in areas such as face recognition, medical imaging, and autonomous driving. In engineering problems, however, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Hongjiang Li , Huanyi Shui , Alemayehu Admasu , Praveen Narayanan , Devesh Upadhyay

Mixup, a recent proposed data augmentation method through linearly interpolating inputs and modeling targets of random samples, has demonstrated its capability of significantly improving the predictive accuracy of the state-of-the-art…

Computation and Language · Computer Science 2019-05-23 Hongyu Guo , Yongyi Mao , Richong Zhang

We show that the effectiveness of the well celebrated Mixup [Zhang et al., 2018] can be further improved if instead of using it as the sole learning objective, it is utilized as an additional regularizer to the standard cross-entropy loss.…

Machine Learning · Computer Science 2023-02-08 Francesco Pinto , Harry Yang , Ser-Nam Lim , Philip H. S. Torr , Puneet K. Dokania

Highly imbalanced datasets are ubiquitous in medical image classification problems. In such problems, it is often the case that rare classes associated to less prevalent diseases are severely under-represented in labeled databases,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Adrian Galdran , Gustavo Carneiro , Miguel A. González Ballester

Mixup is a data augmentation technique that enhances model generalization by interpolating between data points using a mixing ratio $\lambda$ in the image domain. Recently, the concept of mixup has been adapted to the graph domain through…

Machine Learning · Computer Science 2024-12-12 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yibing Zhan , Yiheng Lu , Dapeng Tao

Mixup and its variants form a popular class of data augmentation techniques.Using a random sample pair, it generates a new sample by linear interpolation of the inputs and labels. However, generating only one single interpolation may limit…

Machine Learning · Computer Science 2024-06-04 Lifeng Shen , Jincheng Yu , Hansi Yang , James T. Kwok

Data augmentation with \textbf{Mixup} has been proven an effective method to regularize the current deep neural networks. Mixup generates virtual samples and corresponding labels at once through linear interpolation. However, this one-stage…

Machine Learning · Computer Science 2022-06-07 Xiangjin Xie , Yangning Li , Wang Chen , Kai Ouyang , Li Jiang , Haitao Zheng

We present a simple and yet effective interpolation-based regularization technique, aiming to improve the generalization of Graph Neural Networks (GNNs) on supervised graph classification. We leverage Mixup, an effective regularizer for…

Machine Learning · Computer Science 2022-11-28 Hongyu Guo , Yongyi Mao

A well-calibrated neural model produces confidence (probability outputs) closely approximated by the expected accuracy. While prior studies have shown that mixup training as a data augmentation technique can improve model calibration on…

Computation and Language · Computer Science 2022-03-16 Seo Yeon Park , Cornelia Caragea

Deep reinforcement learning (RL) agents trained in a limited set of environments tend to suffer overfitting and fail to generalize to unseen testing environments. To improve their generalizability, data augmentation approaches (e.g. cutout…

Machine Learning · Computer Science 2020-10-22 Kaixin Wang , Bingyi Kang , Jie Shao , Jiashi Feng