English
Related papers

Related papers: Augment on Manifold: Mixup Regularization with UMA…

200 papers

MixUp is a recently proposed data-augmentation scheme, which linearly interpolates a random pair of training examples and correspondingly the one-hot representations of their labels. Training deep neural networks with such additional data…

Machine Learning · Computer Science 2018-11-26 Hongyu Guo , Yongyi Mao , Richong Zhang

Mixup is a popular data augmentation technique for training deep neural networks where additional samples are generated by linearly interpolating pairs of inputs and their labels. This technique is known to improve the generalization…

Machine Learning · Computer Science 2023-10-17 Yingtian Zou , Vikas Verma , Sarthak Mittal , Wai Hoh Tang , Hieu Pham , Juho Kannala , Yoshua Bengio , Arno Solin , Kenji Kawaguchi

Among all data augmentation techniques proposed so far, linear interpolation of training samples, also called Mixup, has found to be effective for a large panel of applications. Along with improved predictive performance, Mixup is also a…

Machine Learning · Computer Science 2025-03-20 Quentin Bouniot , Pavlo Mozharovskyi , Florence d'Alché-Buc

Mixup is a data augmentation technique that creates new examples as convex combinations of training points and labels. This simple technique has empirically shown to improve the accuracy of many state-of-the-art models in different settings…

Machine Learning · Computer Science 2026-05-28 Luigi Carratino , Moustapha Cissé , Rodolphe Jenatton , Jean-Philippe Vert

As Deep Neural Networks have achieved thrilling breakthroughs in the past decade, data augmentations have garnered increasing attention as regularization techniques when massive labeled data are unavailable. Among existing augmentations,…

Machine Learning · Computer Science 2025-04-24 Xin Jin , Hongyu Zhu , Siyuan Li , Zedong Wang , Zicheng Liu , Juanxi Tian , Chang Yu , Huafeng Qin , Stan Z. Li

Mixup is an efficient data augmentation approach that improves the generalization of neural networks by smoothing the decision boundary with mixed data. Recently, dynamic mixup methods have improved previous static policies effectively…

Machine Learning · Computer Science 2023-10-24 Zicheng Liu , Siyuan Li , Ge Wang , Cheng Tan , Lirong Wu , Stan Z. Li

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

Machine learning techniques are used in a wide range of domains. However, machine learning models often suffer from the problem of over-fitting. Many data augmentation methods have been proposed to tackle such a problem, and one of them is…

Machine Learning · Statistics 2021-06-21 Masanari Kimura

Data augmentation is a common practice to help generalization in the procedure of deep model training. In the context of physiological time series classification, previous research has primarily focused on label-invariant data augmentation…

Machine Learning · Computer Science 2023-09-19 Peikun Guo , Huiyuan Yang , Akane Sano

Uniform Manifold Approximation and Projection (UMAP) is a widely used manifold learning technique for dimensionality reduction. This paper studies UMAP, supervised UMAP, and several competing dimensionality reduction methods, including…

Machine Learning · Computer Science 2026-05-04 Guanzhe Zhang , Shanshan Ding , Zhezhen Jin

Despite substantial progress in the field of deep learning, overfitting persists as a critical challenge, and data augmentation has emerged as a particularly promising approach due to its capacity to enhance model generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Wen Liang , Youzhi Liang , Jianguo Jia

While deep AUC maximization (DAM) has shown remarkable success on imbalanced medical tasks, e.g., chest X-rays classification and skin lesions classification, it could suffer from severe overfitting when applied to small datasets due to its…

Machine Learning · Computer Science 2023-10-19 Jianzhi Xv , Gang Li , Tianbao Yang

To solve the problem of poor performance of deep neural network models due to insufficient data, a simple yet effective interpolation-based data augmentation method is proposed: MSMix (Manifold Swap Mixup). This method feeds two different…

Machine Learning · Computer Science 2023-06-01 Mao Ye , Haitao Wang , Zheqian Chen

Data augmentation is a widely used technique and an essential ingredient in the recent advance in self-supervised representation learning. By preserving the similarity between augmented data, the resulting data representation can improve…

Machine Learning · Statistics 2025-01-16 Shulei Wang

Mixup is a popular data augmentation technique based on taking convex combinations of pairs of examples and their labels. This simple technique has been shown to substantially improve both the robustness and the generalization of the…

Machine Learning · Computer Science 2021-03-19 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , Amirata Ghorbani , James Zou

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

Deep neural networks excel at learning the training data, but often provide incorrect and confident predictions when evaluated on slightly different test examples. This includes distribution shifts, outliers, and adversarial examples. To…

UMAP (Uniform Manifold Approximation and Projection) is a novel manifold learning technique for dimension reduction. UMAP is constructed from a theoretical framework based in Riemannian geometry and algebraic topology. The result is a…

Machine Learning · Statistics 2020-09-21 Leland McInnes , John Healy , James Melville

MixUp is a computer vision data augmentation technique that uses convex interpolations of input data and their labels to enhance model generalization during training. However, the application of MixUp to the natural language understanding…

Computation and Language · Computer Science 2021-02-24 Wancong Zhang , Ieshan Vaidya

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou
‹ Prev 1 2 3 10 Next ›