English
Related papers

Related papers: AlignMixup: Improving Representations By Interpola…

200 papers

Autoencoders represent an effective approach for computing the underlying factors characterizing datasets of different types. The latent representation of autoencoders have been studied in the context of enabling interpolation between data…

Machine Learning · Computer Science 2020-10-23 Alon Oring , Zohar Yakhini , Yacov Hel-Or

Mixup is a data augmentation technique that enhances model generalization by interpolating between data points using a mixing ratio $\lambda$ in the image domain. Recently, the concept of mixup has been adapted to the graph domain through…

Machine Learning · Computer Science 2024-12-12 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yibing Zhan , Yiheng Lu , Dapeng Tao

Mixup, a recent proposed data augmentation method through linearly interpolating inputs and modeling targets of random samples, has demonstrated its capability of significantly improving the predictive accuracy of the state-of-the-art…

Computation and Language · Computer Science 2019-05-23 Hongyu Guo , Yongyi Mao , Richong Zhang

Mixup is a widely adopted strategy for training deep networks, where additional samples are augmented by interpolating inputs and labels of training pairs. Mixup has shown to improve classification performance, network calibration, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Thomas Mensink , Pascal Mettes

Mixup - a neural network regularization technique based on linear interpolation of labeled sample pairs - has stood out by its capacity to improve model's robustness and generalizability through a surprisingly simple formalism. However, its…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Shahine Bouabid , Vincent Delaitre

We develop a novel data-driven nonlinear mixup mechanism for graph data augmentation and present different mixup functions for sample pairs and their labels. Mixup is a data augmentation method to create new training data by linearly…

Machine Learning · Computer Science 2022-10-31 Madeline Navarro , Santiago Segarra

Mixup is a regularization technique that artificially produces new samples using convex combinations of original training points. This simple technique has shown strong empirical performance, and has been heavily used as part of…

Machine Learning · Computer Science 2022-11-01 Arslan Chaudhry , Aditya Krishna Menon , Andreas Veit , Sadeep Jayasumana , Srikumar Ramalingam , Sanjiv Kumar

Mixup augmentation has emerged as a widely used technique for improving the generalization ability of deep neural networks (DNNs). However, the lack of standardized implementations and benchmarks has impeded recent progress, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Siyuan Li , Zedong Wang , Zicheng Liu , Juanxi Tian , Di Wu , Cheng Tan , Weiyang Jin , Stan Z. Li

Metric learning involves learning a discriminative representation such that embeddings of similar classes are encouraged to be close, while embeddings of dissimilar classes are pushed far apart. State-of-the-art methods focus mostly on…

Data mixing (e.g., Mixup, Cutmix, ResizeMix) is an essential component for advancing recognition models. In this paper, we focus on studying its effectiveness in the self-supervised setting. By noticing the mixed images that share the same…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Sucheng Ren , Huiyu Wang , Zhengqi Gao , Shengfeng He , Alan Yuille , Yuyin Zhou , Cihang Xie

Convolutional neural networks for visual recognition require large amounts of training samples and usually benefit from data augmentation. This paper proposes PatchMix, a data augmentation method that creates new samples by composing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Paola Cascante-Bonilla , Arshdeep Sekhon , Yanjun Qi , Vicente Ordonez

Autoencoders are important generative models that, among others, have the ability to interpolate image sequences. However, interpolated images are usually not semantically meaningful.In this paper, motivated by dynamic optimal transport, we…

Optimization and Control · Mathematics 2024-04-16 Xue Feng , Thomas Strohmer

Mixup is a data-dependent regularization technique that consists in linearly interpolating input samples and associated outputs. It has been shown to improve accuracy when used to train on standard machine learning datasets. However,…

Machine Learning · Computer Science 2022-01-13 Raphael Baena , Lucas Drumetz , Vincent Gripon

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

Data augmentation is now an essential part of the image training process, as it effectively prevents overfitting and makes the model more robust against noisy datasets. Recent mixing augmentation strategies have advanced to generate the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Minsoo Kang , Suhyun Kim

Deep neural networks excel at learning the training data, but often provide incorrect and confident predictions when evaluated on slightly different test examples. This includes distribution shifts, outliers, and adversarial examples. To…

Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been gradually replaced…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huafeng Qin , Xin Jin , Yun Jiang , Mounim A. El-Yacoubi , Xinbo Gao

Interpolation-based Data Augmentation (DA) methods (Mixup) linearly interpolate the inputs and labels of two or more training examples. Mixup has more recently been adapted to the field of Natural Language Processing (NLP), mainly for…

Computation and Language · Computer Science 2023-11-17 Yuxin Pei , Pushkar Bhuse , Zhengzhong Liu , Eric Xing

Mixup generates augmented samples by linearly interpolating inputs and labels with a controllable ratio. However, since it operates in the latent embedding level, the resulting samples are not human-interpretable. In contrast, LLM-based…

Computation and Language · Computer Science 2026-02-09 Fanshuang Kong , Richong Zhang , Qiyu Sun , Zhijie Nie , Ting Deng , Chunming Hu

Data augmentation techniques play an important role in enhancing the performance of deep learning models. Despite their proven benefits in computer vision tasks, their application in the other domains remains limited. This paper proposes a…

Machine Learning · Computer Science 2024-01-23 Yousef El-Laham , Elizabeth Fons , Dillon Daudert , Svitlana Vyetrenko