English
Related papers

Related papers: Data Interpolating Prediction: Alternative Interpr…

200 papers

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

MixUp is an effective data augmentation method to regularize deep neural networks via random linear interpolations between pairs of samples and their labels. It plays an important role in model regularization, semi-supervised learning and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Zhijun Mai , Guosheng Hu , Dexiong Chen , Fumin Shen , Heng Tao Shen

Mixup is a popular data augmentation technique based on taking convex combinations of pairs of examples and their labels. This simple technique has been shown to substantially improve both the robustness and the generalization of the…

Machine Learning · Computer Science 2021-03-19 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , Amirata Ghorbani , James Zou

Despite substantial progress in the field of deep learning, overfitting persists as a critical challenge, and data augmentation has emerged as a particularly promising approach due to its capacity to enhance model generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Wen Liang , Youzhi Liang , Jianguo Jia

Mixup is a data-dependent regularization technique that consists in linearly interpolating input samples and associated outputs. It has been shown to improve accuracy when used to train on standard machine learning datasets. However,…

Machine Learning · Computer Science 2022-01-13 Raphael Baena , Lucas Drumetz , Vincent Gripon

Deep neural networks excel at learning the training data, but often provide incorrect and confident predictions when evaluated on slightly different test examples. This includes distribution shifts, outliers, and adversarial examples. To…

Data augmentation (DA) is indispensable in modern machine learning and deep neural networks. The basic idea of DA is to construct new training data to improve the model's generalization by adding slightly disturbed versions of existing data…

Machine Learning · Computer Science 2024-06-05 Chengtai Cao , Fan Zhou , Yurou Dai , Jianping Wang , Kunpeng Zhang

Given imbalanced data, it is hard to train a good classifier using deep learning because of the poor generalization of minority classes. Traditionally, the well-known synthetic minority oversampling technique (SMOTE) for data augmentation,…

Machine Learning · Computer Science 2023-11-06 Wei-Chao Cheng , Tan-Ha Mai , Hsuan-Tien Lin

Data augmentation improves the generalization power of deep learning models by synthesizing more training samples. Sample-mixing is a popular data augmentation approach that creates additional data by combining existing samples. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Tsz-Him Cheung , Dit-Yan Yeung

Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Generalization Performance of Deep Learning models trained using Empirical Risk Minimization can be improved significantly by using Data Augmentation strategies such as simple transformations, or using Mixed Samples. We attempt to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Deepan Das , Haley Massa , Abhimanyu Kulkarni , Theodoros Rekatsinas

In an attempt to provide an answer to the increasing criticism against p-values and to bridge the gap between statistical inference and prediction modelling, we introduce the probability of improved prediction (PIP). In general, the PIP is…

Methodology · Statistics 2024-05-28 Olivier Thas , Stijn Jaspers

The success of data mixing augmentations in image classification tasks has been well-received. However, these techniques cannot be readily applied to object detection due to challenges such as spatial misalignment, foreground/background…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Thanh Vu , Baochen Sun , Bodi Yuan , Alex Ngai , Yueqi Li , Jan-Michael Frahm

MixUp is a computer vision data augmentation technique that uses convex interpolations of input data and their labels to enhance model generalization during training. However, the application of MixUp to the natural language understanding…

Computation and Language · Computer Science 2021-02-24 Wancong Zhang , Ieshan Vaidya

As Deep Neural Networks have achieved thrilling breakthroughs in the past decade, data augmentations have garnered increasing attention as regularization techniques when massive labeled data are unavailable. Among existing augmentations,…

Machine Learning · Computer Science 2025-04-24 Xin Jin , Hongyu Zhu , Siyuan Li , Zedong Wang , Zicheng Liu , Juanxi Tian , Chang Yu , Huafeng Qin , Stan Z. Li

Mixup style data augmentation algorithms have been widely adopted in various tasks as implicit network regularization on representation learning to improve model generalization, which can be achieved by a linear interpolation of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Kangjun Liu , Ke Chen , Lihua Guo , Yaowei Wang , Kui Jia

Data augmentation is an important technique in training deep neural networks as it enhances their ability to generalize and remain robust. While data augmentation is commonly used to expand the sample size and act as a consistency…

Machine Learning · Computer Science 2025-02-18 Xiliang Yang , Shenyang Deng , Shicong Liu , Yuanchi Suo , Wing. W. Y NG , Jianjun Zhang

Training a classification model on a dataset where the instances of one class outnumber those of the other class is a challenging problem. Such imbalanced datasets are standard in real-world situations such as fraud detection, medical…

Machine Learning · Computer Science 2020-09-04 Anubha Kabra , Ayush Chopra , Nikaash Puri , Pinkesh Badjatiya , Sukriti Verma , Piyush Gupta , Balaji K

This paper proposes a simple yet effective interpolation-based data augmentation approach termed DoubleMix, to improve the robustness of models in text classification. DoubleMix first leverages a couple of simple augmentation operations to…

Computation and Language · Computer Science 2022-09-13 Hui Chen , Wei Han , Diyi Yang , Soujanya Poria

Image classification with deep neural networks has seen a surge of technological breakthroughs with promising applications in areas such as face recognition, medical imaging, and autonomous driving. In engineering problems, however, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Hongjiang Li , Huanyi Shui , Alemayehu Admasu , Praveen Narayanan , Devesh Upadhyay