English
Related papers

Related papers: Mixup-Transformer: Dynamic Data Augmentation for N…

200 papers

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

Mixup style data augmentation algorithms have been widely adopted in various tasks as implicit network regularization on representation learning to improve model generalization, which can be achieved by a linear interpolation of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Kangjun Liu , Ke Chen , Lihua Guo , Yaowei Wang , Kui Jia

Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar

This paper proposes a simple yet effective interpolation-based data augmentation approach termed DoubleMix, to improve the robustness of models in text classification. DoubleMix first leverages a couple of simple augmentation operations to…

Computation and Language · Computer Science 2022-09-13 Hui Chen , Wei Han , Diyi Yang , Soujanya Poria

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

Mixup is a widely adopted data augmentation technique known for enhancing the generalization of machine learning models by interpolating between data points. Despite its success and popularity, limited attention has been given to…

Machine Learning · Computer Science 2025-03-05 Chungpa Lee , Jongho Im , Joseph H. T. Kim

Training NLP systems typically assumes access to annotated data that has a single human label per example. Given imperfect labeling from annotators and inherent ambiguity of language, we hypothesize that single label is not sufficient to…

Computation and Language · Computer Science 2021-09-14 Shujian Zhang , Chengyue Gong , Eunsol Choi

Mixup is an efficient data augmentation approach that improves the generalization of neural networks by smoothing the decision boundary with mixed data. Recently, dynamic mixup methods have improved previous static policies effectively…

Machine Learning · Computer Science 2023-10-24 Zicheng Liu , Siyuan Li , Ge Wang , Cheng Tan , Lirong Wu , Stan Z. Li

Mixup is a well-established data augmentation technique, which can extend the training distribution and regularize the neural networks by creating ''mixed'' samples based on the label-equivariance assumption, i.e., a proportional mixup of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zongbo Han , Tianchi Xie , Bingzhe Wu , Qinghua Hu , Changqing Zhang

Due to long-distance correlation and powerful pretrained models, transformer-based methods have initiated a breakthrough in visual object tracking performance. Previous works focus on designing effective architectures suited for tracking,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Jie Zhao , Johan Edstedt , Michael Felsberg , Dong Wang , Huchuan Lu

Image classification with deep neural networks has seen a surge of technological breakthroughs with promising applications in areas such as face recognition, medical imaging, and autonomous driving. In engineering problems, however, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Hongjiang Li , Huanyi Shui , Alemayehu Admasu , Praveen Narayanan , Devesh Upadhyay

Data augmentation by mixing samples, such as Mixup, has widely been used typically for classification tasks. However, this strategy is not always effective due to the gap between augmented samples for training and original samples for…

Machine Learning · Computer Science 2019-06-21 Takuya Shimada , Shoichiro Yamaguchi , Kohei Hayashi , Sosuke Kobayashi

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Yet, its extensions focus on the definition of interpolation and the space where it takes place, while the…

Machine Learning · Computer Science 2022-07-01 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Modern handwritten text recognition techniques employ deep recurrent neural networks. The use of these techniques is especially efficient when a large amount of annotated data is available for parameter estimation. Data augmentation can be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Bastien Moysset , Ronaldo Messina

Data augmentation has recently seen increased interest in NLP due to more work in low-resource domains, new tasks, and the popularity of large-scale neural networks that require large amounts of training data. Despite this recent upsurge,…

Computation and Language · Computer Science 2021-12-03 Steven Y. Feng , Varun Gangal , Jason Wei , Sarath Chandar , Soroush Vosoughi , Teruko Mitamura , Eduard Hovy

In this paper, we explore and compare multiple solutions to the problem of data augmentation in image classification. Previous work has demonstrated the effectiveness of data augmentation through simple techniques, such as cropping,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Luis Perez , Jason Wang

For classifying digital whole slide images in the absence of pixel level annotation, typically multiple instance learning methods are applied. Due to the generic applicability, such methods are currently of very high interest in the…

As a pre-trained Transformer model, BERT (Bidirectional Encoder Representations from Transformers) has achieved ground-breaking performance on multiple NLP tasks. On the other hand, Boosting is a popular ensemble learning technique which…

Computation and Language · Computer Science 2020-09-15 Tongwen Huang , Qingyun She , Junlin Zhang

Mixup is an effective data augmentation method that generates new augmented samples by aggregating linear combinations of different original samples. However, if there are noises or aberrant features in the original samples, Mixup may…

Machine Learning · Computer Science 2024-05-09 Leixin Yang , Yu Xiang

Despite recent advances in large language models, building dependable and deployable NLP models typically requires abundant, high-quality training data. However, task-specific data is not available for many use cases, and manually curating…

Computation and Language · Computer Science 2024-04-30 Saumya Gandhi , Ritu Gala , Vijay Viswanathan , Tongshuang Wu , Graham Neubig