中文
相关论文

相关论文: When does mixup promote local linearity in learned…

200 篇论文

Mixup is a procedure for data augmentation that trains networks to make smoothly interpolated predictions between datapoints. Adversarial training is a strong form of data augmentation that optimizes for worst-case predictions in a compact…

机器学习 · 计算机科学 2021-03-23 Jason Bunk , Srinjoy Chattopadhyay , B. S. Manjunath , Shivkumar Chandrasekaran

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

机器学习 · 计算机科学 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

In the Mixup training paradigm, a model is trained using convex combinations of data points and their associated labels. Despite seeing very few true data points during training, models trained using Mixup seem to still minimize the…

机器学习 · 计算机科学 2022-02-22 Muthu Chidambaram , Xiang Wang , Yuzheng Hu , Chenwei Wu , Rong Ge

Contrastive learning has shown remarkable results in recent self-supervised approaches for visual representation. By learning to contrast positive pairs' representation from the corresponding negatives pairs, one can train good visual…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Sungnyun Kim , Gihun Lee , Sangmin Bae , Se-Young Yun

Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Mixup style data augmentation algorithms have been widely adopted in various tasks as implicit network regularization on representation learning to improve model generalization, which can be achieved by a linear interpolation of labeled…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Kangjun Liu , Ke Chen , Lihua Guo , Yaowei Wang , Kui Jia

Large deep networks have demonstrated competitive performance in single image super-resolution (SISR), with a huge volume of data involved. However, in real-world scenarios, due to the limited accessible training pairs, large models exhibit…

计算机视觉与模式识别 · 计算机科学 2019-06-13 Ruicheng Feng , Jinjin Gu , Yu Qiao , Chao Dong

Deep Neural Networks (DNN) represent the state of the art in many tasks. However, due to their overparameterization, their generalization capabilities are in doubt and still a field under study. Consequently, DNN can overfit and assign…

机器学习 · 计算机科学 2021-05-19 Juan Maroñas , Daniel Ramos , Roberto Paredes

Deep reinforcement learning (RL) agents trained in a limited set of environments tend to suffer overfitting and fail to generalize to unseen testing environments. To improve their generalizability, data augmentation approaches (e.g. cutout…

机器学习 · 计算机科学 2020-10-22 Kaixin Wang , Bingyi Kang , Jie Shao , Jiashi Feng

Mixup is a well-known data-dependent augmentation technique for DNNs, consisting of two sub-tasks: mixup generation and classification. However, the recent dominant online training method confines mixup to supervised learning (SL), and the…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Siyuan Li , Zicheng Liu , Zedong Wang , Di Wu , Zihan Liu , Stan Z. Li

Mixup is a data augmentation strategy that employs convex combinations of training instances and their respective labels to augment the robustness and calibration of deep neural networks. Despite its widespread adoption, the nuanced…

机器学习 · 计算机科学 2024-02-12 Quinn Fisher , Haoming Meng , Vardan Papyan

Mixup linearly interpolates pairs of examples to form new samples, which is easy to implement and has been shown to be effective in image classification tasks. However, there are two drawbacks in mixup: one is that more training epochs are…

计算机视觉与模式识别 · 计算机科学 2021-01-13 Hao Yu , Huanyu Wang , Jianxin Wu

Few-shot learning algorithms aim to learn model parameters capable of adapting to unseen classes with the help of only a few labeled examples. A recent regularization technique - Manifold Mixup focuses on learning a general-purpose…

Mixup is a widely adopted data augmentation technique known for enhancing the generalization of machine learning models by interpolating between data points. Despite its success and popularity, limited attention has been given to…

机器学习 · 计算机科学 2025-03-05 Chungpa Lee , Jongho Im , Joseph H. T. Kim

Mixup, which creates synthetic training instances by linearly interpolating random sample pairs, is a simple and yet effective regularization technique to boost the performance of deep models trained with SGD. In this work, we report a…

机器学习 · 计算机科学 2023-03-03 Zixuan Liu , Ziqiao Wang , Hongyu Guo , Yongyi Mao

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Yet, its extensions focus on the definition of interpolation and the space where it takes place, while the…

机器学习 · 计算机科学 2022-07-01 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Network calibration aims to accurately estimate the level of confidences, which is particularly important for employing deep neural networks in real-world systems. Recent approaches leverage mixup to calibrate the network's predictions…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Jongyoun Noh , Hyekang Park , Junghyup Lee , Bumsub Ham

Mixup is a recent regularizer for current deep classification networks. Through training a neural network on convex combinations of pairs of examples and their labels, it imposes locally linear constraints on the model's input space.…

计算与语言 · 计算机科学 2021-09-16 Guang Liu , Yuzhao Mao , Hailong Huang , Weiguo Gao , Xuan Li

The deep Convolutional Neural Network (CNN) became very popular as a fundamental technique for image classification and objects recognition. To improve the recognition accuracy for the more complex tasks, deeper networks have being…

计算机视觉与模式识别 · 计算机科学 2019-06-25 Hideki Oki , Takio Kurita

Mixup is a popular data augmentation technique based on creating new samples by linear interpolation between two given data samples, to improve both the generalization and robustness of the trained model. Knowledge distillation (KD), on the…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Hongjun Choi , Eun Som Jeon , Ankita Shukla , Pavan Turaga