English
Related papers

Related papers: Epsilon Consistent Mixup: Structural Regularizatio…

200 papers

Mixup is a regularization technique that artificially produces new samples using convex combinations of original training points. This simple technique has shown strong empirical performance, and has been heavily used as part of…

Machine Learning · Computer Science 2022-11-01 Arslan Chaudhry , Aditya Krishna Menon , Andreas Veit , Sadeep Jayasumana , Srikumar Ramalingam , Sanjiv Kumar

Interpolation-based Data Augmentation (DA) methods (Mixup) linearly interpolate the inputs and labels of two or more training examples. Mixup has more recently been adapted to the field of Natural Language Processing (NLP), mainly for…

Computation and Language · Computer Science 2023-11-17 Yuxin Pei , Pushkar Bhuse , Zhengzhong Liu , Eric Xing

Mixup and its variants form a popular class of data augmentation techniques.Using a random sample pair, it generates a new sample by linear interpolation of the inputs and labels. However, generating only one single interpolation may limit…

Machine Learning · Computer Science 2024-06-04 Lifeng Shen , Jincheng Yu , Hansi Yang , James T. Kwok

Mixup, a recent proposed data augmentation method through linearly interpolating inputs and modeling targets of random samples, has demonstrated its capability of significantly improving the predictive accuracy of the state-of-the-art…

Computation and Language · Computer Science 2019-05-23 Hongyu Guo , Yongyi Mao , Richong Zhang

In recent years, mixup regularization has gained popularity as an effective way to improve the generalization performance of deep learning models by training on convex combinations of training data. While many mixup variants have been…

Machine Learning · Computer Science 2025-06-16 Yousef El-Laham , Niccolò Dalmasso , Svitlana Vyetrenko , Vamsi K. Potluru , Manuela Veloso

Mixup is a popular regularization technique for training deep neural networks that improves generalization and increases robustness to certain distribution shifts. It perturbs input training data in the direction of other randomly-chosen…

Machine Learning · Computer Science 2023-10-10 Kristjan Greenewald , Anming Gu , Mikhail Yurochkin , Justin Solomon , Edward Chien

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Its extensions mostly focus on the definition of interpolation and the space (input or feature) where it…

Machine Learning · Computer Science 2023-11-10 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Data augmentation techniques play an important role in enhancing the performance of deep learning models. Despite their proven benefits in computer vision tasks, their application in the other domains remains limited. This paper proposes a…

Machine Learning · Computer Science 2024-01-23 Yousef El-Laham , Elizabeth Fons , Dillon Daudert , Svitlana Vyetrenko

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Yet, its extensions focus on the definition of interpolation and the space where it takes place, while the…

Machine Learning · Computer Science 2022-07-01 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

This paper introduces SelfMatch, a semi-supervised learning method that combines the power of contrastive self-supervised learning and consistency regularization. SelfMatch consists of two stages: (1) self-supervised pre-training based on…

Machine Learning · Computer Science 2021-01-19 Byoungjip Kim , Jinho Choo , Yeong-Dae Kwon , Seongho Joe , Seungjai Min , Youngjune Gwon

Mixup is a procedure for data augmentation that trains networks to make smoothly interpolated predictions between datapoints. Adversarial training is a strong form of data augmentation that optimizes for worst-case predictions in a compact…

Machine Learning · Computer Science 2021-03-23 Jason Bunk , Srinjoy Chattopadhyay , B. S. Manjunath , Shivkumar Chandrasekaran

Topology optimization is one of the engineering tools for finding efficient design. For the material interpolation scheme, it is usual to employ the SIMP (Solid Isotropic Material with Penalization) or the homogenization based interpolation…

Computational Engineering, Finance, and Science · Computer Science 2022-12-07 Bing Yi , Gil Ho Yoon , Ran Zheng , Long Liu , Daping Li , Xiang Peng

Suppose $\mu, \nu$ are compactly supported Radon measures on $\mathbb{R}^d$ and $V\in G(d,n)$ is an $n$-dimensional subspace. In this paper we systematically study the mixed-norm $$\int\|\pi^y\mu\|_{L^p(G(d,n))}^q\,d\nu(y),\…

Classical Analysis and ODEs · Mathematics 2022-03-08 Bochen Liu

Positive--unlabeled (PU) learning considers two samples, a positive set P with observations from only one class and an unlabeled set U with observations from two classes. The goal is to classify observations in U. Class mixture proportion…

Methodology · Statistics 2020-01-13 Zhenfeng Lin , James P. Long

Positive and Unlabeled (PU) learning, a binary classification model trained with only positive and unlabeled data, generally suffers from overfitted risk estimation due to inconsistent data distributions. To address this, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Chengjie Wang , Chengming Xu , Zhenye Gan , Jianlong Hu , Wenbing Zhu , Lizhuag Ma

Mixup is the latest data augmentation technique that linearly interpolates input examples and the corresponding labels. It has shown strong effectiveness in image classification by interpolating images at the pixel level. Inspired by this…

Computation and Language · Computer Science 2020-11-12 Lichao Sun , Congying Xia , Wenpeng Yin , Tingting Liang , Philip S. Yu , Lifang He

The success of data mixing augmentations in image classification tasks has been well-received. However, these techniques cannot be readily applied to object detection due to challenges such as spatial misalignment, foreground/background…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Thanh Vu , Baochen Sun , Bodi Yuan , Alex Ngai , Yueqi Li , Jan-Michael Frahm

Mix-up is a key technique for consistency regularization-based semi-supervised learning methods, blending two or more images to generate strong-perturbed samples for strong-weak pseudo supervision. Existing mix-up operations are performed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zhiqiang Shen , Peng Cao , Junming Su , Jinzhu Yang , Osmar R. Zaiane

We deal with the shape reconstruction of inclusions in elastic bodies. For solving this inverse problem in practice, data fitting functionals are used. Those work better than the rigorous monotonicity methods from [5], but have no…

Numerical Analysis · Mathematics 2022-12-13 Sarah Eberle , Bastian Harrach

In this paper, a novel pattern classification approach is proposed by regularizing the classifier learning to maximize mutual information between the classification response and the true class label. We argue that, with the learned…

Machine Learning · Computer Science 2014-09-30 Jim Jing-Yan Wang , Yi Wang , Shiguang Zhao , Xin Gao