English
Related papers

Related papers: Enhancing Mixup-based Semi-Supervised Learning wit…

200 papers

Consistency regularization and pseudo-labeling have significantly advanced semi-supervised learning (SSL). Prior works have effectively employed Mixup for consistency regularization in SSL. However, our findings indicate that applying Mixup…

Machine Learning · Computer Science 2025-04-18 Haorong Han , Jidong Yuan , Chixuan Wei , Zhongyang Yu

Computer-aided diagnosis via deep learning relies on large-scale annotated data sets, which can be costly when involving expert knowledge. Semi-supervised learning (SSL) mitigates this challenge by leveraging unlabeled data. One effective…

Machine Learning · Computer Science 2020-05-25 Prashnna Kumar Gyawali , Sandesh Ghimire , Pradeep Bajracharya , Zhiyuan Li , Linwei Wang

MixUp is an effective data augmentation method to regularize deep neural networks via random linear interpolations between pairs of samples and their labels. It plays an important role in model regularization, semi-supervised learning and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Zhijun Mai , Guosheng Hu , Dexiong Chen , Fumin Shen , Heng Tao Shen

Semi-supervised learning (SSL) has demonstrated high performance in image classification tasks by effectively utilizing both labeled and unlabeled data. However, existing SSL methods often suffer from poor calibration, with models yielding…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Mehrab Mustafy Rahman , Jayanth Mohan , Tiberiu Sosea , Cornelia Caragea

Semi-Supervised Learning (SSL) seeks to leverage large amounts of non-annotated data along with the smallest amount possible of annotated data in order to achieve the same level of performance as if all data were annotated. A fruitful…

Machine Learning · Computer Science 2024-05-24 Nikolaos Karaliolios , Hervé Le Borgne , Florian Chabot

In recent years, great progress has been made to incorporate unlabeled data to overcome the inefficiently supervised problem via semi-supervised learning (SSL). Most state-of-the-art models are based on the idea of pursuing consistent model…

Machine Learning · Computer Science 2022-09-27 Yangbangyan Jiang , Xiaodan Li , Yuefeng Chen , Yuan He , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

Computation and Language · Computer Science 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

Deep-learning based speech separation models confront poor generalization problem that even the state-of-the-art models could abruptly fail when evaluating them in mismatch conditions. To address this problem, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-04 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Deep learning has achieved remarkable success across a wide range of tasks, but its models often suffer from instability and vulnerability: small changes to the input may drastically affect predictions, while optimization can be hindered by…

Machine Learning · Computer Science 2025-10-30 Blaise Delattre

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

Machine Learning · Computer Science 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer

Mixup is a popular regularization technique for training deep neural networks that improves generalization and increases robustness to certain distribution shifts. It perturbs input training data in the direction of other randomly-chosen…

Machine Learning · Computer Science 2023-10-10 Kristjan Greenewald , Anming Gu , Mikhail Yurochkin , Justin Solomon , Edward Chien

Probabilistic learning is increasingly being tackled as an optimization problem, with gradient-based approaches as predominant methods. When modelling multivariate likelihoods, a usual but undesirable outcome is that the learned model fits…

Machine Learning · Computer Science 2020-10-23 Adrián Javaloy , Isabel Valera

Mixup is a well-known data-dependent augmentation technique for DNNs, consisting of two sub-tasks: mixup generation and classification. However, the recent dominant online training method confines mixup to supervised learning (SL), and the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Siyuan Li , Zicheng Liu , Zedong Wang , Di Wu , Zihan Liu , Stan Z. Li

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Machine Learning · Computer Science 2022-07-05 Jianfeng Wang , Thomas Lukasiewicz , Daniela Massiceti , Xiaolin Hu , Vladimir Pavlovic , Alexandros Neophytou

Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence,…

Machine Learning · Computer Science 2018-05-01 Hongyi Zhang , Moustapha Cisse , Yann N. Dauphin , David Lopez-Paz

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Deep neural networks are notorious for being sensitive to small well-chosen perturbations, and estimating the regularity of such architectures is of utmost importance for safe and robust practical applications. In this paper, we investigate…

Machine Learning · Statistics 2019-10-28 Kevin Scaman , Aladin Virmaux
‹ Prev 1 2 3 10 Next ›