English
Related papers

Related papers: MixBoost: Improving the Robustness of Deep Neural …

200 papers

Mixup is a popular data augmentation technique based on taking convex combinations of pairs of examples and their labels. This simple technique has been shown to substantially improve both the robustness and the generalization of the…

Machine Learning · Computer Science 2021-03-19 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , Amirata Ghorbani , James Zou

Data augmentation is a simple yet effective way to improve the robustness of deep neural networks (DNNs). Diversity and hardness are two complementary dimensions of data augmentation to achieve robustness. For example, AugMix explores…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Haotao Wang , Chaowei Xiao , Jean Kossaifi , Zhiding Yu , Anima Anandkumar , Zhangyang Wang

Recent work has shown that data augmentation has the potential to significantly improve the generalization of deep learning models. Recently, automated augmentation strategies have led to state-of-the-art results in image classification and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Ekin D. Cubuk , Barret Zoph , Jonathon Shlens , Quoc V. Le

In this paper we propose a novel augmentation technique that improves not only the performance of deep neural networks on clean test data, but also significantly increases their robustness to random transformations, both affine and…

This paper introduces RawBoost, a data boosting and augmentation method for the design of more reliable spoofing detection solutions which operate directly upon raw waveform inputs. While RawBoost requires no additional data sources, e.g.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Hemlata Tak , Madhu Kamble , Jose Patino , Massimiliano Todisco , Nicholas Evans

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

Deep learning (DL) models have gained prominence in domains such as computer vision and natural language processing but remain underutilized for regression tasks involving tabular data. In these cases, traditional machine learning (ML)…

Machine Learning · Computer Science 2025-01-08 Assaf Shmuel , Oren Glickman , Teddy Lazebnik

Data augmentation is a key technique for improving the robustness of image classification models. However, many recent approaches rely on diffusion-based synthesis or complex feature mixing strategies, which introduce substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuto Matsuo , Yoshihiro Fukuhara , Yuki M. Asano , Rintaro Yanagi , Hirokatsu Kataoka , Akio Nakamura

Deep Learning has thrived on the emergence of biomedical big data. However, medical datasets acquired at different institutions have inherent bias caused by various confounding factors such as operation policies, machine protocols,…

Image and Video Processing · Electrical Eng. & Systems 2019-11-15 Yundong Zhang , Hang Wu , Huiye Liu , Li Tong , May D Wang

Data augmentation is an essential technique for improving generalization ability of deep learning models. Recently, AutoAugment has been proposed as an algorithm to automatically search for augmentation policies from a dataset and has…

Machine Learning · Computer Science 2020-01-09 Sungbin Lim , Ildoo Kim , Taesup Kim , Chiheon Kim , Sungwoong Kim

Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network models is crucial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Inspired by the great success of Deep Neural Networks (DNNs) in natural language processing (NLP), DNNs have been increasingly applied in source code analysis and attracted significant attention from the software engineering community. Due…

Software Engineering · Computer Science 2023-01-11 Zeming Dong , Qiang Hu , Yuejun Guo , Maxime Cordy , Mike Papadakis , Zhenya Zhang , Yves Le Traon , Jianjun Zhao

Data augmentation (DA) techniques aim to increase data variability, and thus train deep networks with better generalisation. The pioneering AutoAugment automated the search for optimal DA policies with reinforcement learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Yonggang Li , Guosheng Hu , Yongtao Wang , Timothy Hospedales , Neil M. Robertson , Yongxin Yang

Despite substantial progress in the field of deep learning, overfitting persists as a critical challenge, and data augmentation has emerged as a particularly promising approach due to its capacity to enhance model generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Wen Liang , Youzhi Liang , Jianguo Jia

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on reducing robust overfitting by using common data augmentation schemes. We…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

Data augmentation has been widely applied as an effective methodology to improve generalization in particular when training deep neural networks. Recently, researchers proposed a few intensive data augmentation techniques, which indeed…

Machine Learning · Computer Science 2019-11-22 Zhuoxun He , Lingxi Xie , Xin Chen , Ya Zhang , Yanfeng Wang , Qi Tian

Self-augmentation has received increasing research interest recently to improve named entity recognition (NER) performance in low-resource scenarios. Token substitution and mixup are two feasible heterogeneous self-augmentation techniques…

Computation and Language · Computer Science 2022-05-17 Linzhi Wu , Pengjun Xie , Jie Zhou , Meishan Zhang , Chunping Ma , Guangwei Xu , Min Zhang

This dissertation explores the impact of bias in deep neural networks and presents methods for reducing its influence on model performance. The first part begins by categorizing and describing potential sources of bias and errors in data…

Machine Learning · Computer Science 2023-08-21 Agnieszka Mikołajczyk-Bareła

With the rapid development of deep learning, automatic modulation recognition (AMR), as an important task in cognitive radio, has gradually transformed from traditional feature extraction and classification to automatic classification by…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Xinjie Xu , Zhuangzhi Chen , Dongwei Xu , Huaji Zhou , Shanqing Yu , Shilian Zheng , Qi Xuan , Xiaoniu Yang

Data augmentation is one of the most effective techniques to improve the generalization performance of deep neural networks. Yet, despite often facing limited data availability in medical image analysis, it is frequently underutilized. This…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Adam Tupper , Christian Gagné