English
Related papers

Related papers: NoisyMix: Boosting Model Robustness to Common Corr…

200 papers

Deep networks have achieved impressive results on a range of well-curated benchmark datasets. Surprisingly, their performance remains sensitive to perturbations that have little effect on human performance. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jonas Ngnawe , Marianne Abemgnigni Njifon , Jonathan Heek , Yann Dauphin

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

Data augmentation plays a crucial role in enhancing the robustness and performance of machine learning models across various domains. In this study, we introduce a novel mixed-sample data augmentation method called RandoMix. RandoMix is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

We study the problem of robust data augmentation for regression tasks in the presence of noisy data. Data augmentation is essential for generalizing deep learning models, but most of the techniques like the popular Mixup are primarily…

Machine Learning · Computer Science 2024-08-19 Seong-Hyeon Hwang , Minsu Kim , Steven Euijong Whang

Consistency regularization is a commonly-used technique for semi-supervised and self-supervised learning. It is an auxiliary objective function that encourages the prediction of the network to be similar in the vicinity of the observed…

Machine Learning · Computer Science 2021-10-05 Erik Englesson , Hossein Azizpour

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

Modern deep neural networks can achieve high accuracy when the training distribution and test distribution are identically distributed, but this assumption is frequently violated in practice. When the train and test distributions are…

Machine Learning · Statistics 2020-02-18 Dan Hendrycks , Norman Mu , Ekin D. Cubuk , Barret Zoph , Justin Gilmer , Balaji Lakshminarayanan

Data augmentation has been proven effective for training high-accuracy convolutional neural network classifiers by preventing overfitting. However, building deep neural networks in real-world scenarios requires not only high accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zhenglin Huang , Xiaoan Bao , Na Zhang , Qingqi Zhang , Xiaomei Tu , Biao Wu , Xi Yang

We introduce Noisy Feature Mixup (NFM), an inexpensive yet effective method for data augmentation that combines the best of interpolation based training and noise injection schemes. Rather than training with convex combinations of pairs of…

Machine Learning · Computer Science 2023-05-23 Soon Hoe Lim , N. Benjamin Erichson , Francisco Utrera , Winnie Xu , Michael W. Mahoney

For multi-class classification under class-conditional label noise, we prove that the accuracy metric itself can be robust. We concretize this finding's inspiration in two essential aspects: training and validation, with which we address…

Machine Learning · Computer Science 2020-12-09 Pengfei Chen , Junjie Ye , Guangyong Chen , Jingwei Zhao , Pheng-Ann Heng

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Randomized smoothing is a technique for providing provable robustness guarantees against adversarial attacks while making minimal assumptions about a classifier. This method relies on taking a majority vote of any base classifier over…

Machine Learning · Computer Science 2023-05-09 Ambar Pal , Jeremias Sulam

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

With the increasing use of deep learning on data collected by non-perfect sensors and in non-perfect environments, the robustness of deep learning systems has become an important issue. A common approach for obtaining robustness to noise…

Machine Learning · Computer Science 2023-11-21 Xueqiong Yuan , Jipeng Li , Ercan Engin Kuruoğlu

We investigate the impact of entropy change in deep learning systems by noise injection at different levels, including the embedding space and the image. The series of models that employ our methodology are collectively known as Noisy…

Artificial Intelligence · Computer Science 2025-09-09 Xiaowei Yu , Zhe Huang , Minheng Chen , Lu Zhang , Tianming Liu , Dajiang Zhu

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

As more and more artificial intelligence (AI) technologies move from the laboratory to real-world applications, the open-set and robustness challenges brought by data from the real world have received increasing attention. Data augmentation…

Machine Learning · Computer Science 2022-12-09 Zhendong Liu , Wenyu Jiang , Min guo , Chongjun Wang

Deploying machine learning systems in the real world requires both high accuracy on clean data and robustness to naturally occurring corruptions. While architectural advances have led to improved accuracy, building robust models remains…

Machine Learning · Computer Science 2019-06-07 Raphael Gontijo Lopes , Dong Yin , Ben Poole , Justin Gilmer , Ekin D. Cubuk

Certified robustness guarantee gauges a model's robustness to test-time attacks and can assess the model's readiness for deployment in the real world. In this work, we critically examine how the adversarial robustness guarantees from…

Machine Learning · Computer Science 2021-12-02 Jiachen Sun , Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Dan Hendrycks , Jihun Hamm , Z. Morley Mao

The performance of computer vision models are susceptible to unexpected changes in input images caused by sensor errors or extreme imaging environments, known as common corruptions (e.g. noise, blur, illumination changes). These corruptions…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shunxin Wang , Raymond Veldhuis , Christoph Brune , Nicola Strisciuglio
‹ Prev 1 2 3 10 Next ›