English
Related papers

Related papers: Learning Deep Neural Networks under Agnostic Corru…

200 papers

It has been reported that deep learning models are extremely vulnerable to small but intentionally chosen perturbations of its input. In particular, a deep network, despite its near-optimal accuracy on the clean images, often mis-classifies…

Machine Learning · Computer Science 2022-03-16 A. Tuan Nguyen , Ser Nam Lim , Philip Torr

Time series anomaly detection (TSAD) is an important data mining task with numerous applications in the IoT era. In recent years, a large number of deep neural network-based methods have been proposed, demonstrating significantly better…

Machine Learning · Computer Science 2022-08-04 Wenkai Li , Cheng Feng , Ting Chen , Jun Zhu

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Robust model fitting is a core algorithm in a large number of computer vision applications. Solving this problem efficiently for datasets highly contaminated with outliers is, however, still challenging due to the underlying computational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Giang Truong , Huu Le , David Suter , Erchuan Zhang , Syed Zulqarnain Gilani

Deep learning in digital pathology brings intelligence and automation as substantial enhancements to pathological analysis, the gold standard of clinical diagnosis. However, multiple steps from tissue preparation to slide imaging introduce…

Image and Video Processing · Electrical Eng. & Systems 2023-11-01 Peixiang Huang , Songtao Zhang , Yulu Gan , Rui Xu , Rongqi Zhu , Wenkang Qin , Limei Guo , Shan Jiang , Lin Luo

Deep learning (DL) has emerged as a crucial tool in network anomaly detection (NAD) for cybersecurity. While DL models for anomaly detection excel at extracting features and learning patterns from data, they are vulnerable to data…

Deep convolutional neural networks (CNNs) have demonstrated remarkable success in computer vision by supervisedly learning strong visual feature representations. However, training CNNs relies heavily on the availability of exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Jiabo Huang , Qi Dong , Shaogang Gong , Xiatian Zhu

Recent deep networks are capable of memorizing the entire data even when the labels are completely random. To overcome the overfitting on corrupted labels, we propose a novel technique of learning another neural network, called MentorNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Lu Jiang , Zhengyuan Zhou , Thomas Leung , Li-Jia Li , Li Fei-Fei

Deep learning based image segmentation methods have achieved great success, even having human-level accuracy in some applications. However, due to the black box nature of deep learning, the best method may fail in some situations. Thus…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Leixin Zhou , Wenxiang Deng , Xiaodong Wu

Despite tremendous success of modern neural networks, they are known to be overconfident even when the model encounters inputs with unfamiliar conditions. Detecting such inputs is vital to preventing models from making naive predictions…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Jinsol Lee , Ghassan AlRegib

Deep belief networks are used extensively for unsupervised stochastic learning on large datasets. Compared to other deep learning approaches their layer-by-layer learning makes them highly scalable. Unfortunately, the principles by which…

Disordered Systems and Neural Networks · Physics 2019-07-15 Swapnil Nitin Shah

Previous studies demonstrate DNNs' vulnerability to adversarial examples and adversarial training can establish a defense to adversarial examples. In addition, recent studies show that deep neural networks also exhibit vulnerability to…

Machine Learning · Computer Science 2022-04-15 Zhiyuan Zhang , Ruixuan Luo , Xuancheng Ren , Qi Su , Liangyou Li , Xu Sun

Robustness is a fundamental property of machine learning classifiers required to achieve safety and reliability. In the field of adversarial robustness of image classifiers, robustness is commonly defined as the stability of a model to all…

Machine Learning · Computer Science 2024-05-28 Georg Siedel , Weijia Shao , Silvia Vock , Andrey Morozov

We present an adaptive approach for robust learning from corrupted training sets. We identify corrupted and non-corrupted samples with latent Bernoulli variables and thus formulate the learning problem as maximization of the likelihood…

Machine Learning · Statistics 2024-06-17 Aleksandr Karakulev , Dave Zachariah , Prashant Singh

A method to control results of gradient descent unsupervised learning in a deep neural network by using evolutionary algorithm is proposed. To process crossover of unsupervisedly trained models, the algorithm evaluates pointwise fitness of…

Machine Learning · Statistics 2018-03-29 Takeshi Inagaki

Neural network pruning is a popular technique used to reduce the inference costs of modern, potentially overparameterized, networks. Starting from a pre-trained network, the process is as follows: remove redundant parameters, retrain, and…

Machine Learning · Computer Science 2021-03-05 Lucas Liebenwein , Cenk Baykal , Brandon Carter , David Gifford , Daniela Rus

We conduct theoretical studies on streaming-based active learning for binary classification under unknown adversarial label corruptions. In this setting, every time before the learner observes a sample, the adversary decides whether to…

Machine Learning · Computer Science 2021-06-22 Yifang Chen , Simon S. Du , Kevin Jamieson

Conventional sampling techniques fall short of drawing descriptive sketches of the data when the data is grossly corrupted as such corruptions break the low rank structure required for them to perform satisfactorily. In this paper, we…

Machine Learning · Computer Science 2016-11-21 Mostafa Rahmani , George Atia

We compare the robustness of humans and current convolutional deep neural networks (DNNs) on object recognition under twelve different types of image degradations. First, using three well known DNNs (ResNet-152, VGG-19, GoogLeNet) we find…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Robert Geirhos , Carlos R. Medina Temme , Jonas Rauber , Heiko H. Schütt , Matthias Bethge , Felix A. Wichmann

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto