English
Related papers

Related papers: Selective Classification for Deep Neural Networks

200 papers

Automated ranking of pre-trained Deep Neural Networks (DNNs) reduces the required time for selecting optimal pre-trained DNN and boost the classification performance in transfer learning. In this paper, we introduce a novel algorithm to…

Machine Learning · Computer Science 2020-12-29 Mostafa Kalhor , Ahmad Kalhor , Mehdi Rahmani

We propose a novel method to explain trained deep neural networks (DNNs), by distilling them into surrogate models using unsupervised clustering. Our method can be applied flexibly to any subset of layers of a DNN architecture and can…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Yu-han Liu , Sercan O. Arik

The recent ground-breaking advances in deep learning networks ( DNNs ) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-limited embedded devices. Offloading the…

Performance · Computer Science 2018-05-14 Ben Taylor , Vicent Sanz Marco , Willy Wolff , Yehia Elkhatib , Zheng Wang

Testing of deep learning models is challenging due to the excessive number and complexity of computations involved. As a result, test data selection is performed manually and in an ad hoc way. This raises the question of how we can…

Machine Learning · Computer Science 2019-05-01 Wei Ma , Mike Papadakis , Anestis Tsakmalis , Maxime Cordy , Yves Le Traon

Deep neural networks (DNN) have been used successfully in many scientific problems for their high prediction accuracy, but their application to genetic studies remains challenging due to their poor interpretability. In this paper, we…

Machine Learning · Computer Science 2021-10-01 Peyman H. Kassani , Fred Lu , Yann Le Guen , Zihuai He

Surgical training in medical school residency programs has followed the apprenticeship model. The learning and assessment process is inherently subjective and time-consuming. Thus, there is a need for objective methods to assess surgical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Erim Yanik , Xavier Intes , Uwe Kruger , Pingkun Yan , David Miller , Brian Van Voorst , Basiel Makled , Jack Norfleet , Suvranu De

Deep Learning has become interestingly popular in computer vision, mostly attaining near or above human-level performance in various vision tasks. But recent work has also demonstrated that these deep neural networks are very vulnerable to…

Machine Learning · Computer Science 2020-12-09 Shashi Kant Gupta

This paper introduces a generic method which enables to use conventional deep neural networks as end-to-end one-class classifiers. The method is based on splitting given data from one class into two subsets. In one-class classification,…

Machine Learning · Computer Science 2019-09-17 Patrick Schlachter , Yiwen Liao , Bin Yang

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Selective prediction, where a model has the option to abstain from making a decision, is crucial for machine learning applications in which mistakes are costly. In this work, we focus on distributional regression and introduce a framework…

Statistics Theory · Mathematics 2025-04-01 Ahmed Zaoui , Clément Dombry

Deep Neural Networks (DNNs) are often criticized for being susceptible to adversarial attacks. Most successful defense strategies adopt adversarial training or random input transformations that typically require retraining or fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Lokender Tiwari , Anish Madan , Saket Anand , Subhashis Banerjee

Deterministic neural nets have been shown to learn effective predictors on a wide range of machine learning problems. However, as the standard approach is to train the network to minimize a prediction loss, the resultant model remains…

Machine Learning · Computer Science 2018-11-02 Murat Sensoy , Lance Kaplan , Melih Kandemir

When deployed for risk-sensitive tasks, deep neural networks must include an uncertainty estimation mechanism. Here we examine the relationship between deep architectures and their respective training regimes, with their corresponding…

Machine Learning · Computer Science 2023-02-24 Ido Galil , Mohammed Dabbah , Ran El-Yaniv

Deep neural networks enjoy a powerful representation and have proven effective in a number of applications. However, recent advances show that deep neural networks are vulnerable to adversarial attacks incurred by the so-called adversarial…

Machine Learning · Computer Science 2019-11-21 Lirong He , Ziyi Guo , Kaizhu Huang , Zenglin Xu

In recent years, deep learning techniques have been introduced into the field of trajectory optimization to improve convergence and speed. Training such models requires large trajectory datasets. However, the convergence of low thrust (LT)…

Optimization and Control · Mathematics 2022-02-11 Ruida Xie , Andrew G. Dempster

Deep Convolutional Neural Networks (CNNs) have demonstrated excellent performance in image classification, but still show room for improvement in object-detection tasks with many categories, in particular for cluttered scenes and occlusion.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-24 Nikolaos Karianakis , Thomas J. Fuchs , Stefano Soatto

The choice of learning rate (LR) functions and policies has evolved from a simple fixed LR to the decaying LR and the cyclic LR, aiming to improve the accuracy and reduce the training time of Deep Neural Networks (DNNs). This paper presents…

Machine Learning · Computer Science 2022-10-25 Yanzhao Wu , Ling Liu

Deep convolutional neural network (DCNN) based supervised learning is a widely practiced approach for large-scale image classification. However, retraining these large networks to accommodate new, previously unseen data demands high…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Syed Shakib Sarwar , Aayush Ankit , Kaushik Roy

Despite the highest classification accuracy in wide varieties of application areas, artificial neural network has one disadvantage. The way this Network comes to a decision is not easily comprehensible. The lack of explanation ability…

Computer Vision and Pattern Recognition · Computer Science 2016-10-18 Tameru Hailesilassie

In the field of machine unlearning, certified unlearning has been extensively studied in convex machine learning models due to its high efficiency and strong theoretical guarantees. However, its application to deep neural networks (DNNs),…

Machine Learning · Computer Science 2026-04-23 Binchi Zhang , Yushun Dong , Tianhao Wang , Jundong Li