English
Related papers

Related papers: Verification-Aided Deep Ensemble Selection

200 papers

Deep Neural Networks are increasingly adopted in critical tasks that require a high level of safety, e.g., autonomous driving. While state-of-the-art verifiers can be employed to check whether a DNN is unsafe w.r.t. some given property…

Artificial Intelligence · Computer Science 2023-06-21 Luca Marzari , Davide Corsi , Ferdinando Cicalese , Alessandro Farinelli

Motivated by the success of traditional software testing, numerous diversity measures have been proposed for testing deep neural networks (DNNs). In this study, we propose a shift in perspective, advocating for the consideration of DNN…

Software Engineering · Computer Science 2024-02-28 Zi Wang , Jihye Choi , Ke Wang , Somesh Jha

Deep neural networks (DNNs) have proven to be powerful predictors and are widely used for various tasks. Credible uncertainty estimation of their predictions, however, is crucial for their deployment in many risk-sensitive applications. In…

Machine Learning · Computer Science 2021-12-03 Ido Galil , Ran El-Yaniv

Current deep neural networks suffer from two problems; first, they are hard to interpret, and second, they suffer from overfitting. There have been many attempts to define interpretability in neural networks, but they typically lack…

Machine Learning · Computer Science 2019-08-15 Sean Tao

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

Due to numerous breakthroughs in real-world applications brought by machine intelligence, deep neural networks (DNNs) are widely employed in critical applications. However, predictions of DNNs are easily manipulated with imperceptible…

Machine Learning · Computer Science 2022-05-04 Hongjun Wang , Yisen Wang

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding…

Artificial Intelligence · Computer Science 2025-05-09 Luca Marzari , Isabella Mastroeni , Alessandro Farinelli

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial…

Machine Learning · Statistics 2017-04-07 Cheng Ju , Aurélien Bibaut , Mark J. van der Laan

Deep Neural Networks (DNN) are increasingly used in a variety of applications, many of them with substantial safety and security concerns. This paper introduces DeepCheck, a new approach for validating DNNs based on core ideas from program…

Software Engineering · Computer Science 2018-07-30 Divya Gopinath , Kaiyuan Wang , Mengshi Zhang , Corina S. Pasareanu , Sarfraz Khurshid

Image classification with neural networks (NNs) is widely used in industrial processes, situations where the model likely encounters unknown objects during deployment, i.e., out-of-distribution (OOD) data. Worryingly, NNs tend to make…

Machine Learning · Computer Science 2025-01-14 Arthur Thuy , Dries F. Benoit

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

Verifying the robustness of machine learning models against evasion attacks at test time is an important research problem. Unfortunately, prior work established that this problem is NP-hard for decision tree ensembles, hence bound to be…

Machine Learning · Computer Science 2023-11-14 Stefano Calzavara , Lorenzo Cazzaro , Giulio Ermanno Pibiri , Nicola Prezza

Deep Neural Networks (DNNs) are notoriously vulnerable to adversarial input designs with limited noise budgets. While numerous successful attacks with subtle modifications to original input have been proposed, defense techniques against…

Machine Learning · Computer Science 2025-06-27 Furkan Mumcu , Yasin Yilmaz

Deep Neural Networks (DNNs) are a revolutionary force in the ongoing information revolution, and yet their intrinsic properties remain a mystery. In particular, it is widely known that DNNs are highly sensitive to noise, whether adversarial…

Machine Learning · Computer Science 2020-05-01 Netanel Raviv , Siddharth Jain , Pulakesh Upadhyaya , Jehoshua Bruck , Anxiao Jiang

Deep Neural Networks (DNN) are typically tested for accuracy relying on a set of unlabelled real world data (operational dataset), from which a subset is selected, manually labelled and used as test suite. This subset is required to be…

Software Engineering · Computer Science 2024-03-27 Antonio Guerriero , Roberto Pietrantuono , Stefano Russo

Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

Despite the large number of sophisticated deep neural network (DNN) verification algorithms, DNN verifier developers, users, and researchers still face several challenges. First, verifier developers must contend with the rapidly changing…

Machine Learning · Computer Science 2023-08-29 David Shriver , Sebastian Elbaum , Matthew B. Dwyer

Deep learning classifiers are assisting humans in making decisions and hence the user's trust in these models is of paramount importance. Trust is often a function of constant behavior. From an AI model perspective it means given the same…

Deep Neural Networks (DNN) are crucial in approximating nonlinear functions across diverse applications, ranging from image classification to control. Verifying specific input-output properties can be a highly challenging task due to the…

Machine Learning · Computer Science 2025-07-22 Tianhao Wei , Hanjiang Hu , Luca Marzari , Kai S. Yun , Peizhi Niu , Xusheng Luo , Changliu Liu