English
Related papers

Related papers: Computing the Testing Error without a Testing Set

200 papers

Deep neural networks have achieved outstanding performance over various tasks, but they have a critical issue: over-confident predictions even for completely unknown samples. Many studies have been proposed to successfully filter out these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Jihyo Kim , Jiin Koo , Sangheum Hwang

Deep Neural Networks (DNN) are increasingly used in a variety of applications, many of them with substantial safety and security concerns. This paper introduces DeepCheck, a new approach for validating DNNs based on core ideas from program…

Software Engineering · Computer Science 2018-07-30 Divya Gopinath , Kaiyuan Wang , Mengshi Zhang , Corina S. Pasareanu , Sarfraz Khurshid

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

We distinguish two general modes of testing for Deep Neural Networks (DNNs): Offline testing where DNNs are tested as individual units based on test datasets obtained without involving the DNNs under test, and online testing where DNNs are…

Software Engineering · Computer Science 2022-01-31 Fitash Ul Haq , Donghwan Shin , Shiva Nejati , Lionel Briand

Machine learning systems based on deep neural networks (DNNs) produce state-of-the-art results in many applications. Considering the large amount of training data and know-how required to generate the network, it is more practical to use…

Machine Learning · Computer Science 2019-11-27 Bo Luo , Yu Li , Lingxiao Wei , Qiang Xu

The paper proposes a new testing approach for Deep Neural Networks (DNN) using gradient-free optimization to find perturbation chains that successfully falsify the tested DNN, going beyond existing grid-based or combinatorial testing.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Clemens Otte , Yinchong Yang , Danny Benlin Oswan

Deep neural networks (DNN) has received increasing attention in machine learning applications in the last several years. Recently, a non-asymptotic error bound has been developed to measure the performance of the fully connected DNN…

Machine Learning · Statistics 2024-05-15 Kejin Wu , Dimitris N. Politis

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

Surface inspection systems are an important application domain for computer vision, as they are used for defect detection and classification in the manufacturing industry. Existing systems use hand-crafted features which require extensive…

Image and Video Processing · Electrical Eng. & Systems 2019-04-10 Selim Arikan , Kiran Varanasi , Didier Stricker

Deep neural network (DNN) inference has become an important part of many data-center workloads. This has prompted focused efforts to design ever-faster deep learning accelerators such as GPUs and TPUs. However, an end-to-end DNN-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Ahmed F. AbouElhamayed , Susanne Balle , Deshanand Singh , Mohamed S. Abdelfattah

This paper introduces deep neural networks (DNNs) as add-on blocks to baseline feedback control systems to enhance tracking performance of arbitrary desired trajectories. The DNNs are trained to adapt the reference signals to the feedback…

Robotics · Computer Science 2017-10-09 Siqi Zhou , Mohamed K. Helwa , Angela P. Schoellig

Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Neerav Karani , Ertunc Erdil , Krishna Chaitanya , Ender Konukoglu

Deep neural networks (DNNs) are state-of-the-art techniques for solving most computer vision problems. DNNs require billions of parameters and operations to achieve state-of-the-art results. This requirement makes DNNs extremely compute,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Ishmeet Kaur , Adwaita Janardhan Jadhav

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy in stereo matching than traditional…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Qiang Wang , Shaohuai Shi , Shizhen Zheng , Kaiyong Zhao , Xiaowen Chu

In the field of machine unlearning, certified unlearning has been extensively studied in convex machine learning models due to its high efficiency and strong theoretical guarantees. However, its application to deep neural networks (DNNs),…

Machine Learning · Computer Science 2026-04-23 Binchi Zhang , Yushun Dong , Tianhao Wang , Jundong Li

Deep neural networks (DNNs) play a crucial role in the field of artificial intelligence, and their security-related testing has been a prominent research focus. By inputting test cases, the behavior of models is examined for anomalies, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Wenkai Li , Xiaoqi Li , Yingjie Mao , Yishun Wang

Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems. Companies incur in high costs for testing DNN with datasets representative of the inputs expected in operation, as these need…

Software Engineering · Computer Science 2024-03-29 Antonio Guerriero , Roberto Pietrantuono , Stefano Russo

Deep neural networks (DNNs) are often coupled with physics-based models or data-driven surrogate models to perform fault detection and health monitoring of systems in the low data regime. These models serve as digital twins to generate…

Machine Learning · Computer Science 2023-03-21 Laya Das , Blazhe Gjorgiev , Giovanni Sansavini

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

Deep neural networks can be unreliable in the real world when the training set does not adequately cover all the settings where they are deployed. Focusing on image classification, we consider the setting where we have an error distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sahil Singla , Atoosa Malemir Chegini , Mazda Moayeri , Soheil Feiz