English
Related papers

Related papers: Towards Improved Testing For Deep Learning

200 papers

Deep learning achieves remarkable performance on pattern recognition, but can be vulnerable to defects of some important properties such as robustness and security. This tutorial is based on a stream of research conducted since the summer…

Software Engineering · Computer Science 2021-08-05 Nicolas Berthier , Youcheng Sun , Wei Huang , Yanghao Zhang , Wenjie Ruan , Xiaowei Huang

Quantum Neural Networks (QNNs) have achieved initial success in various tasks by integrating quantum computing and neural networks. However, growing concerns about their reliability and robustness highlight the need for systematic testing.…

Quantum Physics · Physics 2026-01-12 Minqi Shao , Jianjun Zhao

Nowadays, we are witnessing an increasing effort to improve the performance and trustworthiness of Deep Neural Networks (DNNs), with the aim to enable their adoption in safety critical systems such as self-driving cars. Multiple testing…

Software Engineering · Computer Science 2022-04-05 Houssem Ben Braiek , Foutse Khomh

As the potential for neural networks to augment our daily lives grows, ensuring their quality through effective testing, debugging, and maintenance is essential. This is especially the case as we acknowledge the prospects of negative…

Software Engineering · Computer Science 2025-07-08 Fatema Tuz Zohra , Brittany Johnson

Deep Neural Networks (DNNs), with its promising performance, are being increasingly used in safety critical applications such as autonomous driving, cancer detection, and secure authentication. With growing importance in deep learning,…

Machine Learning · Computer Science 2019-11-19 Senthil Mani , Anush Sankaran , Srikanth Tamilselvam , Akshay Sethi

As Deep Neural Networks (DNNs) are rapidly being adopted within large software systems, software developers are increasingly required to design, train, and deploy such models into the systems they develop. Consequently, testing and…

Software Engineering · Computer Science 2023-01-30 Jinhan Kim , Nargiz Humbatova , Gunel Jahangirova , Paolo Tonella , Shin Yoo

Recent developments in deep neural networks (DNNs) have led to their adoption in safety-critical systems, which in turn has heightened the need for guaranteeing their safety. These safety properties of DNNs can be proven using tools…

Logic in Computer Science · Computer Science 2024-02-14 Remi Desmartin , Omri Isac , Grant Passmore , Kathrin Stark , Guy Katz , Ekaterina Komendantskaya

Deep neural network (DNN) models, including those used in safety-critical domains, need to be thoroughly tested to ensure that they can reliably perform well in different scenarios. In this article, we provide an overview of structural…

Software Engineering · Computer Science 2022-08-09 Muhammad Usman , Youcheng Sun , Divya Gopinath , Rishi Dange , Luca Manolache , Corina S. Pasareanu

Neural networks are one of the most investigated and widely used techniques in Machine Learning. In spite of their success, they still find limited application in safety- and security-related contexts, wherein assurance about networks'…

Artificial Intelligence · Computer Science 2018-05-28 Francesco Leofante , Nina Narodytska , Luca Pulina , Armando Tacchella

Deep learning is increasingly used as a building block of security systems. Unfortunately, neural networks are hard to interpret and typically opaque to the practitioner. The machine learning community has started to address this problem by…

Machine Learning · Computer Science 2020-04-28 Alexander Warnecke , Daniel Arp , Christian Wressnegger , Konrad Rieck

Deep learning has transformed the way we think of software and what it can do. But deep neural networks are fragile and their behaviors are often surprising. In many settings, we need to provide formal guarantees on the safety, security,…

Machine Learning · Computer Science 2021-10-06 Aws Albarghouthi

Deep neural networks (DNN) have been widely applied in modern life, including critical domains like autonomous driving, making it essential to ensure the reliability and robustness of DNN-powered systems. As an analogy to code coverage…

Software Engineering · Computer Science 2022-01-04 Zhou Yang , Jieke Shi , Muhammad Hilmi Asyrofi , David Lo

Deep Neural Networks (DNNs) have revolutionized computer vision. We now have DNNs that achieve top (performance) results in many problems, including object recognition, facial expression analysis, and semantic segmentation, to name but a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Ciprian Corneanu , Meysam Madadi , Sergio Escalera , Aleix Martinez

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

The reliability of software that has a Deep Neural Network (DNN) as a component is urgently important today given the increasing number of critical applications being deployed with DNNs. The need for reliability raises a need for rigorous…

Software Engineering · Computer Science 2021-03-01 Swaroopa Dola , Matthew B. Dwyer , Mary Lou Soffa

Recurrent neural networks (RNNs) have been applied to a broad range of applications, including natural language processing, drug discovery, and video recognition. Their vulnerability to input perturbation is also known. Aligning with a view…

Machine Learning · Computer Science 2021-05-14 Wei Huang , Youcheng Sun , Xingyu Zhao , James Sharp , Wenjie Ruan , Jie Meng , Xiaowei Huang

Deep neural networks have seen enormous success in various real-world applications. Beyond their predictions as point estimates, increasing attention has been focused on quantifying the uncertainty of their predictions. In this review, we…

Machine Learning · Computer Science 2023-02-06 Chengyu Dong

Testing of deep learning models is challenging due to the excessive number and complexity of computations involved. As a result, test data selection is performed manually and in an ad hoc way. This raises the question of how we can…

Machine Learning · Computer Science 2019-05-01 Wei Ma , Mike Papadakis , Anestis Tsakmalis , Maxime Cordy , Yves Le Traon

Deep neural networks (DNNs) are widely used in real-world applications, yet they remain vulnerable to errors and adversarial attacks. Formal verification offers a systematic approach to identify and mitigate these vulnerabilities, enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yizhak Y. Elboher , Avraham Raviv , Yael Leibovich Weiss , Omer Cohen , Roy Assa , Guy Katz , Hillel Kugler