English
Related papers

Related papers: VNN: Verification-Friendly Neural Networks with Ha…

200 papers

The ubiquity of deep neural networks (DNNs), cloud-based training, and transfer learning is giving rise to a new cybersecurity frontier in which unsecure DNNs have `structural malware' (i.e., compromised weights and activation pathways). In…

Machine Learning · Computer Science 2021-02-05 N. Benjamin Erichson , Dane Taylor , Qixuan Wu , Michael W. Mahoney

Motivated by the gap between theoretical optimal approximation rates of deep neural networks (DNNs) and the accuracy realized in practice, we seek to improve the training of DNNs. The adoption of an adaptive basis viewpoint of DNNs leads to…

Machine Learning · Computer Science 2019-12-11 Eric C. Cyr , Mamikon A. Gulian , Ravi G. Patel , Mauro Perego , Nathaniel A. Trask

Deploying deep neural networks (DNNs) as core functions in autonomous driving creates unique verification and validation challenges. In particular, the continuous engineering paradigm of gradually perfecting a DNN-based perception can make…

Machine Learning · Computer Science 2021-09-28 Chih-Hong Cheng , Rongjie Yan

Nowadays, we are witnessing an increasing effort to improve the performance and trustworthiness of Deep Neural Networks (DNNs), with the aim to enable their adoption in safety critical systems such as self-driving cars. Multiple testing…

Software Engineering · Computer Science 2022-04-05 Houssem Ben Braiek , Foutse Khomh

The wide deployment of deep neural networks, though achieving great success in many domains, has severe safety and reliability concerns. Existing adversarial attack generation and automatic verification techniques cannot formally verify…

Machine Learning · Computer Science 2020-06-09 Weidi Sun , Yuteng Lu , Xiyue Zhang , Zhanxing Zhu , Meng Sun

In order to deploy deep neural networks (DNNs) in high-stakes scenarios, it is imperative that DNNs provide inference robust to external perturbations - both intentional and unintentional. Although the resilience of DNNs to intentional and…

Cryptography and Security · Computer Science 2024-08-06 Sazzad Sayyed , Milin Zhang , Shahriar Rifat , Ananthram Swami , Michael De Lucia , Francesco Restuccia

Ensuring solution feasibility is a key challenge in developing Deep Neural Network (DNN) schemes for solving constrained optimization problems, due to inherent DNN prediction errors. In this paper, we propose a ``preventive learning''…

Machine Learning · Computer Science 2023-05-18 Tianyu Zhao , Xiang Pan , Minghua Chen , Steven H. Low

Machine learning software, deep neural networks (DNN) software in particular, discerns valuable information from a large dataset, a set of data. Outcomes of such DNN programs are dependent on the quality of both learning programs and…

Machine Learning · Computer Science 2019-11-27 Shin Nakajima

Autonomous systems -- such as self-driving cars, autonomous drones, and automated trains -- must come with strong safety guarantees. Over the past decade, techniques based on formal methods have enjoyed some success in providing strong…

Software Engineering · Computer Science 2020-06-17 Nathan Fulton , Nathan Hunt , Nghia Hoang , Subhro Das

Deep neural networks (DNNs) are state-of-the-art algorithms for multiple applications, spanning from image classification to speech recognition. While providing excellent accuracy, they often have enormous compute and memory requirements.…

Machine Learning · Computer Science 2020-11-12 Ussama Zahid , Giulio Gambardella , Nicholas J. Fraser , Michaela Blott , Kees Vissers

Deep learning has emerged as an effective approach for creating modern software systems, with neural networks often surpassing hand-crafted systems. Unfortunately, neural networks are known to suffer from various safety and security issues.…

Machine Learning · Computer Science 2021-01-19 Guy Amir , Haoze Wu , Clark Barrett , Guy Katz

Visual recognition is currently one of the most important and active research areas in computer vision, pattern recognition, and even the general field of artificial intelligence. It has great fundamental importance and strong industrial…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yang Wu , Dingheng Wang , Xiaotong Lu , Fan Yang , Guoqi Li , Weisheng Dong , Jianbo Shi

The ability to train Deep Neural Networks (DNNs) with constraints is instrumental in improving the fairness of modern machine-learning models. Many algorithms have been analysed in recent years, and yet there is no standard, widely accepted…

Machine Learning · Computer Science 2026-02-19 Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček

Deep Neural Networks (DNNs) have emerged as a powerful mechanism and are being increasingly deployed in real-world safety-critical domains. Despite the widespread success, their complex architecture makes proving any formal guarantees about…

Machine Learning · Computer Science 2020-03-26 Saket Dingliwal , Divyansh Pareek , Jatin Arora

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

Machine Learning · Computer Science 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu

Despite apparent human-level performances of deep neural networks (DNN), they behave fundamentally differently from humans. They easily change predictions when small corruptions such as blur and noise are applied on the input (lack of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Sanghyuk Chun , Seong Joon Oh , Sangdoo Yun , Dongyoon Han , Junsuk Choe , Youngjoon Yoo

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

Machine Learning · Computer Science 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN…

Machine Learning · Computer Science 2025-08-27 Rudy Bunel , Jingyue Lu , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

Many available formal verification methods have been shown to be instances of a unified Branch-and-Bound (BaB) formulation. We propose a novel machine learning framework that can be used for designing an effective branching strategy as well…

Machine Learning · Computer Science 2021-07-28 Florian Jaeckle , Jingyue Lu , M. Pawan Kumar

The rapid growth of deep learning applications in real life is accompanied by severe safety concerns. To mitigate this uneasy phenomenon, much research has been done providing reliable evaluations of the fragility level in different deep…

Machine Learning · Computer Science 2019-12-03 Zhaoyang Lyu , Ching-Yun Ko , Zhifeng Kong , Ngai Wong , Dahua Lin , Luca Daniel