English
Related papers

Related papers: Refactoring Neural Networks for Verification

200 papers

Even as deep neural networks (DNNs) have achieved remarkable success on vision-related tasks, their performance is brittle to transformations in the input. Of particular interest are semantic transformations that model changes that have a…

Machine Learning · Computer Science 2020-07-21 Lakshya Jain , Varun Chandrasekaran , Uyeong Jang , Wilson Wu , Andrew Lee , Andy Yan , Steven Chen , Somesh Jha , Sanjit A. Seshia

Safety is a critical concern for the next generation of autonomy that is likely to rely heavily on deep neural networks for perception and control. Formally verifying the safety and robustness of well-trained DNNs and learning-enabled…

Machine Learning · Computer Science 2021-08-10 Xiaodong Yang , Tom Yamaguchi , Hoang-Dung Tran , Bardh Hoxha , Taylor T Johnson , Danil Prokhorov

The reliability of software that has a Deep Neural Network (DNN) as a component is urgently important today given the increasing number of critical applications being deployed with DNNs. The need for reliability raises a need for rigorous…

Software Engineering · Computer Science 2021-03-01 Swaroopa Dola , Matthew B. Dwyer , Mary Lou Soffa

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Juan C. Cuevas-Tello , Manuel Valenzuela-Rendon , Juan A. Nolazco-Flores

While the deployment of neural networks, yielding impressive results, becomes more prevalent in various applications, their interpretability and understanding remain a critical challenge. Network inversion, a technique that aims to…

Machine Learning · Computer Science 2024-02-20 Pirzada Suhail , Supratik Chakraborty , Amit Sethi

Deep Neural Networks (DNNs) have revolutionized computer vision. We now have DNNs that achieve top (performance) results in many problems, including object recognition, facial expression analysis, and semantic segmentation, to name but a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Ciprian Corneanu , Meysam Madadi , Sergio Escalera , Aleix Martinez

A robust theoretical framework that can describe and predict the generalization ability of deep neural networks (DNNs) in general circumstances remains elusive. Classical attempts have produced complexity metrics that rely heavily on global…

Machine Learning · Computer Science 2020-01-20 Marelie H. Davel , Marthinus W. Theunissen , Arnold M. Pretorius , Etienne Barnard

Constructing high-quality features is critical to any quantitative data analysis. While feature engineering was historically addressed by carefully hand-crafting data representations based on domain expertise, deep neural networks (DNNs)…

Machine Learning · Computer Science 2025-02-25 Max Vargas , Reilly Cannon , Andrew Engel , Anand D. Sarwate , Tony Chiang

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript, we describe a custom DNN specially designed to solve problems in the RF…

Signal Processing · Electrical Eng. & Systems 2021-09-23 Brian Shevitski , Yijing Watkins , Nicole Man , Michael Girard

Though deep neural networks (DNNs) have shown superiority over other techniques in major fields like computer vision, natural language processing, robotics, recently, it has been proven that they are vulnerable to adversarial attacks. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Nupur Thakur , Yuzhen Ding , Baoxin Li

Deep neural networks have gained tremendous popularity in last few years. They have been applied for the task of classification in almost every domain. Despite the success, deep networks can be incredibly slow to train for even moderate…

Machine Learning · Computer Science 2018-10-11 Gaurav Singh , John Shawe-Taylor

The ubiquity of deep neural networks (DNNs), cloud-based training, and transfer learning is giving rise to a new cybersecurity frontier in which unsecure DNNs have `structural malware' (i.e., compromised weights and activation pathways). In…

Machine Learning · Computer Science 2021-02-05 N. Benjamin Erichson , Dane Taylor , Qixuan Wu , Michael W. Mahoney

Deep neural networks (DNN) are powerful models for many pattern recognition tasks, yet their high computational complexity and memory requirement limit them to applications on high-performance computing platforms. In this paper, we propose…

Machine Learning · Computer Science 2018-10-24 Lukas Mauch , Bin Yang

We use Deep Neural Networks (DNNs) to classify and reconstruct a large database of handwritten digits from the intensity of the speckle patterns that result after the images propagated through multimode fibers (MMF). Images transmitted…

Optics · Physics 2018-08-21 Navid Borhani , Eirini Kakkava , Christophe Moser , Demetri Psaltis

The surge in popularity of machine learning (ML) has driven significant investments in training Deep Neural Networks (DNNs). However, these models that require resource-intensive training are vulnerable to theft and unauthorized use. This…

Cryptography and Security · Computer Science 2024-03-12 Jasper Stang , Torsten Krauß , Alexandra Dmitrienko

Recently, deep neural network (DNN)-based physical layer communication techniques have attracted considerable interest. Although their potential to enhance communication systems and superb performance have been validated by simulation…

Signal Processing · Electrical Eng. & Systems 2022-08-30 Jun Liu , Haitao Zhao , Dongtang Ma , Kai Mei , Jibo Wei

Deep reinforcement learning (DRL) has become a dominant deep-learning paradigm for tasks where complex policies are learned within reactive systems. Unfortunately, these policies are known to be susceptible to bugs. Despite significant…

Robotics · Computer Science 2023-01-12 Guy Amir , Davide Corsi , Raz Yerushalmi , Luca Marzari , David Harel , Alessandro Farinelli , Guy Katz

On-line Precision scalability of the deep neural networks(DNNs) is a critical feature to support accuracy and complexity trade-off during the DNN inference. In this paper, we propose dual-precision DNN that includes two different precision…

Machine Learning · Computer Science 2024-05-14 Jae Hyun Park , Ji Sub Choi , Jong Hwan Ko

Systems based on Deep Neural Networks (DNNs) are increasingly being used in industry. In the process of system operation, DNNs need to be updated in order to improve their performance. When updating DNNs, systems used in companies that…

Software Engineering · Computer Science 2025-03-11 Takao Nakagawa , Susumu Tokumoto , Shogo Tokui , Fuyuki Ishikawa

Deep Neural Networks (DNNs) are the key to the state-of-the-art machine vision, sensor fusion and audio/video signal processing. Unfortunately, their computation complexity and tight resource constraints on the Edge make them hard to…

Machine Learning · Computer Science 2017-12-05 Ranko Sredojevic , Shaoyi Cheng , Lazar Supic , Rawan Naous , Vladimir Stojanovic