English

Entropy-Based Modeling for Estimating Soft Errors Impact on Binarized Neural Network Inference

Machine Learning 2020-04-22 v2 Cryptography and Security Machine Learning

Abstract

Over past years, the easy accessibility to the large scale datasets has significantly shifted the paradigm for developing highly accurate prediction models that are driven from Neural Network (NN). These models can be potentially impacted by the radiation-induced transient faults that might lead to the gradual downgrade of the long-running expected NN inference accelerator. The crucial observation from our rigorous vulnerability assessment on the NN inference accelerator demonstrates that the weights and activation functions are unevenly susceptible to both single-event upset (SEU) and multi-bit upset (MBU), especially in the first five layers of our selected convolution neural network. In this paper, we present the relatively-accurate statistical models to delineate the impact of both undertaken SEU and MBU across layers and per each layer of the selected NN. These models can be used for evaluating the error-resiliency magnitude of NN topology before adopting them in the safety-critical applications.

Keywords

Cite

@article{arxiv.2004.05089,
  title  = {Entropy-Based Modeling for Estimating Soft Errors Impact on Binarized Neural Network Inference},
  author = {Navid Khoshavi and Saman Sargolzaei and Arman Roohi and Connor Broyles and Yu Bi},
  journal= {arXiv preprint arXiv:2004.05089},
  year   = {2020}
}
R2 v1 2026-06-23T14:47:02.300Z