English

NullaNet: Training Deep Neural Networks for Reduced-Memory-Access Inference

Machine Learning 2018-08-28 v2 Neural and Evolutionary Computing Machine Learning

Abstract

Deep neural networks have been successfully deployed in a wide variety of applications including computer vision and speech recognition. However, computational and storage complexity of these models has forced the majority of computations to be performed on high-end computing platforms or on the cloud. To cope with computational and storage complexity of these models, this paper presents a training method that enables a radically different approach for realization of deep neural networks through Boolean logic minimization. The aforementioned realization completely removes the energy-hungry step of accessing memory for obtaining model parameters, consumes about two orders of magnitude fewer computing resources compared to realizations that use floatingpoint operations, and has a substantially lower latency.

Keywords

Cite

@article{arxiv.1807.08716,
  title  = {NullaNet: Training Deep Neural Networks for Reduced-Memory-Access Inference},
  author = {Mahdi Nazemi and Ghasem Pasandi and Massoud Pedram},
  journal= {arXiv preprint arXiv:1807.08716},
  year   = {2018}
}
R2 v1 2026-06-23T03:11:15.456Z