English
Related papers

Related papers: A noise-tolerant, resource-saving probabilistic bi…

200 papers

Resistive random access memories (RRAM) are novel nonvolatile memory technologies, which can be embedded at the core of CMOS, and which could be ideal for the in-memory implementation of deep neural networks. A particularly exciting vision…

Emerging Technologies · Computer Science 2019-04-09 Tifenn Hirtzlin , Marc Bocquet , Jacques-Olivier Klein , Etienne Nowak , Elisa Vianello , Jean-Michel Portal , Damien Querlioz

Bayesian Neural Networks (BNNs) can overcome the problem of overconfidence that plagues traditional frequentist deep neural networks, and are hence considered to be a key enabler for reliable AI systems. However, conventional hardware…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Nicolas Skatchkovsky , Osvaldo Simeone , Bipin Rajendran , Bashir M. Al-Hashimi

Energy-efficient methods are addressed for leveraging low energy barrier nanomagnetic devices within neuromorphic architectures. Using a Magnetoresistive Random Access Memory (MRAM) probabilistic device (p-bit) as the basis of neuronal…

Emerging Technologies · Computer Science 2020-05-06 Hossein Pourmeidani , Punyashloka Debashis , Zhihong Chen , Ronald F. DeMara , Ramtin Zand

Low bit-width weights and activations are an effective way of combating the increasing need for both memory and compute power of Deep Neural Networks. In this work, we present a probabilistic training method for Neural Network with both…

Machine Learning · Computer Science 2018-09-11 Jorn W. T. Peters , Max Welling

Stateful logic is a promising processing-in-memory (PIM) paradigm to perform logic operations using emerging nonvolatile memory cells. While most stateful logic circuits to date focused on technologies such as resistive RAM, we propose two…

Emerging Technologies · Computer Science 2022-08-02 Barak Hoffer , Shahar Kvatinsky

Analog computing hardwares, such as Processing-in-memory (PIM) accelerators, have gradually received more attention for accelerating the neural network computations. However, PIM accelerators often suffer from intrinsic noise in the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Li-Huang Tsai , Shih-Chieh Chang , Yu-Ting Chen , Jia-Yu Pan , Wei Wei , Da-Cheng Juan

Bayesian networks play an increasingly important role in data mining, inference, and reasoning with the rapid development of artificial intelligence. In this paper, we present proof-of-concept experiments demonstrating the use of spin-orbit…

Binary stochastic neurons (BSN's) form an integral part of many machine learning algorithms, motivating the development of hardware accelerators for this complex function. It has been recognized that hardware BSN's can be implemented using…

Emerging Technologies · Computer Science 2019-04-23 Orchi Hassan , Rafatul Faria , Kerem Y. Camsari , Jonathan Z. Sun , Supriyo Datta

Non-volatile memristors offer a salient platform for artificial neural network (ANN), but the integration of different function blocks into one hardware system remains challenging. Here we demonstrate the implementation of brain-like…

Mesoscale and Nanoscale Physics · Physics 2023-05-22 Puyang Huang , Xinqi Liu , Yue Xin , Yu Gu , Albert Lee , Zhuo Xu , Peng Chen , Yu Zhang , Weijie Deng , Guoqiang Yu , Zhongkai Liu , Qi Yao , Yumeng Yang , Zhifeng Zhu , Xufeng Kou

Interest in Restricted Boltzmann Machine (RBM) is growing as a generative stochastic artificial neural network to implement a novel energy-efficient machine-learning (ML) technique. For a hardware implementation of the RBM, an essential…

Bayesian Neural Networks (BNNs) provide superior estimates of uncertainty by generating an ensemble of predictive distributions. However, inference via ensembling is resource-intensive, requiring additional entropy sources to generate…

Emerging Technologies · Computer Science 2025-05-20 Prabodh Katti , Clement Ruah , Osvaldo Simeone , Bashir M. Al-Hashimi , Bipin Rajendran

The brain performs intelligent tasks with extremely low energy consumption. This work takes inspiration from two strategies used by the brain to achieve this energy efficiency: the absence of separation between computing and memory…

Low-bit quantized neural networks are of great interest in practical applications because they significantly reduce the consumption of both memory and computational resources. Binary neural networks are memory and computationally efficient…

Machine Learning · Computer Science 2022-05-20 Anton Trusov , Elena Limonova , Dmitry Nikolaev , Vladimir V. Arlazarov

Artificial intelligence applications in autonomous driving, medical diagnostics, and financial systems increasingly demand machine learning models that can provide robust uncertainty quantification, interpretability, and noise resilience.…

Many real-world mission-critical applications require continual online learning from noisy data and real-time decision making with a defined confidence level. Probabilistic models and stochastic neural networks can explicitly handle…

Disordered Systems and Neural Networks · Physics 2022-06-01 Sourav Dutta , Georgios Detorakis , Abhishek Khanna , Benjamin Grisafe , Emre Neftci , Suman Datta

Spin-orbit torque (SOT)-induced magnetization switching shows promise for realizing ultrafast and reliable spintronics devices. Bipolar switching of perpendicular magnetization via SOT is achieved under an in-plane magnetic field collinear…

Materials Science · Physics 2016-05-04 Shunsuke Fukami , Chaoliang Zhang , Samik DuttaGupta , Hideo Ohno

A low-energy hardware implementation of deep belief network (DBN) architecture is developed using near-zero energy barrier probabilistic spin logic devices (p-bits), which are modeled to realize an intrinsic sigmoidal activation function. A…

Emerging Technologies · Computer Science 2018-06-13 Ramtin Zand , Kerem Yunus Camsari , Steven D. Pyle , Ibrahim Ahmed , Chris H. Kim , Ronald F. DeMara

We present a novel design of a strained topological insulator spin-orbit torque random access memory (STI-SOTRAM) bit cell comprising a piezoelectric/magnet (gating)/topological insulator (TI)/magnet (storage) heterostructure that leverages…

Mesoscale and Nanoscale Physics · Physics 2025-03-03 Md Golam Morshed , Hamed Vakili , Mohammad Nazmus Sakib , Samiran Ganguly , Mircea R. Stan , Avik W. Ghosh

This study presents a neural network which uses filters based on logistic mapping (LogNNet). LogNNet has a feedforward network structure, but possesses the properties of reservoir neural networks. The input weight matrix, set by a recurrent…

Neural and Evolutionary Computing · Computer Science 2020-09-07 Andrei Velichko

Probabilistic machine learning utilizes controllable sources of randomness to encode uncertainty and enable statistical modeling. Harnessing the pure randomness of quantum vacuum noise, which stems from fluctuating electromagnetic fields,…