English
Related papers

Related papers: Composable Probabilistic Inference Networks Using …

200 papers

Restricted Boltzmann Machines (RBMs) are one of the fundamental building blocks of deep learning. Approximate maximum likelihood training of RBMs typically necessitates sampling from these models. In many training scenarios, computationally…

Machine Learning · Computer Science 2014-10-02 Guillaume Desjardins , Heng Luo , Aaron Courville , Yoshua Bengio

In this paper, the intrinsic physical characteristics of spin-orbit torque (SOT) magnetoresistive random-access memory (MRAM) devices are leveraged to realize sigmoidal neurons in neuromorphic architectures. Performance comparisons with the…

Emerging Technologies · Computer Science 2020-06-03 Brendan Reidy , Ramtin Zand

This project explores the use of non-volatile synapses in neuromorphic computing for pattern recognition tasks through a comprehensive simulation-based approach. The main approach is through spintronic synapses, which leverage the…

Mesoscale and Nanoscale Physics · Physics 2025-01-08 Luis Sosa , Minhyeok Wi , Miguel Barrera , Imran Nasrullah , Yingying Wu

The widespread integration of embedded systems across various industries has facilitated seamless connectivity among devices and bolstered computational capabilities. Despite their extensive applications, embedded systems encounter…

Cryptography and Security · Computer Science 2024-04-16 Sreenitha Kasarapu , Sathwika Bavikadi , Sai Manoj Pudukotai Dinakarrao

The use of analog resistance states for storing weights in neuromorphic systems is impeded by fabrication imprecision and device stochasticity that limit the precision of synapse weights. This challenge can be resolved by emulating analog…

Neural and Evolutionary Computing · Computer Science 2021-12-13 Peng Zhou , Julie A. Smith , Laura Deremo , Stephen K. Heinrich-Barna , Joseph S. Friedman

Artificial Neural Network computation relies on intensive vector-matrix multiplications. Recently, the emerging nonvolatile memory (NVM) crossbar array showed a feasibility of implementing such operations with high energy efficiency, thus…

Emerging Technologies · Computer Science 2017-04-03 Hyungjun Kim , Taesu Kim , Jinseok Kim , Jae-Joon Kim

The computing wall and data movement challenges of deep neural networks (DNNs) have exposed the limitations of conventional CMOS-based DNN accelerators. Furthermore, the deep structure and large model size will make DNNs prohibitive to…

Signal Processing · Electrical Eng. & Systems 2019-12-12 Geng Yuan , Xiaolong Ma , Sheng Lin , Zhengang Li , Caiwen Ding

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

The emergence of resistive non-volatile memories opens the way to highly energy-efficient computation near- or in-memory. However, this type of computation is not compatible with conventional ECC, and has to deal with device unreliability.…

Emerging Technologies · Computer Science 2020-07-14 Marc Bocquet , Tifenn Hirtzlin , Jacques-Olivier Klein , Etienne Nowak , Elisa Vianello , Jean-Michel Portal , Damien Querlioz

As data-intensive applications increasingly strain conventional computing systems, processing-in-memory (PIM) has emerged as a promising paradigm to alleviate the memory wall by minimizing data transfer between memory and processing units.…

Emerging Technologies · Computer Science 2026-02-05 Thomas Neuner , Henriette Padberg , Lior Kornblum , Eilam Yalon , Pedram Khalili Amiri , Shahar Kvatinsky

Binarized Neural Networks, a recently discovered class of neural networks with minimal memory requirements and no reliance on multiplication, are a fantastic opportunity for the realization of compact and energy efficient inference…

Emerging Technologies · Computer Science 2019-06-04 Tifenn Hirtzlin , Bogdan Penkovsky , Marc Bocquet , Jacques-Olivier Klein , Jean-Michel Portal , Damien Querlioz

Binary stochastic neurons (BSNs) are excellent activators for machine learning. An ideal platform for implementing them are low- or zero-energy-barrier nanomagnets (LBMs) possessing in-plane anisotropy (e.g. circular or slightly elliptical…

Mesoscale and Nanoscale Physics · Physics 2023-02-28 Rahnuma Rahman , Supriyo Bandyopadhyay

We propose a new algorithm for training neural networks with binary activations and multi-level weights, which enables efficient processing-in-memory circuits with embedded nonvolatile memories (eNVM). Binary activations obviate costly DACs…

Machine Learning · Computer Science 2020-10-13 Siming Ma , David Brooks , Gu-Yeon Wei

We propose MC-CIM, a compute-in-memory (CIM) framework for robust, yet low power, Bayesian edge intelligence. Deep neural networks (DNN) with deterministic weights cannot express their prediction uncertainties, thereby pose critical risks…

Machine Learning · Computer Science 2021-11-16 Priyesh Shukla , Shamma Nasrin , Nastaran Darabi , Wilfred Gomes , Amit Ranjan Trivedi

Wind energy forecasting helps to manage power production, and hence, reduces energy cost. Deep Neural Networks (DNN) mimics hierarchical learning in the human brain and thus possesses hierarchical, distributed, and multi-task learning…

Machine Learning · Computer Science 2018-08-01 Asifullah Khan , Aneela Zameer , Tauseef Jamal , Ahmad Raza

The advent of deep learning has considerably accelerated machine learning development. The deployment of deep neural networks at the edge is however limited by their high memory and energy consumption requirements. With new memory…

Large-scale electrophysiological recordings now allow simultaneous monitoring of thousands of neurons across multiple brain regions, revealing structured variability in neural population activity. Understanding how these collective patterns…

Neurons and Cognition · Quantitative Biology 2026-03-12 Nicolas Béreux , Giovanni Catania , Aurélien Decelle , Francesca Mignacco , Alfonso de Jesús Navas Gómez , Beatriz Seoane

Stochastic neural networks are a prototypical computational device able to build a probabilistic representation of an ensemble of external stimuli. Building on the relationship between inference and learning, we derive a synaptic plasticity…

Disordered Systems and Neural Networks · Physics 2018-10-23 Luca Saglietti , Federica Gerace , Alessandro Ingrosso , Carlo Baldassi , Riccardo Zecchina

In-memory computing is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. Crossbar arrays of resistive memory devices can be used to encode the network weights and perform efficient analog…

On-chip memory (usually based on Static RAMs-SRAMs) are crucial components for various computing devices including heterogeneous devices, e.g., GPUs, FPGAs, ASICs to achieve high performance. Modern workloads such as Deep Neural Networks…

Hardware Architecture · Computer Science 2022-07-20 İsmail Emir Yüksel , Behzad Salami , Oğuz Ergin , Osman Sabri Ünsal , Adrian Cristal Kestelman