English
Related papers

Related papers: Implementation of Ternary Weights with Resistive R…

200 papers

Brain-inspired computing aims to mimic cognitive functions like associative memory, the ability to recall complete patterns from partial cues. Memristor technology offers promising hardware for such neuromorphic systems due to its potential…

Machine Learning · Computer Science 2025-05-20 Chengping He , Mingrui Jiang , Keyi Shan , Szu-Hao Yang , Zefan Li , Shengbo Wang , Giacomo Pedretti , Jim Ignowski , Can Li

Memristive neural networks (MNNs), which use memristors as neurons or synapses, have become a hot research topic recently. However, most memristors are not compatible with mainstream integrated circuit technology and their stabilities in…

Emerging Technologies · Computer Science 2019-01-03 Zhiri Tang , Ruohua Zhu , Peng Lin , Jin He , Hao Wang , Qijun Huang , Sheng Chang , Qiming Ma

Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally…

Binary matrix-vector multiplication (BMVM) is a key operation in post-quantum cryptography schemes like the Classic McEliece cryptosystem. Conventional computing architectures incur significant energy efficiency loss due to data movement of…

Emerging Technologies · Computer Science 2025-07-15 Hao Yue , Yihao Chen , Tianhang Liang , Xiangrui Li , Xin Kong , Zhelong Jiang , Zhigang Li , Gang Chen , Huaxiang Lu

Current large scale implementations of deep learning and data mining require thousands of processors, massive amounts of off-chip memory, and consume gigajoules of energy. Emerging memory technologies such as nanoscale two-terminal…

Neural and Evolutionary Computing · Computer Science 2016-11-15 S. Burc Eryilmaz , Emre Neftci , Siddharth Joshi , SangBum Kim , Matthew BrightSky , Hsiang-Lan Lung , Chung Lam , Gert Cauwenberghs , H. -S. Philip Wong

Resistive Random Access Memory (ReRAM) has emerged as a promising platform for deep neural networks (DNNs) due to its support for parallel in-situ matrix-vector multiplication. However, hardware failures, such as stuck-at-fault defects, can…

Machine Learning · Computer Science 2024-01-23 Bingbing Li , Geng Yuan , Zigeng Wang , Shaoyi Huang , Hongwu Peng , Payman Behnam , Wujie Wen , Hang Liu , Caiwen Ding

Due to many limitations of Von Neumann architecture such as speed, memory bandwidth, efficiency of global interconnects and increase in the application of artificial neural network, researchers have been pushed to look into alternative…

Emerging Technologies · Computer Science 2019-05-15 Harshit Roy , Mrigank Sharad

Reducing computational costs is an important issue for development of embedded systems. Binary-weight Neural Networks (BNNs), in which weights are binarized and activations are quantized, are employed to reduce computational costs of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Tse-Wei Chen , Wei Tao , Dongyue Zhao , Kazuhiro Mima , Tadayuki Ito , Kinya Osa , Masami Kato

The in-memory computing paradigm with emerging memory devices has been recently shown to be a promising way to accelerate deep learning. Resistive processing unit (RPU) has been proposed to enable the vector-vector outer product in a…

Machine Learning · Computer Science 2020-04-24 Varun Bhatt , Shalini Shrivastava , Tanmay Chavan , Udayan Ganguly

Compute-in-Memory (CIM) and weight sparsity are two effective techniques to reduce data movement during Neural Network (NN) inference. However, they can hardly be employed in the same accelerator simultaneously because CIM requires…

Hardware Architecture · Computer Science 2025-11-19 Weiping Yang , Shilin Zhou , Hui Xu , Yujiao Nie , Qimin Zhou , Zhiwei Li , Changlin Chen

We propose a process to compress a pre-trained Vision Language Model into a ternary version of itself instead of training a ternary model from scratch. A new initialization scheme from pre-trained weights based on the k-means algorithm is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Ben Crulis , Cyril De Runz , Barthelemy Serres , Gilles Venturini

As conventional memory technologies are challenged by their technological physical limits, emerging technologies driven by novel materials are becoming an attractive option for future memory architectures. Among these technologies,…

Materials Science · Physics 2015-05-28 Omid Kavehei , Said Al-Sarawi , Kyoung-Rok Cho , Kamran Eshraghian , Derek Abbott

The impressive performance of artificial neural networks has come at the cost of high energy usage and CO$_2$ emissions. Unconventional computing architectures, with magnetic systems as a candidate, have potential as alternative…

Emerging Technologies · Computer Science 2023-03-06 Matthew O. A. Ellis , Alex Welbourne , Stephan J. Kyle , Paul W. Fry , Dan A. Allwood , Thomas J. Hayward , Eleni Vasilaki

When neural networks (NeuralNets) are implemented in hardware, their weights need to be stored in memory devices. As noise accumulates in the stored weights, the NeuralNet's performance will degrade. This paper studies how to use error…

Information Theory · Computer Science 2020-01-14 Kunping Huang , Paul Siegel , Anxiao , Jiang

Recent work showed neural-network-based approaches to reconstructing images from compressively sensed measurements offer significant improvements in accuracy and signal compression. Such methods can dramatically boost the capability of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Fangliang Bai , Jinchao Liu , Xiaojuan Liu , Margarita Osadchy , Chao Wang , Stuart J. Gibson

Recently, RRAM-based Binary Neural Network (BNN) hardware has been gaining interests as it requires 1-bit sense-amp only and eliminates the need for high-resolution ADC and DAC. However, RRAM-based BNN hardware still requires…

Neural and Evolutionary Computing · Computer Science 2019-04-16 Yulhwa Kim , Hyungjun Kim , Jae-Joon Kim

We introduce an algorithm where the individual bits representing the weights of a neural network are learned. This method allows training weights with integer values on arbitrary bit-depths and naturally uncovers sparse networks, without…

Machine Learning · Computer Science 2022-02-22 Cristian Ivan

Resistive random access memory (RRAM) is very well known for its potential application in in-memory and neural computing. However, they often have different types of device-to-device and cycle-to-cycle variability. This makes it harder to…

Emerging Technologies · Computer Science 2023-08-08 Rajalekshmi TR , Rinku Rani Das , Chithra R , Alex James

Single layer feedforward networks with random weights are known for their non-iterative and fast training algorithms and are successful in a variety of classification and regression problems. A major drawback of these networks is that they…

Machine Learning · Computer Science 2020-09-25 Ajay M. Patrikar

The Spiking Neural Network (SNN), a biologically inspired neural network infrastructure, has garnered significant attention recently. SNNs utilize binary spike activations for efficient information transmission, replacing multiplications…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yufei Guo , Yuhan Zhang , Zhou Jie , Xiaode Liu , Xin Tong , Yuanpei Chen , Weihang Peng , Zhe Ma