English

Integrated Artificial Neural Network with Trainable Activation Function Enabled by Topological Insulator-based Spin-Orbit Torque Devices

Mesoscale and Nanoscale Physics 2023-05-22 v2

Abstract

Non-volatile memristors offer a salient platform for artificial neural network (ANN), but the integration of different function blocks into one hardware system remains challenging. Here we demonstrate the implementation of brain-like synaptic (SOT-S) and neuronal (SOT-N) functions in the Bi2Te3/CrTe2 heterostructure-based spin-orbit torque (SOT) device. The SOT-S unit exhibits highly linear (linearity error < 4.19%) and symmetrical long-term potentiation/depression process, resulting in better performance compared to other memristor synapses. Meanwhile, the Sigmoid-shape transition curve inherited in the SOT-N cell replaces the software-based activation function block, hence reducing the system complexity. On this basis, we employ a serial-connected, voltage-mode sensing ANN architecture to enhance the vector-matrix multiplication signal strength with low reading error of 0.61%. Furthermore, the trainable activation function of SOT-N enables the integrated SOT-ANN to execute the Batch Normalization algorithm and activation operation within one clock cycle, which bring about improved on/off-chip training performance close to the ideal baseline.

Keywords

Cite

@article{arxiv.2209.06001,
  title  = {Integrated Artificial Neural Network with Trainable Activation Function Enabled by Topological Insulator-based Spin-Orbit Torque Devices},
  author = {Puyang Huang and Xinqi Liu and Yue Xin and Yu Gu and Albert Lee and Zhuo Xu and Peng Chen and Yu Zhang and Weijie Deng and Guoqiang Yu and Zhongkai Liu and Qi Yao and Yumeng Yang and Zhifeng Zhu and Xufeng Kou},
  journal= {arXiv preprint arXiv:2209.06001},
  year   = {2023}
}
R2 v1 2026-06-28T01:12:52.072Z