English
Related papers

Related papers: Using Floating Gate Memory to Train Ideal Accuracy…

200 papers

Herein, a bit-wise Convolutional Neural Network (CNN) in-memory accelerator is implemented using Spin-Orbit Torque Magnetic Random Access Memory (SOT-MRAM) computational sub-arrays. It utilizes a novel AND-Accumulation method capable of…

Machine Learning · Computer Science 2019-04-18 Arman Roohi , Shaahin Angizi , Deliang Fan , Ronald F DeMara

Current Artificial Intelligence (AI) computation systems face challenges, primarily from the memory-wall issue, limiting overall system-level performance, especially for Edge devices with constrained battery budgets, such as smartphones,…

Hardware Architecture · Computer Science 2024-10-15 Lucas Huijbregts , Liu Hsiao-Hsuan , Paul Detterer , Said Hamdioui , Amirreza Yousefzadeh , Rajendra Bishnoi

We study how to set channel numbers in a neural network to achieve better accuracy under constrained resources (e.g., FLOPs, latency, memory footprint or model size). A simple and one-shot solution, named AutoSlim, is presented. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jiahui Yu , Thomas Huang

Hardware neural networks that implement synaptic weights with embedded non-volatile memory, such as spin torque memory (ST-MRAM), are a major lead for low energy artificial intelligence. In this work, we propose an approximate storage…

Emerging Technologies · Computer Science 2018-10-26 Nicolas Locatelli , Adrien F. Vincent , Damien Querlioz

Spintronic devices are considered as promising candidates in implementing neuromorphic systems or hardware neural networks, which are expected to perform better than other existing computing systems for certain data classification and…

In recent years, the space community has been exploring the possibilities of Artificial Intelligence (AI), specifically Artificial Neural Networks (ANNs), for a variety of on board applications. However, this development is limited by the…

Hardware Architecture · Computer Science 2025-09-03 Zacharia A. Rudge , Dario Izzo , Moritz Fieback , Anteneh Gebregiorgis , Said Hamdioui , Dominik Dold

Conventional neural structures tend to communicate through analog quantities such as currents or voltages, however, as CMOS devices shrink and supply voltages decrease, the dynamic range of voltage/current-domain analog circuits becomes…

Neural and Evolutionary Computing · Computer Science 2025-05-15 Xiangyu Chen , Zolboo Byambadorj , Takeaki Yajima , Hisashi Inoue , Isao H. Inoue , Tetsuya Iizuka

Analog Compute-In-Memory (CIM) architectures promise significant energy efficiency gains for neural network inference, but suffer from complex hardware-induced noise that poses major challenges for deployment. While noise-aware training…

Machine Learning · Computer Science 2025-08-19 Yuannuo Feng , Wenyong Zhou , Yuexi Lyu , Yixiang Zhang , Zhengwu Liu , Ngai Wong , Wang Kang

Modern CNN are typically based on floating point linear algebra based implementations. Recently, reduced precision NN have been gaining popularity as they require significantly less memory and computational resources compared to floating…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jiang Su , Nicholas J. Fraser , Giulio Gambardella , Michaela Blott , Gianluca Durelli , David B. Thomas , Philip Leong , Peter Y. K. Cheung

Deep neural networks have enabled progress in a wide variety of applications. Growing the size of the neural network typically results in improved accuracy. As model sizes grow, the memory and compute requirements for training these models…

Up to now, the training processes of typical Generative Adversarial Networks (GANs) are still particularly sensitive to data properties and hyperparameters, which may lead to severe oscillations, difficulties in convergence, or even…

Machine Learning · Computer Science 2025-04-22 Lin Wang , Xiancheng Wang , Rui Wang , Zhibo Zhang , Minghang Zhao

Nanoscale resistive memories are expected to fuel dense integration of electronic synapses for large-scale neuromorphic system. To realize such a brain-inspired computing chip, a compact CMOS spiking neuron that performs in-situ learning…

Neural and Evolutionary Computing · Computer Science 2015-11-25 Xinyu Wu , Vishal Saxena , Kehan Zhu , Sakkarapani Balagopal

In this paper, we describe a design of a mixed signal circuit for a binary neuron (a.k.a perceptron, threshold logic gate) and a methodology for automatically embedding such cells in ASICs. The binary neuron, referred to as an FTL (flash…

Emerging Technologies · Computer Science 2022-04-19 Ankit Wagle , Gian Singh , Sunil Khatri , Sarma Vrudhula

Spiking Neural Networks (SNNs) emerged as a promising solution in the field of Artificial Neural Networks (ANNs), attracting the attention of researchers due to their ability to mimic the human brain and process complex information with…

Neural and Evolutionary Computing · Computer Science 2023-09-12 Pavithra Koralalage , Ireoluwa Fakeye , Pedro Machado , Jason Smith , Isibor Kennedy Ihianle , Salisu Wada Yahaya , Andreas Oikonomou , Ahmad Lotfi

A coupled spintronic oscillator array has been considered attractive for neuromorphic computing applications. Experimental reports have shown the nano-constriction geometry to be a relatively easier-to-fabricate platform for implementing…

We propose and numerically simulate novel reconfigurable logic gates employing spin metal-oxide-semiconductor field-effect transistors (spin MOSFETs). The output characteristics of the spin MOSFETs depend on the relative magnetization…

Materials Science · Physics 2007-05-23 Satoshi Sugahara , Tomohiro Matsuno , Masaaki Tanaka

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Optical neural networks (ONNs) have demonstrated record-breaking potential in high-performance neuromorphic computing due to their ultra-high execution speed and low energy consumption. However, current learning protocols fail to provide…

Emerging Technologies · Computer Science 2021-09-07 Jiaqi Gu , Chenghao Feng , Zheng Zhao , Zhoufeng Ying , Ray T. Chen , David Z. Pan

While integer arithmetic has been widely adopted for improved performance in deep quantized neural network inference, training remains a task primarily executed using floating point arithmetic. This is because both high dynamic range and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Maolin Wang , Seyedramin Rasoulinezhad , Philip H. W. Leong , Hayden K. H. So

Energy efficiency in computation is ultimately limited by noise, with quantum limits setting the fundamental noise floor. Analog physical neural networks hold promise for improved energy efficiency compared to digital electronic neural…