English
Related papers

Related papers: Contrastive Learning in Memristor-based Neuromorph…

200 papers

End user AI is trained on large server farms with data collected from the users. With ever increasing demand for IOT devices, there is a need for deep learning approaches that can be implemented (at the edge) in an energy efficient manner.…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Ruthvik Vaila , John Chiasson , Vishal Saxena

Spiking Neural Network (SNN) naturally inspires hardware implementation as it is based on biology. For learning, spike time dependent plasticity (STDP) may be implemented using an energy efficient waveform superposition on memristor based…

Neural and Evolutionary Computing · Computer Science 2017-08-03 Aditya Shukla , Vinay Kumar , Udayan Ganguly

Inspired by the brain's hierarchical processing and energy efficiency, this paper presents a Spiking Neural Network (SNN) architecture for lifelong Network Intrusion Detection System (NIDS). The proposed system first employs an efficient…

Machine Learning · Computer Science 2026-01-01 Md Zesun Ahmed Mia , Malyaban Bal , Sen Lu , George M. Nishibuchi , Suhas Chelian , Srini Vasan , Abhronil Sengupta

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

We recently proposed the STiDi-BP algorithm, which avoids backward recursive gradient computation, for training multi-layer spiking neural networks (SNNs) with single-spike-based temporal coding. The algorithm employs a linear approximation…

Neural and Evolutionary Computing · Computer Science 2021-09-01 Maryam Mirsadeghi , Majid Shalchian , Saeed Reza Kheradpisheh , Timothée Masquelier

Neuromorphic computing --- brainlike computing in hardware --- typically requires myriad CMOS spiking neurons interconnected by a dense mesh of nanoscale plastic synapses. Memristors are frequently citepd as strong synapse candidates due to…

Neural and Evolutionary Computing · Computer Science 2015-09-02 David Howard , Larry Bull , Ben De Lacy Costello

Spiking neural networks (SNNs) are potential competitors to artificial neural networks (ANNs) due to their high energy-efficiency on neuromorphic hardware. However, SNNs are unfolded over simulation time steps during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hong Zhang , Yu Zhang

Nanoscale resistive memories are expected to fuel dense integration of electronic synapses for large-scale neuromorphic system. To realize such a brain-inspired computing chip, a compact CMOS spiking neuron that performs in-situ learning…

Neural and Evolutionary Computing · Computer Science 2015-11-25 Xinyu Wu , Vishal Saxena , Kehan Zhu , Sakkarapani Balagopal

Recent advancements in contrastive learning have revolutionized self-supervised representation learning and achieved state-of-the-art performance on benchmark tasks. While most existing methods focus on applying contrastive learning to…

Machine Learning · Computer Science 2024-04-16 Lihui Liu , Jinha Kim , Vidit Bansal

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Short-term plasticity (STP) is a mechanism that stores decaying memories in synapses of the cerebral cortex. In computing practice, STP has been used, but mostly in the niche of spiking neurons, even though theory predicts that it is the…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Hector Garcia Rodriguez , Qinghai Guo , Timoleon Moraitis

With the development of research on memristor, memristive neural networks (MNNs) have become a hot research topic recently. Because memristor can mimic the spike timing-dependent plasticity (STDP), the research on STDP based MNNs is rapidly…

Emerging Technologies · Computer Science 2019-12-10 Zhiri Tang

Anomaly detection in dynamic networks is critical for applications from cybersecurity to industrial monitoring, yet existing methods face challenges in energy efficiency, temporal precision, and adaptability. This paper introduces…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Abdul Joseph Fofanah , Lian Wen , David Chen , Tsungcheng Yao , Kwabena Sarpong

Biological systems use neural circuits to integrate input information and produce outputs. Synaptic convergence, where multiple neurons converge their inputs onto a single downstream neuron, is common in natural neural circuits. However,…

Mesoscale and Nanoscale Physics · Physics 2026-02-04 Wendy Otieno , Alex Gabbitas , Debi Pattnaik , Pavel Borisov , Sergey Savel'ev , Alexander G. Balanov

Spiking Neural Networks (SNNs) contain more biologically realistic structures and biologically-inspired learning principles than those in standard Artificial Neural Networks (ANNs). SNNs are considered the third generation of ANNs, powerful…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Tielin Zhang , Shuncheng Jia , Xiang Cheng , Bo Xu

We develop biologically plausible training mechanisms for self-supervised learning (SSL) in deep networks. Specifically, by biological plausible training we mean (i) All updates of weights are based on current activities of pre-synaptic…

Neural and Evolutionary Computing · Computer Science 2022-02-02 Mufeng Tang , Yibo Yang , Yali Amit

Recently, brain-inspired spiking neural networks (SNNs) have attracted great research attention owing to their inherent bio-interpretability, event-triggered properties and powerful perception of spatiotemporal information, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yuqi Ma , Huamin Wang , Hangchi Shen , Xuemei Chen , Shukai Duan , Shiping Wen

The deployment of AI on edge computing devices faces significant challenges related to energy consumption and functionality. These devices could greatly benefit from brain-inspired learning mechanisms, allowing for real-time adaptation…

Synaptic plasticity poses itself as a powerful method of self-regulated unsupervised learning in neural networks. A recent resurgence of interest has developed in utilizing Artificial Neural Networks (ANNs) together with synaptic plasticity…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Samuel Schmidgall , Joe Hays

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy