English
Related papers

Related papers: A Supervised STDP-based Training Algorithm for Liv…

200 papers

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised…

Machine Learning · Statistics 2017-05-22 E. Miles Stoudenmire , David J. Schwab

We present a fully memristive spiking neural network (MSNN) consisting of physically-realizable memristive neurons and memristive synapses to implement an unsupervised Spiking Time Dependent Plasticity (STDP) learning rule. The system is…

Neural and Evolutionary Computing · Computer Science 2022-03-11 Peng Zhou , Dong-Uk Choi , Jason K. Eshraghian , Sung-Mo Kang

We present new theoretical foundations for unsupervised Spike-Timing-Dependent Plasticity (STDP) learning in spiking neural networks (SNNs). In contrast to empirical parameter search used in most previous works, we provide novel theoretical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Ali Safa , Ilja Ocket , André Bourdoux , Hichem Sahli , Francky Catthoor , Georges Gielen

Computation on a large volume of data at high speed and low power requires energy-efficient computing architectures. Spiking neural network (SNN) with bio-inspired spike-timing-dependent plasticity learning (STDP) is a promising solution…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Sahibia Kaur Vohra , Sherin A Thomas , Mahendra Sakare , Devarshi Mrinal Das

Training deep neural networks with the error backpropagation algorithm is considered implausible from a biological perspective. Numerous recent publications suggest elaborate models for biologically plausible variants of deep learning,…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Bernd Illing , Wulfram Gerstner , Johanni Brea

Current advances in technology have highlighted the importance of video analysis in the domain of computer vision. However, video analysis has considerably high computational costs with traditional artificial neural networks (ANNs). Spiking…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Mireille El-Assal , Pierre Tirilly , Ioan Marius Bilasco

With the development of research on memristor, memristive neural networks (MNNs) have become a hot research topic recently. Because memristor can mimic the spike timing-dependent plasticity (STDP), the research on STDP based MNNs is rapidly…

Emerging Technologies · Computer Science 2019-12-10 Zhiri Tang

We present a fast, fully parameterizable GPU implementation of Convolutional Neural Network variants. Our feature extractors are neither carefully designed nor pre-wired, but rather learned in a supervised way. Our deep hierarchical…

Artificial Intelligence · Computer Science 2011-02-02 Dan C. Cireşan , Ueli Meier , Jonathan Masci , Luca M. Gambardella , Jürgen Schmidhuber

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Shahriar Rezghi Shirsavar , Abdol-Hossein Vahabie , Mohammad-Reza A. Dehaqani

Neural machine learning methods, such as deep neural networks (DNN), have achieved remarkable success in a number of complex data processing tasks. These methods have arguably had their strongest impact on tasks such as image and audio…

Learning sparse feature representations is a useful instrument for solving an unsupervised learning problem. In this paper, we present three labeled handwritten digit datasets, collectively called n-MNIST. Then, we propose a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Saikat Basu , Manohar Karki , Sangram Ganguly , Robert DiBiano , Supratik Mukhopadhyay , Ramakrishna Nemani

A new supervised learning algorithm, SNN/LP, is proposed for Spiking Neural Networks. This novel algorithm uses limited precision for both synaptic weights and synaptic delays; 3 bits in each case. Also a genetic algorithm is used for the…

Neural and Evolutionary Computing · Computer Science 2014-07-02 Evangelos Stromatias , John Marsland

Traditional methods of computer vision and machine learning cannot match human performance on tasks such as the recognition of handwritten digits or traffic signs. Our biologically plausible deep artificial neural network architectures can.…

Computer Vision and Pattern Recognition · Computer Science 2012-11-15 Dan Cireşan , Ueli Meier , Juergen Schmidhuber

Spike-timing-dependent-plasticity (STDP) is an unsupervised learning algorithm for spiking neural network (SNN), which promises to achieve deeper understanding of human brain and more powerful artificial intelligence. While conventional…

Neural and Evolutionary Computing · Computer Science 2019-09-13 Xueyuan She , Yun Long , Saibal Mukhopadhyay

We exploit a recently derived inversion scheme for arbitrary deep neural networks to develop a new semi-supervised learning framework that applies to a wide range of systems and problems. The approach outperforms current state-of-the-art…

Machine Learning · Statistics 2017-11-15 Randall Balestriero , Vincent Roger , Herve G. Glotin , Richard G. Baraniuk

Spike-Timing-Dependent Plasticity (STDP) is an unsupervised learning mechanism for Spiking Neural Networks (SNNs) that has received significant attention from the neuromorphic hardware community. However, scaling such local learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sen Lu , Abhronil Sengupta

Spiking Neural Network (SNN), as a brain-inspired approach, is attracting attention due to its potential to produce ultra-high-energy-efficient hardware. Competitive learning based on Spike-Timing-Dependent Plasticity (STDP) is a popular…

Neural and Evolutionary Computing · Computer Science 2020-10-20 Mingyuan Meng , Xingyu Yang , Shanlin Xiao , Zhiyi Yu

The rapid evolution of deep neural networks has revolutionized the field of machine learning, enabling remarkable advancements in various domains. In this article, we introduce NeuroWrite, a unique method for predicting the categorization…

Computer Vision and Pattern Recognition · Computer Science 2024-09-01 Kottakota Asish , P. Sarath Teja , R. Kishan Chander , D. Deva Hema

End user AI is trained on large server farms with data collected from the users. With ever increasing demand for IOT devices, there is a need for deep learning approaches that can be implemented (at the edge) in an energy efficient manner.…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Ruthvik Vaila , John Chiasson , Vishal Saxena