English
Related papers

Related papers: Delay Learning Architectures for Memory and Classi…

200 papers

Energy efficiency and low latency are crucial requirements for designing wearable AI-empowered human activity recognition systems, due to the hard constraints of battery operations and closed-loop feedback. While neural network models have…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Sizhen Bian , Michele Magno

We introduce a novel neuromorphic network architecture based on a lattice of exciton-polariton condensates, intricately interconnected and energized through non-resonant optical pumping. The network employs a binary framework, where each…

Disordered Systems and Neural Networks · Physics 2025-01-17 Evgeny Sedov , Alexey Kavokin

This project explores the use of non-volatile synapses in neuromorphic computing for pattern recognition tasks through a comprehensive simulation-based approach. The main approach is through spintronic synapses, which leverage the…

Mesoscale and Nanoscale Physics · Physics 2025-01-08 Luis Sosa , Minhyeok Wi , Miguel Barrera , Imran Nasrullah , Yingying Wu

As spiking-based deep learning inference applications are increasing in embedded systems, these systems tend to integrate neuromorphic accelerators such as $\mu$Brain to improve energy efficiency. We propose a $\mu$Brain-based scalable…

Neural and Evolutionary Computing · Computer Science 2021-11-24 M. Lakshmi Varshika , Adarsha Balaji , Federico Corradi , Anup Das , Jan Stuijt , Francky Catthoor

Finding spike-based learning algorithms that can be implemented within the local constraints of neuromorphic systems, while achieving high accuracy, remains a formidable challenge. Equilibrium Propagation is a promising alternative to…

Neural and Evolutionary Computing · Computer Science 2021-02-18 Erwann Martin , Maxence Ernoult , Jérémie Laydevant , Shuai Li , Damien Querlioz , Teodora Petrisor , Julie Grollier

Deep learning's success comes with growing energy demands, raising concerns about the long-term sustainability of the field. Spiking neural networks, inspired by biological neurons, offer a promising alternative with potential computational…

Neural and Evolutionary Computing · Computer Science 2025-03-05 Adalbert Fono , Manjot Singh , Ernesto Araya , Philipp C. Petersen , Holger Boche , Gitta Kutyniok

We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Kakei Yamamoto , Yusuke Sakemi , Kazuyuki Aihara

Spiking neural networks (SNNs) take inspiration from the brain to enable energy-efficient computations. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on modern sequential tasks, as they inherit…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Matei Ioan Stan , Oliver Rhodes

We study the storage and retrieval of phase-coded patterns as stable dynamical attractors in recurrent neural networks, for both an analog and a integrate-and-fire spiking model. The synaptic strength is determined by a learning rule based…

Neurons and Cognition · Quantitative Biology 2010-09-08 S. Scarpetta , A. de Candia , F. Giacco

We study a model of spiking neurons, with recurrent connections that result from learning a set of spatio-temporal patterns with a spike-timing dependent plasticity rule and a global inhibition. We investigate the ability of the network to…

Neurons and Cognition · Quantitative Biology 2020-04-22 S. Scarpetta , A. de Candia

Nonlinear photonic delay systems present interesting implementation platforms for machine learning models. They can be extremely fast, offer great degrees of parallelism and potentially consume far less power than digital processors. So far…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Michiel Hermans , Miguel Soriano , Joni Dambre , Peter Bienstman , Ingo Fischer

Transformers have been established as the most popular backbones in sequence modeling, mainly due to their effectiveness in in-context retrieval tasks and the ability to learn at scale. Their quadratic memory and time complexity, however,…

Computation and Language · Computer Science 2025-05-30 Ali Behrouz , Zeman Li , Praneeth Kacham , Majid Daliri , Yuan Deng , Peilin Zhong , Meisam Razaviyayn , Vahab Mirrokni

Traffic forecasting in cellular networks is a challenging spatiotemporal prediction problem due to strong temporal dependencies, spatial heterogeneity across cells, and the need for scalability to large network deployments. Traditional…

Machine Learning · Computer Science 2026-03-16 Zineddine Bettouche , Khalid Ali , Andreas Fischer , Andreas Kassler

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

Neuromorphic systems that densely integrate CMOS spiking neurons and nano-scale memristor synapses open a new avenue of brain-inspired computing. Existing silicon neurons have molded neural biophysical dynamics but are incompatible with…

Neural and Evolutionary Computing · Computer Science 2015-06-10 Xinyu Wu , Vishal Saxena , Kehan Zhu

Deep spiking neural networks (SNNs) hold great potential for improving the latency and energy efficiency of deep neural networks through event-based computation. However, training such networks is difficult due to the non-differentiable…

Neural and Evolutionary Computing · Computer Science 2016-09-01 Jun Haeng Lee , Tobi Delbruck , Michael Pfeiffer

Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Qiang Yu , Shenglan Li , Huajin Tang , Longbiao Wang , Jianwu Dang , Kay Chen Tan

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in…

Machine Learning · Computer Science 2021-11-03 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Changqing Xu , Yijian Pei , Zili Wu , Yi Liu , Yintang Yang

In this paper, the use of third-generation machine learning, also known as spiking neural network architecture, for continuous learning was investigated and compared to conventional models. The experimentation was divided into three…

Neural and Evolutionary Computing · Computer Science 2023-10-10 C. Tanner Fredieu