English
Related papers

Related papers: Reward-based learning under hardware constraints -…

200 papers

This paper introduces SpikeFit, a novel training method for Spiking Neural Networks (SNNs) that enables efficient inference on neuromorphic hardware, considering all its stringent requirements: the number of neurons and synapses that can…

Neural and Evolutionary Computing · Computer Science 2025-11-04 Ivan Kartashov , Mariia Pushkareva , Iakov Karandashev

The brain can learn to execute a wide variety of tasks quickly and efficiently. Nevertheless, most of the mechanisms that enable us to learn are unclear or incredibly complicated. Recently, considerable efforts have been made in…

Neural and Evolutionary Computing · Computer Science 2023-03-28 Mohammad Modiri

The in-memory computing paradigm with emerging memory devices has been recently shown to be a promising way to accelerate deep learning. Resistive processing unit (RPU) has been proposed to enable the vector-vector outer product in a…

Machine Learning · Computer Science 2020-04-24 Varun Bhatt , Shalini Shrivastava , Tanmay Chavan , Udayan Ganguly

Neuromodulation plays a fundamental role in the acquisition of new behaviours. Our experimental findings show that, whereas acetylcholine biases hippocampal synaptic plasticity towards depression, the subsequent application of dopamine can…

Neurons and Cognition · Quantitative Biology 2017-10-06 Sara Zannone , Zuzanna Brzosko , Ole Paulsen , Claudia Clopath

In this study, we build a computational model of Prefrontal Cortex (PFC) using Spiking Neural Networks (SNN) to understand how neurons adapt and respond to tasks switched under short and longer duration of stimulus changes. We also explore…

Neural and Evolutionary Computing · Computer Science 2023-05-25 Ashwin Viswanathan Kannan , Goutam Mylavarapu , Johnson P Thomas

This paper presents verification and implementation methods that have been developed for the design of the BrainScaleS-2 65nm ASICs. The 2nd generation BrainScaleS chips are mixed-signal devices with tight coupling between full-custom…

Hardware Architecture · Computer Science 2020-03-26 Andreas Grübl , Sebastian Billaudelle , Benjamin Cramer , Vitali Karasenko , Johannes Schemmel

Finding spike-based learning algorithms that can be implemented within the local constraints of neuromorphic systems, while achieving high accuracy, remains a formidable challenge. Equilibrium Propagation is a promising alternative to…

Neural and Evolutionary Computing · Computer Science 2021-02-18 Erwann Martin , Maxence Ernoult , Jérémie Laydevant , Shuai Li , Damien Querlioz , Teodora Petrisor , Julie Grollier

Memristive devices are a class of circuit elements that shows great promise as future building block for brain-inspired computing. One influential view in theoretical neuroscience sees the brain as a function-computing device: given input…

Emerging Technologies · Computer Science 2022-04-13 Thomas F. Tiotto , Jelmer P. Borst , Niels A. Taatgen

Spiking neurons can perform spatiotemporal feature detection by nonlinear synaptic and dendritic integration of presynaptic spike patterns. Multicompartment models of non-linear dendrites and related neuromorphic circuit designs enable…

Neural and Evolutionary Computing · Computer Science 2021-06-02 Mattias Nilsson , Foteini Liwicki , Fredrik Sandin

Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial…

Neural and Evolutionary Computing · Computer Science 2023-02-02 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

We introduce the ``soft Deep MaxPain'' (softDMP) algorithm, which integrates the optimization of long-term policy entropy into reward-punishment reinforcement learning objectives. Our motivation is to facilitate a smoother variation of…

Machine Learning · Computer Science 2024-09-16 Jiexin Wang , Eiji Uchibe

Deep spiking neural networks (SNNs) support asynchronous event-driven computation, massive parallelism and demonstrate great potential to improve the energy efficiency of its synchronous analog counterpart. However, insufficient attention…

Neural and Evolutionary Computing · Computer Science 2019-02-18 Jibin Wu , Yansong Chua , Malu Zhang , Qu Yang , Guoqi Li , Haizhou Li

Spiking neural networks (SNNs) are good candidates to produce ultra-energy-efficient hardware. However, the performance of these models is currently behind traditional methods. Introducing multi-layered SNNs is a promising way to reduce…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Pierre Falez , Pierre Tirilly , Ioan Marius Bilasco , Philippe Devienne , Pierre Boulet

A Spiking Neural Network (SNN) is trained with Spike Timing Dependent Plasticity (STDP), which is a neuro-inspired unsupervised learning method for various machine learning applications. This paper studies the generalizability properties of…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Biswadeep Chakraborty , Saibal Mukhopadhyay

Safe reinforcement learning has been a promising approach for optimizing the policy of an agent that operates in safety-critical applications. In this paper, we propose an algorithm, SNO-MDP, that explores and optimizes Markov decision…

Machine Learning · Computer Science 2020-08-18 Akifumi Wachi , Yanan Sui

We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration…

Rats and mice use their whiskers to probe the environment. By rhythmically swiping their whiskers back and forth they can detect the existence of an object, locate it, and identify its texture. Localization can be accomplished by inferring…

Neurons and Cognition · Quantitative Biology 2021-11-17 Nimrod Sherf , Maoz Shamir

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Spiking neural networks have shown great promise for the design of low-power sensory-processing and edge-computing hardware platforms. However, implementing on-chip learning algorithms on such architectures is still an open challenge,…

Neural and Evolutionary Computing · Computer Science 2021-04-13 Matteo Cartiglia , Germain Haessig , Giacomo Indiveri

Spike-timing-dependent plasticity(STDP) is a biological process in which the precise order and timing of neuronal spikes affect the degree of synaptic modification. While there have been numerous research focusing on the role of STDP in…

Neurons and Cognition · Quantitative Biology 2021-08-10 Hong-Gyu Yoon , Pilwon Kim