English
Related papers

Related papers: Back-engineering of spiking neural networks parame…

200 papers

The linearly inseparable XOR problem and the related problem of representing binary logical gates is revisited from the point of view of temporal encoding and its solvability by spiking neural networks with minimal configurations of leaky…

Neural and Evolutionary Computing · Computer Science 2024-08-13 Bernhard A. Moser , Michael Lunglmayr

Emulating spiking neural networks on analog neuromorphic hardware offers several advantages over simulating them on conventional computers, particularly in terms of speed and energy consumption. However, this usually comes at the cost of…

There is an interest in finding energy efficient alternatives to current state of the art neural network training algorithms. Spiking neural network are a promising approach, because they can be simulated energy efficiently on neuromorphic…

Neural and Evolutionary Computing · Computer Science 2024-03-15 Florian Bacho , Dminique Chu

Larger and deeper networks generalise well despite their increased capacity to overfit. Understanding why this happens is theoretically and practically important. One recent approach looks at the infinitely wide limits of such networks and…

Machine Learning · Computer Science 2023-10-13 Adrian Goldwaser , Hong Ge

Neural network has attracted great attention for a long time and many researchers are devoted to improve the effectiveness of neural network training algorithms. Though stochastic gradient descent (SGD) and other explicit gradient-based…

Optimization and Control · Mathematics 2020-02-11 Ren Liu , Xiaoqun Zhang

Spiking Neural Networks (SNNs) use discrete spike sequences to transmit information, which significantly mimics the information transmission of the brain. Although this binarized form of representation dramatically enhances the energy…

Neural and Evolutionary Computing · Computer Science 2023-01-31 Guobin Shen , Dongcheng Zhao , Yi Zeng

Spiking Neural Networks (SNNs) capture the information processing mechanism of the brain by taking advantage of spiking neurons, such as the Leaky Integrate-and-Fire (LIF) model neuron, which incorporates temporal dynamics and transmits…

Neural and Evolutionary Computing · Computer Science 2024-01-18 Zexiang Yi , Jing Lian , Yunliang Qi , Zhaofei Yu , Huajin Tang , Yide Ma , Jizhao Liu

In this paper, we propose a framework to repair a pre-trained feed-forward neural network (NN) to satisfy a set of properties. We formulate the properties as a set of predicates that impose constraints on the output of NN over the target…

Machine Learning · Computer Science 2021-09-30 Keyvan Majd , Siyu Zhou , Heni Ben Amor , Georgios Fainekos , Sriram Sankaranarayanan

Using precise times of every spike, spiking supervised learning has more effects on complex spatial-temporal pattern than supervised learning only through neuronal firing rates. The purpose of spiking supervised learning after…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Guojun Chen , Xianghong Lin , Guoen Wang

Radio Frequency (RF) sensing holds the potential for enabling pervasive monitoring applications. However, modern sensing algorithms imply complex operations, which clash with the energy-constrained nature of edge sensing devices. This calls…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Eleonora Cicciarella , Riccardo Mazzieri , Jacopo Pegoraro , Michele Rossi

We investigate a recently proposed model for cortical computation which performs relational inference. It consists of several interconnected, structurally equivalent populations of leaky integrate-and-fire (LIF) neurons, which are trained…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Johannes Thiele , Peter Diehl , Matthew Cook

Recent advancements in large language models (LLMs) with billions of parameters have improved performance in various applications, but their inference processes demand significant energy and computational resources. In contrast, the human…

Machine Learning · Computer Science 2025-04-11 Xingrun Xing , Boyan Gao , Zheng Zhang , David A. Clifton , Shitao Xiao , Li Du , Guoqi Li , Jiajun Zhang

Spiking Neural Networks (SNNs) are biologically-inspired models that are capable of processing information in streams of action potentials. However, simulating and training SNNs is computationally expensive due to the need to solve large…

Neurons and Cognition · Quantitative Biology 2023-12-29 Rainer Engelken

Spiking neural networks (SNNs) have attracted much attention due to their ability to process temporal information, low power consumption, and higher biological plausibility. However, it is still challenging to develop efficient and…

Neural and Evolutionary Computing · Computer Science 2023-02-21 Chunming Jiang , Yilei Zhang

The combination of new recording techniques in neuroscience and powerful inference methods recently held the promise to recover useful effective models, at the single neuron or network level, directly from observed data. The value of a…

Neurons and Cognition · Quantitative Biology 2018-04-09 Cristiano Capone , Guido Gigante , Paolo Del Giudice

Inspired by the operation of biological brains, Spiking Neural Networks (SNNs) have the unique ability to detect information encoded in spatio-temporal patterns of spiking signals. Examples of data types requiring spatio-temporal processing…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

We present a spike-based unsupervised regenerative learning scheme to train Spiking Deep Networks (SpikeCNN) for object recognition problems using biologically realistic leaky integrate-and-fire neurons. The training methodology is based on…

Neural and Evolutionary Computing · Computer Science 2016-02-05 Priyadarshini Panda , Kaushik Roy

As the size of large language models continue to scale, so does the computational resources required to run it. Spiking Neural Networks (SNNs) have emerged as an energy-efficient approach to deep learning that leverage sparse and…

Computation and Language · Computer Science 2024-07-12 Rui-Jie Zhu , Qihang Zhao , Guoqi Li , Jason K. Eshraghian

At present, implementation of learning mechanisms in spiking neural networks (SNN) cannot be considered as a solved scientific problem despite plenty of SNN learning algorithms proposed. It is also true for SNN implementation of…

Neural and Evolutionary Computing · Computer Science 2023-09-26 Mikhail Kiselev

Spiking neural networks are biologically plausible counterparts of the artificial neural networks, artificial neural networks are usually trained with stochastic gradient descent and spiking neural networks are trained with spike timing…

Neural and Evolutionary Computing · Computer Science 2019-09-26 Ruthvik Vaila , John Chiasson , Vishal Saxena