English
Related papers

Related papers: Formalising the Use of the Activation Function in …

200 papers

Elucidating the neurophysiological mechanisms underlying neural pattern formation remains an outstanding challenge in Computational Neuroscience. In this paper, we address the issue of understanding the emergence of neural patterns by…

Neurons and Cognition · Quantitative Biology 2024-06-04 Gregory Dumont , Carmen Oana Tarniceriu

Artificial Intelligence has looked into biological systems as a source of inspiration. Although there are many aspects of the brain yet to be discovered, neuroscience has found evidence that the connections between neurons continuously grow…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Javier Lopez Randulfe , Leon Bonde Larsen

Spintronic devices offer a promising avenue for the development of nanoscale, energy-efficient artificial neurons for neuromorphic computing. It has previously been shown that with antiferromagnetic (AFM) oscillators, ultra-fast spiking…

Neural and Evolutionary Computing · Computer Science 2024-07-31 Hannah Bradley , Steven Louis , Andrei Slavin , Vasyl Tyberkevych

Spiking neural networks (SNNs), inspired by the neural circuits of the brain, are promising in achieving high computational efficiency with biological fidelity. Nevertheless, it is quite difficult to optimize SNNs because the functional…

Neural and Evolutionary Computing · Computer Science 2025-01-28 Huifeng Yin , Hanle Zheng , Jiayi Mao , Siyuan Ding , Xing Liu , Mingkun Xu , Yifan Hu , Jing Pei , Lei Deng

Spiking Neural Networks (SNNs) are widely regarded as a biologically-inspired and energy-efficient alternative to classical artificial neural networks. Yet, their theoretical foundations remain only partially understood. In this work, we…

Optimization and Control · Mathematics 2025-09-29 Umberto Biccari

The firing dynamics of biological neurons in mathematical models is often determined by the model's parameters, representing the neurons' underlying properties. The parameter estimation problem seeks to recover those parameters of a single…

Neurons and Cognition · Quantitative Biology 2022-10-05 Long Le , Yao Li

Active inference is a process theory of the brain that states that all living organisms infer actions in order to minimize their (expected) free energy. However, current experiments are limited to predefined, often discrete, state spaces.…

Machine Learning · Computer Science 2020-02-25 Ozan Çatal , Tim Verbelen , Johannes Nauta , Cedric De Boom , Bart Dhoedt

Neurophysiologists are nowadays able to record from a large number of extracellular electrodes and to extract, from the raw data, the sequences of action potentials or spikes generated by many neurons. Unfortunately these ''many neurons''…

Applications · Statistics 2026-04-22 Pierre Charitat , Ségolen Geffray , Christophe Pouzat

Many activation functions have been proposed in the past, but selecting an adequate one requires trial and error. We propose a new methodology of designing activation functions within a neural network at each layer. We call this technique…

Machine Learning · Statistics 2017-02-28 Mark Harmon , Diego Klabjan

The bio-inspired integrate-fire-reset mechanism of spiking neurons constitutes the foundation for efficient processing in Spiking Neural Networks (SNNs). Recent progress in large models demands that spiking neurons support highly parallel…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Yanbin Huang , Man Yao , Yuqi Pan , Changze Lv , Siyuan Xu , Xiaoqing Zheng , Bo Xu , Guoqi Li

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

Emerging Technologies · Computer Science 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Neurofeedback is a form of brain training in which subjects are fed back information about some measure of their brain activity which they are instructed to modify in a way thought to be functionally advantageous. Over the last twenty…

Neurons and Cognition · Quantitative Biology 2018-05-15 David Papo

Our knowledge of the sensory world is encoded by neurons in sequences of discrete, identical pulses termed action potentials or spikes. There is persistent controversy about the extent to which the precise timing of these spikes is relevant…

Neurons and Cognition · Quantitative Biology 2007-05-23 Ilya Nemenman , Geoffrey D. Lewen , William Bialek , Rob R. de Ruyter van Steveninck

Collective rhythmic dynamics from neurons is vital for cognitive functions such as memory formation but how neurons self-organize to produce such activity is not well understood. Attractor-based models have been successfully implemented as…

Neurons and Cognition · Quantitative Biology 2013-03-22 Mark Niedringhaus , Xin Chen , Katherine Conant , Rhonda Dzakpasu

The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience that can produce human-like behavior through reward-based learning. In this study, we test the ability for the AIF to…

Neurons and Cognition · Quantitative Biology 2022-11-21 Zhizhuo Yang , Gabriel J. Diaz , Brett R. Fajen , Reynold Bailey , Alexander Ororbia

The excitability property of spiking neurons describes their capability to output an action potential as a real-time response to an input synaptic excitation current and is central to the event-based neuromorphic computing paradigm. The…

Statistical Mechanics · Physics 2025-11-18 Léopold Van Brandt , Grégoire Brandsteert , Denis Flandre

Spiking neural networks are a type of artificial neural networks in which communication between neurons is only made of events, also called spikes. This property allows neural networks to make asynchronous and sparse computations and…

Neural and Evolutionary Computing · Computer Science 2024-05-07 Florent De Geeter , Damien Ernst , Guillaume Drion

We review different aspects of the simulation of spiking neural networks. We start by reviewing the different types of simulation strategies and algorithms that are currently implemented. We next review the precision of those simulation…

Encoding models are used for predicting brain activity in response to sensory stimuli with the objective of elucidating how sensory information is represented in the brain. Encoding models typically comprise a nonlinear transformation of…

Neurons and Cognition · Quantitative Biology 2017-03-13 Umut Güçlü , Marcel A. J. van Gerven

We study the spike statistics of neurons in a network with dynamically balanced excitation and inhibition. Our model, intended to represent a generic cortical column, comprises randomly connected excitatory and inhibitory leaky…

Neurons and Cognition · Quantitative Biology 2007-05-23 Alexander Lerchner , Cristina Ursta , John Hertz , Mandana Ahmadi , Pauline Ruffiot