English
Related papers

Related papers: Formalising the Use of the Activation Function in …

200 papers

With recent and rapid advancements in artificial intelligence (AI), understanding the foundation of purposeful behaviour in autonomous agents is crucial for developing safe and efficient systems. While artificial neural networks have…

Artificial Intelligence · Computer Science 2025-08-12 Aswin Paul , Moein Khajehnejad , Forough Habibollahi , Brett J. Kagan , Adeel Razi

Optimal control of complex environments with robotic systems faces two complementary and intertwined challenges: efficient organization of sensory state information and far-sighted action planning. Because the reinforcement learning…

Machine Learning · Computer Science 2026-01-30 Abdullah Akgül , Gulcin Baykal , Manuel Haußmann , Mustafa Mert Çelikok , Melih Kandemir

Spiking neural network models characterize the emergent collective dynamics of circuits of biological neurons and help engineer neuro-inspired solutions across fields. Most dynamical systems' models of spiking neural networks typically…

Computational Physics · Physics 2023-04-12 Georg Börner , Fabio Schittler Neves , Marc Timme

Deep learning has recently led to great successes in tasks such as image recognition (e.g Krizhevsky et al., 2012). However, deep networks are still outmatched by the power and versatility of the brain, perhaps in part due to the richer…

Machine Learning · Statistics 2014-03-25 David P. Reichert , Thomas Serre

Recent experimental studies of living neural networks reveal that their global activation induced by electrical stimulation can be explained using the concept of bootstrap percolation on a directed random network. The experiment consists in…

Probability · Mathematics 2015-05-14 Hamed Amini

Partial synchronization plays a crucial role in the functioning of neuronal networks: selective, coordinated activation of neurons enables information processing that flexibly adapts to a changing computational context. Since the structure…

Neurons and Cognition · Quantitative Biology 2025-06-17 Daniil Radushev , Olesia Dogonasheva , Boris Gutkin , Denis Zakharov

The action potential constitutes the digital component of the signaling dynamics of neurons. But the biophysical nature of the full-time course of the action potential associated with changes in membrane potential is mathematically distinct…

Neurons and Cognition · Quantitative Biology 2026-04-16 Gabriel A. Silva

In this paper, we clarify the mechanisms underlying a general phenomenon present in pulse-coupled heterogeneous inhibitory networks: inhibition can induce not only suppression of the neural activity, as expected, but it can also promote…

Neurons and Cognition · Quantitative Biology 2017-05-23 David Angulo-Garcia , Stefano Luccioli , Simona Olmi , Alessandro Torcini

Neuronal firing activities have attracted a lot of attention since a large population of spatiotemporal patterns in the brain is the basis for adaptive behavior and can also reveal the signs for various neurological disorders including…

Neurons and Cognition · Quantitative Biology 2017-03-13 Wenyuan Li , Igor V. Ovchinnikov , Honglin Chen , Zhe Wang , Albert Lee , Hochul Lee , Carlos Cepeda , Robert N. Schwartz , Karlheinz Meier , Kang L. Wang

Analytical expressions are put forward to investigate the forced spiking activity of abstract neuron models such as the driven leaky integrate-and-fire (LIF) model. The method is valid in a wide parameter regime beyond the restraining…

Neurons and Cognition · Quantitative Biology 2007-05-23 Michael Schindler , Peter Talkner , Peter Hänggi

Active inference is a mathematical framework which originated in computational neuroscience as a theory of how the brain implements action, perception and learning. Recently, it has been shown to be a promising approach to the problems of…

Dynamic adaptation in single-neuron response plays a fundamental role in neural coding in biological neural networks. Yet, most neural activation functions used in artificial networks are fixed and mostly considered as an inconsequential…

Machine Learning · Computer Science 2020-06-23 Victor Geadah , Giancarlo Kerg , Stefan Horoi , Guy Wolf , Guillaume Lajoie

The seemingly stochastic transient dynamics of neocortical circuits observed in vivo have been hypothesized to represent a signature of ongoing stochastic inference. In vitro neurons, on the other hand, exhibit a highly deterministic…

Neurons and Cognition · Quantitative Biology 2017-03-14 Mihai A. Petrovici , Johannes Bill , Ilja Bytschok , Johannes Schemmel , Karlheinz Meier

We study in this paper the effect of an unique initial stimulation on random recurrent networks of leaky integrate and fire neurons. Indeed given a stochastic connectivity this so-called spontaneous mode exhibits various non trivial…

Neural and Evolutionary Computing · Computer Science 2007-05-23 H. Soula , G. Beslon , O. Mazet

We present a method of estimating the gradient of an objective function with respect to the synaptic weights of a spiking neural network. The method works by measuring the fluctuations in the objective function in response to dynamic…

Neurons and Cognition · Quantitative Biology 2007-05-23 Ila R. Fiete , H. Sebastian Seung

Understanding the relation between cortical neuronal network structure and neuronal activity is a fundamental unresolved question in neuroscience, with implications to our understanding of the mechanism by which neuronal networks evolve…

Active inference is a normative framework for explaining behaviour under the free energy principle -- a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on…

Neurons and Cognition · Quantitative Biology 2021-10-26 Lancelot Da Costa , Thomas Parr , Biswa Sengupta , Karl Friston

A neuroscience method to understanding the brain is to find and study the preferred stimuli that highly activate an individual cell or groups of cells. Recent advances in machine learning enable a family of methods to synthesize preferred…

Machine Learning · Computer Science 2019-04-22 Anh Nguyen , Jason Yosinski , Jeff Clune

A key question in neuroscience is at which level functional meaning emerges from biophysical phenomena. In most vertebrate systems, precise functions are assigned at the level of neural populations, while single-neurons are deemed…

Neurons and Cognition · Quantitative Biology 2017-03-17 Wieland Brendel , Ralph Bourdoukan , Pietro Vertechi , Christian K. Machens , Sophie Denéve

A simple model that replicates the dynamics of spiking and spiking-bursting activity of real biological neurons is proposed. The model is a two-dimensional map which contains one fast and one slow variable. The mechanisms behind generation…

Chaotic Dynamics · Physics 2009-11-07 Nikolai F. Rulkov