English
Related papers

Related papers: Embodied Synaptic Plasticity with Online Reinforce…

200 papers

Competitive dynamics are thought to occur in many processes of learning involving synaptic plasticity. Here we show, in a game theory-inspired model of synaptic interactions, that the competition between synapses in their weak and strong…

Disordered Systems and Neural Networks · Physics 2015-05-28 Gaurang Mahajan , Anita Mehta

Spike Timing Dependent Plasticity is form of learning that has been demonstrated in real cortical tissue, but attempts to use it for artificial systems have not produced good results. This paper seeks to remedy this with two significant…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Simon Davidson , Stephen B. Furber , Oliver Rhodes

Using precise times of every spike, spiking supervised learning has more effects on complex spatial-temporal pattern than supervised learning only through neuronal firing rates. The purpose of spiking supervised learning after…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Guojun Chen , Xianghong Lin , Guoen Wang

Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may corresponds to a synchronization phase transition. The critical dynamics near such a critical point needs further…

Disordered Systems and Neural Networks · Physics 2022-05-04 Mahsa Khoshkhou , Afshin Montakhab

Biological neural networks are characterized by their high degree of plasticity, a core property that enables the remarkable adaptability of natural organisms. Importantly, this ability affects both the synaptic strength and the topology of…

Neural and Evolutionary Computing · Computer Science 2024-06-17 Erwan Plantec , Joachin W. Pedersen , Milton L. Montero , Eleni Nisioti , Sebastian Risi

Structural plasticity of the brain describes the creation of new and the deletion of old synapses over time. Rinke et al. (JPDC 2018) introduced a scalable algorithm that simulates structural plasticity for up to one billion neurons on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-03 Fabian Czappa , Alexander Geiß , Felix Wolf

Biological neurons and their in-silico emulations for neuromorphic artificial intelligence (AI) use extraordinarily energy-efficient mechanisms, such as spike-based communication and local synaptic plasticity. It remains unclear whether…

Neural and Evolutionary Computing · Computer Science 2021-06-17 Timoleon Moraitis , Abu Sebastian , Evangelos Eleftheriou

In the mammalian nervous system, various synaptic plasticity rules act, either individually or synergistically, and over wide-ranging timescales to dictate the processes that enable learning and memory formation. To mimic biological…

Disordered Systems and Neural Networks · Physics 2021-06-11 Syed Ghazi Sarwat , Benedikt Kersting , Timoleon Moraitis , Vara Prasad Jonnalagadda , Abu Sebastian

We formulate the search for phenomenological models of synaptic plasticity as an optimization problem. We employ Cartesian genetic programming to evolve biologically plausible human-interpretable plasticity rules that allow a given network…

Neural and Evolutionary Computing · Computer Science 2021-02-09 Henrik D. Mettler , Maximilian Schmidt , Walter Senn , Mihai A. Petrovici , Jakob Jordan

Offline reinforcement learning (RL) aims to optimize a policy using collected data without online interactions. Model-based approaches are particularly appealing for addressing offline RL challenges because of their capability to mitigate…

Machine Learning · Computer Science 2026-04-14 Hao Li , Xiao-Hu Zhou , Shu-Hai Li , Mei-Jiang Gui , Xiao-Liang Xie , Shi-Qi Liu , Shuang-Yi Wang , Zhen-Qiu Feng , Zeng-Guang Hou

The human somatosensory cortex is intimately linked to other central brain functions such as vision, audition, mechanoreception, and motor planning and control. These links are established through brain learning, and display a considerable…

Robotics · Computer Science 2021-01-19 Birgitta Dresp-Langley

Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial…

Neural and Evolutionary Computing · Computer Science 2023-02-02 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

The brain is a biological system comprising nerve cells and orchestrates its embodied agent's perception, behavior, and learning in the dynamic environment. The free energy principle (FEP) advocated by Karl Friston explicates the local,…

Neurons and Cognition · Quantitative Biology 2024-10-07 Chang Sub Kim

Hippocampal reverse replay is thought to contribute to learning, and particularly reinforcement learning, in animals. We present a computational model of learning in the hippocampus that builds on a previous model of the…

Neurons and Cognition · Quantitative Biology 2021-02-25 Matthew T. Whelan , Tony J. Prescott , Eleni Vasilaki

Spike-Timing-Dependent Plasticity (STDP) provides a biologically grounded learning rule for spiking neural networks (SNNs), but its reliance on precise spike timing and pairwise updates limits fast learning of weights. We introduce a…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Gouri Lakshmi S , Athira Chandrasekharan , Harshit Kumar , Muhammed Sahad E , Bikas C Das , Saptarshi Bej

Learning policies from previously recorded data is a promising direction for real-world robotics tasks, as online learning is often infeasible. Dexterous manipulation in particular remains an open problem in its general form. The…

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

This paper presents a spike-based model which employs neurons with functionally distinct dendritic compartments for classifying high dimensional binary patterns. The synaptic inputs arriving on each dendritic subunit are nonlinearly…

Neural and Evolutionary Computing · Computer Science 2014-11-26 Shaista Hussain , Shih-Chii Liu , Arindam Basu

This study proposes voltage-dependent-synaptic plasticity (VDSP), a novel brain-inspired unsupervised local learning rule for the online implementation of Hebb's plasticity mechanism on neuromorphic hardware. The proposed VDSP learning rule…

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar