中文
相关论文

相关论文: Reward-based learning under hardware constraints -…

200 篇论文

The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since…

Spike-timing-dependent plasticity (STDP) with asymmetric learning windows is commonly found in the brain and useful for a variety of spike-based computations such as input filtering and associative memory. A natural consequence of STDP is…

神经元与认知 · 定量生物学 2012-07-13 Naoki Masuda , Hiroshi Kori

We study risk-sensitive reinforcement learning (RL) based on an entropic risk measure in episodic non-stationary Markov decision processes (MDPs). Both the reward functions and the state transition kernels are unknown and allowed to vary…

机器学习 · 计算机科学 2022-11-22 Yuhao Ding , Ming Jin , Javad Lavaei

The plasticity of the conduction delay between neurons plays a fundamental role in learning. However, the exact underlying mechanisms in the brain for this modulation is still an open problem. Understanding the precise adjustment of…

神经与进化计算 · 计算机科学 2020-11-19 Alireza Nadafian , Mohammad Ganjtabesh

Deploying event-camera object detectors is constrained by per-frame labeling requirements and GPU compute demands. This work introduces three local spike-timing-dependent plasticity (STDP) modules, including sequence, candidate, and…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Mohamad Yazan Sadoun , Sarah Sharif , Yaser Mike Banad

The plasticity property of biological neural networks allows them to perform learning and optimize their behavior by changing their configuration. Inspired by biology, plasticity can be modeled in artificial neural networks by using Hebbian…

神经与进化计算 · 计算机科学 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

Artificial Spiking Neural Networks (ASNNs) promise greater information processing efficiency because of discrete event-based (i.e., spike) computation. Several Machine Learning (ML) applications use biologically inspired plasticity…

机器学习 · 计算机科学 2022-03-15 Mahima Milinda Alwis Weerasinghe , David Parry , Grace Wang , Jacqueline Whalley

We introduce a weight update formula that is expressed only in terms of firing rates and their derivatives and that results in changes consistent with those associated with spike-timing dependent plasticity (STDP) rules and biological…

神经与进化计算 · 计算机科学 2016-03-22 Yoshua Bengio , Thomas Mesnard , Asja Fischer , Saizheng Zhang , Yuhuai Wu

Parallels between the signal processing tasks and biological neurons lead to an understanding of the principles of self-organized optimization of input signal recognition. In the present paper, we discuss such similarities among biological…

神经元与认知 · 定量生物学 2021-08-03 Oleg Nikitin , Olga Lukyanova , Alex Kunin

This paper introduces a Spiking Diffusion Policy (SDP) learning method for robotic manipulation by integrating Spiking Neurons and Learnable Channel-wise Membrane Thresholds (LCMT) into the diffusion policy model, thereby enhancing…

机器人学 · 计算机科学 2024-09-18 Zhixing Hou , Maoxu Gao , Hang Yu , Mengyu Yang , Chio-In Ieong

Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in spiking neural networks (SNN) to extract visual features of low or intermediate complexity in an unsupervised manner. These studies, however, used…

计算机视觉与模式识别 · 计算机科学 2018-03-12 Saeed Reza Kheradpisheh , Mohammad Ganjtabesh , Simon J Thorpe , Timothée Masquelier

Neural Radiance Fields (NeRF)-based models have achieved remarkable success in 3D reconstruction and rendering tasks. However, during both training and inference, these models rely heavily on dense point sampling along rays from multiple…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Ranxi Lin , Canming Yao , Jiayi Li , Weihang Liu , Xin Lou , Pingqiang Zhou

Neuromorphic computing is a new paradigm for design of both the computing hardware and algorithms inspired by biological neural networks. The event-based nature and the inherent parallelism make neuromorphic computing a promising paradigm…

新兴技术 · 计算机科学 2019-07-10 Sebastian Glatz , Julien N. P. Martel , Raphaela Kreiser , Ning Qiao , Yulia Sandamirskaya

Memristive neural networks (MNNs), which use memristors as neurons or synapses, have become a hot research topic recently. However, most memristors are not compatible with mainstream integrated circuit technology and their stabilities in…

新兴技术 · 计算机科学 2019-01-03 Zhiri Tang , Ruohua Zhu , Peng Lin , Jin He , Hao Wang , Qijun Huang , Sheng Chang , Qiming Ma

Spiking Neural Network (SNN), as a brain-inspired approach, is attracting attention due to its potential to produce ultra-high-energy-efficient hardware. Competitive learning based on Spike-Timing-Dependent Plasticity (STDP) is a popular…

神经与进化计算 · 计算机科学 2020-10-20 Mingyuan Meng , Xingyu Yang , Shanlin Xiao , Zhiyi Yu

Policy learning for delicate industrial insertion tasks (e.g., PC board assembly) is challenging. This paper considers two major problems: how to learn a diversified policy (instead of just one average policy) that can efficiently handle…

机器人学 · 计算机科学 2023-03-06 Boshen Niu , Chenxi Wang , Changliu Liu

This paper presents an extension of the BrainScaleS accelerated analog neuromorphic hardware model. The scalable neuromorphic architecture is extended by the support for multi-compartment models and non-linear dendrites. These features are…

神经与进化计算 · 计算机科学 2017-03-22 Johannes Schemmel , Laura Kriener , Paul Müller , Karlheinz Meier

Spike-timing dependent plasticity in biological neural networks has been proven to be important during biological learning process. On the other hand, artificial neural networks use a different way to learn, such as Back-Propagation or…

神经与进化计算 · 计算机科学 2022-06-29 Shiyuan Li

Biological neurons can detect complex spatio-temporal features in spiking patterns via their synapses spread across across their dendritic branches. This is achieved by modulating the efficacy of the individual synapses, and by exploiting…

新兴技术 · 计算机科学 2023-12-15 Melika Payvand , Simone D'Agostino , Filippo Moro , Yigit Demirag , Giacomo Indiveri , Elisa Vianello

Working memory (WM) has been intensively used to enable the temporary storing of information for processing purposes, playing an important role in the execution of various cognitive tasks. Recent studies have shown that information in WM is…

神经元与认知 · 定量生物学 2022-05-19 Thi Kim Thoa Thieu , Roderick Melnik