English
Related papers

Related papers: Learning binary or real-valued time-series via spi…

200 papers

Spike-Timing-Dependent Plasticity (STDP) provides a biologically grounded learning rule for spiking neural networks (SNNs), but its reliance on precise spike timing and pairwise updates limits fast learning of weights. We introduce a…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Gouri Lakshmi S , Athira Chandrasekharan , Harshit Kumar , Muhammed Sahad E , Bikas C Das , Saptarshi Bej

Recent biological experimental findings have shown that synaptic plasticity depends on the relative timing of pre- and post-synaptic spikes and this is called spike-timing-dependent plasticity (STDP). Many authors have claimed that a…

Disordered Systems and Neural Networks · Physics 2007-05-23 Narihisa Matsumoto , Masato Okada

We derive a synaptic weight update rule for learning temporally precise spike train to spike train transformations in multilayer feedforward networks of spiking neurons. The framework, aimed at seamlessly generalizing error backpropagation…

Neural and Evolutionary Computing · Computer Science 2016-01-11 Arunava Banerjee

Using precise times of every spike, spiking supervised learning has more effects on complex spatial-temporal pattern than supervised learning only through neuronal firing rates. The purpose of spiking supervised learning after…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Guojun Chen , Xianghong Lin , Guoen Wang

This paper introduces a Spiking Diffusion Policy (SDP) learning method for robotic manipulation by integrating Spiking Neurons and Learnable Channel-wise Membrane Thresholds (LCMT) into the diffusion policy model, thereby enhancing…

Robotics · Computer Science 2024-09-18 Zhixing Hou , Maoxu Gao , Hang Yu , Mengyu Yang , Chio-In Ieong

We describe a novel method for modeling non-stationary multivariate time series, with time-varying conditional dependencies represented through dynamic networks. Our proposed approach combines traditional multi-scale modeling and network…

Methodology · Statistics 2017-12-25 Xinyu Kang , Apratim Ganguly , Eric D. Kolaczyk

End user AI is trained on large server farms with data collected from the users. With ever increasing demand for IOT devices, there is a need for deep learning approaches that can be implemented (at the edge) in an energy efficient manner.…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Ruthvik Vaila , John Chiasson , Vishal Saxena

In this article we intoduce a novel stochastic Hebb-like learning rule for neural networks that is neurobiologically motivated. This learning rule combines features of unsupervised (Hebbian) and supervised (reinforcement) learning and is…

Disordered Systems and Neural Networks · Physics 2009-11-11 Frank Emmert-Streib

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

We review Boltzmann machines and energy-based models. A Boltzmann machine defines a probability distribution over binary-valued patterns. One can learn parameters of a Boltzmann machine via gradient based approaches in a way that log…

Neural and Evolutionary Computing · Computer Science 2019-01-21 Takayuki Osogami

Learning to produce spatiotemporal sequences is a common task that the brain has to solve. The same neural substrate may be used by the brain to produce different sequential behaviours. The way the brain learns and encodes such tasks…

Neurons and Cognition · Quantitative Biology 2020-07-01 Amadeus Maes , Mauricio Barahona , Claudia Clopath

This work proposes an algorithmic framework to learn time-varying graphs from online data. The generality offered by the framework renders it model-independent, i.e., it can be theoretically analyzed in its abstract formulation and then…

Machine Learning · Computer Science 2022-05-25 Alberto Natali , Elvin Isufi , Mario Coutino , Geert Leus

The Dirichlet Belief Network~(DirBN) has been recently proposed as a promising approach in learning interpretable deep latent representations for objects. In this work, we leverage its interpretable modelling architecture and propose a deep…

Machine Learning · Computer Science 2020-04-30 Yaqiong Li , Xuhui Fan , Ling Chen , Bin Li , Zheng Yu , Scott A. Sisson

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by the goal of…

Neural and Evolutionary Computing · Computer Science 2022-11-02 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

Learning continuous-time stochastic dynamics is a fundamental and essential problem in modeling sporadic time series, whose observations are irregular and sparse in both time and dimension. For a given system whose latent states and…

Machine Learning · Computer Science 2021-04-30 Yingru Liu , Yucheng Xing , Xuewen Yang , Xin Wang , Jing Shi , Di Jin , Zhaoyue Chen

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

Machine Learning · Computer Science 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter

Video analysis is a computer vision task that is useful for many applications like surveillance, human-machine interaction, and autonomous vehicles. Deep Convolutional Neural Networks (CNNs) are currently the state-of-the-art methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mireille El-Assal , Pierre Tirilly , Ioan Marius Bilasco

We introduce a weight update formula that is expressed only in terms of firing rates and their derivatives and that results in changes consistent with those associated with spike-timing dependent plasticity (STDP) rules and biological…

Neural and Evolutionary Computing · Computer Science 2016-03-22 Yoshua Bengio , Thomas Mesnard , Asja Fischer , Saizheng Zhang , Yuhuai Wu

Artificial Neural Network (ANN)-based inference on battery-powered devices can be made more energy-efficient by restricting the synaptic weights to be binary, hence eliminating the need to perform multiplications. An alternative, emerging,…

Machine Learning · Computer Science 2020-12-16 Hyeryung Jang , Nicolas Skatchkovsky , Osvaldo Simeone

We develop methods to learn the correlation potential for a time-dependent Kohn-Sham (TDKS) system in one spatial dimension. We start from a low-dimensional two-electron system for which we can numerically solve the time-dependent…

Machine Learning · Statistics 2022-12-08 Harish S. Bhat , Kevin Collins , Prachi Gupta , Christine M. Isborn