English
Related papers

Related papers: MC-QDSNN: Quantized Deep evolutionary SNN with Mul…

200 papers

In this study, we propose an ensemble long short-term memory (EnLSTM) network, which can be trained on a small dataset and process sequential data. The EnLSTM is built by combining the ensemble neural network (ENN) and the cascaded long…

Signal Processing · Electrical Eng. & Systems 2020-12-15 Yuntian Chen , Dongxiao Zhang

Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), and Memory Networks which contain memory are popularly used to learn patterns in sequential data. Sequential data has long sequences that hold relationships. RNN can…

Computation and Language · Computer Science 2019-04-22 Anupiya Nugaliyadde , Kok Wai Wong , Ferdous Sohel , Hong Xie

Spiking Neural Networks (SNNs) are capable of encoding and processing temporal information in a biologically plausible way. However, most existing SNN-based methods for image tasks do not fully exploit this feature. Moreover, they often…

Neural and Evolutionary Computing · Computer Science 2024-06-06 Xuerui Qiu , Zheng Luan , Zhaorui Wang , Rui-Jie Zhu

Spike train classification has recently become an important topic in the machine learning community, where each spike train is a binary event sequence with \emph{temporal-sparsity of signals of interest} and \emph{temporal-noise}…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Hang Yin , Yao Su , Liping Liu , Thomas Hartvigsen , Xin Dai , Xiangnan Kong

Spiking Neural Networks (SNNs), models inspired by neural mechanisms in the brain, allow for energy-efficient implementation on neuromorphic hardware. However, SNNs trained with current direct training approaches are constrained to a…

Machine Learning · Computer Science 2025-03-25 Kangrui Du , Yuhang Wu , Shikuang Deng , Shi Gu

This letter adopts long short-term memory(LSTM) to predict sea surface temperature(SST), which is the first attempt, to our knowledge, to use recurrent neural network to solve the problem of SST prediction, and to make one week and one…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Qin Zhang , Hui Wang , Junyu Dong , Guoqiang Zhong , Xin Sun

Recurrent neural networks (RNNs) have been applied to a broad range of applications, including natural language processing, drug discovery, and video recognition. Their vulnerability to input perturbation is also known. Aligning with a view…

Machine Learning · Computer Science 2021-05-14 Wei Huang , Youcheng Sun , Xingyu Zhao , James Sharp , Wenjie Ruan , Jie Meng , Xiaowei Huang

Recurrent neural networks (RNN) are at the core of modern automatic speech recognition (ASR) systems. In particular, long-short term memory (LSTM) recurrent neural networks have achieved state-of-the-art results in many speech recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Titouan Parcollet , Mohamed Morchid , Georges Linarès , Renato De Mori

In this article, we introduce a new nanoscale electromechanical device -- a leaky memcapacitor -- and show that it may be useful for the hardware implementation of spiking neurons. The leaky memcapacitor is a movable-plate capacitor that…

Emerging Technologies · Computer Science 2024-03-05 Zixi Zhang , Yuriy V. Pershin , Ivar Martin

For the weakly supervised task of electrocardiogram (ECG) rhythm classification, convolutional neural networks (CNNs) and long short-term memory (LSTM) networks are two increasingly popular classification models. This work investigates…

Machine Learning · Computer Science 2019-12-03 Nora Vogt

There is extensive evidence that biological neural networks encode information in the precise timing of the spikes generated and transmitted by neurons, which offers several advantages over rate-based codes. Here we adopt a vector space…

Neurons and Cognition · Quantitative Biology 2019-07-16 Dorian Florescu , Daniel Coca

The increasing complexity and energy demands of large-scale neural networks, such as Deep Neural Networks (DNNs) and Large Language Models (LLMs), challenge their practical deployment in edge applications due to high power consumption, area…

Neural and Evolutionary Computing · Computer Science 2026-05-18 Ckristian Duran , Nanako Kimura , Zolboo Byambadorj , Tetsuya Iizuka

This work presents a Long Short-Term Memory (LSTM) network for forecasting a monthly electricity demand time series with a one-year horizon. The novelty of this work is the use of pattern representation of the seasonal time series as an…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Paweł Pełka , Grzegorz Dudek

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

Machine Learning · Computer Science 2020-11-03 Frank Xiao

Magnetoencephalography (MEG) and Electroencephalography (EEG) source estimates have thus far mostly been derived sample by sample, i.e., independent of each other in time. However, neuronal assemblies are heavily interconnected,…

Quantitative Methods · Quantitative Biology 2019-09-09 Christoph Dinh , John GW Samuelsson , Alexander Hunold , Matti S Hämäläinen , Sheraz Khan

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

Epileptic seizures are caused by abnormal, overly syn- chronized, electrical activity in the brain. The abnor- mal electrical activity manifests as waves, propagating across the brain. Accurate prediction of the propagation velocity and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Yilin Song , Jonathan Viventi , Yao Wang

Spintronic devices, such as the domain walls and skyrmions, have shown significant potential for applications in energy-efficient data storage and beyond CMOS computing architectures. In recent years, spiking neural networks have shown more…

Spiking Neural Networks (SNNs) have received considerable attention not only for their superiority in energy efficiency with discrete signal processing but also for their natural suitability to integrate multi-scale biological plasticity.…

Neural and Evolutionary Computing · Computer Science 2023-11-08 Wenxuan Pan , Feifei Zhao , Guobin Shen , Yi Zeng

5G networks provide more bandwidth and more complex control to enhance user's experiences, while also requiring a more accurate estimation of the communication channels compared with previous mobile networks. In this paper, we propose a…

Networking and Internet Architecture · Computer Science 2020-08-04 Hao Yin , Xiaojun Guo , Pengyu Liu , Xiaojun Hei , Yayu Gao