English
Related papers

Related papers: Gated Attention Coding for Training High-performan…

200 papers

Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event-driven computation mechanism and replacement of energy-consuming weight multiplications with…

Neural and Evolutionary Computing · Computer Science 2023-11-03 Zhehui Wang , Xiaozhe Gu , Rick Goh , Joey Tianyi Zhou , Tao Luo

Autonomous driving demands an integrated approach that encompasses perception, prediction, and planning, all while operating under strict energy constraints to enhance scalability and environmental sustainability. We present Spiking…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Rui-Jie Zhu , Ziqing Wang , Leilani Gilpin , Jason K. Eshraghian

Bio-inspired spiking neural networks (SNNs), operating with asynchronous binary signals (or spikes) distributed over time, can potentially lead to greater computational efficiency on event-driven hardware. The state-of-the-art SNNs suffer…

Neural and Evolutionary Computing · Computer Science 2020-12-03 Nitin Rathi , Kaushik Roy

Attention improves representation learning over RNNs, but its discrete nature limits continuous-time (CT) modeling. We introduce Neuronal Attention Circuit (NAC), a novel, biologically inspired CT-Attention mechanism that reformulates…

Artificial Intelligence · Computer Science 2026-01-07 Waleed Razzaq , Izis Kanjaraway , Yun-Bo Zhao

Recently, Graph Transformers have emerged as a promising solution to alleviate the inherent limitations of Graph Neural Networks (GNNs) and enhance graph representation performance. Unfortunately, Graph Transformers are computationally…

Neural and Evolutionary Computing · Computer Science 2024-03-26 Yundong Sun , Dongjie Zhu , Yansong Wang , Zhaoshuo Tian , Ning Cao , Gregory O'Hared

Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements…

Neural and Evolutionary Computing · Computer Science 2024-04-25 Lang Qin , Ziming Wang , Runhao Jiang , Rui Yan , Huajin Tang

Spiking neural networks (SNNs) are investigated as biologically inspired models of neural computation, distinguished by their computational capability and energy efficiency due to precise spiking times and sparse spikes with event-driven…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Mingqing Xiao , Yixin Zhu , Di He , Zhouchen Lin

Graph Transformers (GTs), which integrate message passing and self-attention mechanisms simultaneously, have achieved promising empirical results in graph prediction tasks. However, the design of scalable and topology-aware node…

Neural and Evolutionary Computing · Computer Science 2025-12-12 Huizhe Zhang , Jintang Li , Yuchang Zhu , Huazhen Zhong , Liang Chen

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

Spiking Neural Networks (SNNs) offer potential advantages in energy efficiency but currently trail Artificial Neural Networks (ANNs) in versatility, largely due to challenges in efficient input encoding. Recent work shows that direct coding…

Hardware Architecture · Computer Science 2024-11-26 Ilkin Aliyev , Jesus Lopez , Tosiron Adegbija

Spiking Neural Networks (SNNs), as a biologically plausible alternative to Artificial Neural Networks (ANNs), have demonstrated advantages in terms of energy efficiency, temporal processing, and biological plausibility. However, SNNs are…

Machine Learning · Computer Science 2025-09-22 Xinyu Luo , Kecheng Chen , Pao-Sheng Vincent Sun , Chris Xing Tian , Arindam Basu , Haoliang Li

In recent years, Deep Convolutional Neural Networks (DCNNs) have outreached the performance of classical algorithms for image restoration tasks. However most of these methods are not suited for computational efficiency and are therefore too…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Spiking Neural Networks (SNNs) present a more energy-efficient alternative to Artificial Neural Networks (ANNs) by harnessing spatio-temporal dynamics and event-driven spikes. Effective utilization of temporal information is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Minje Kim , Minjun Kim , Xu Yang

Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct…

Neural and Evolutionary Computing · Computer Science 2024-07-12 Chenlin Zhou , Han Zhang , Liutao Yu , Yumin Ye , Zhaokun Zhou , Liwei Huang , Zhengyu Ma , Xiaopeng Fan , Huihui Zhou , Yonghong Tian

Spiking Neural Networks (SNNs) have emerged as a promising third generation of neural networks, offering unique characteristics such as binary outputs, high sparsity, and biological plausibility. However, the lack of effective learning…

Neural and Evolutionary Computing · Computer Science 2024-03-01 Liuzhenghao Lv , Wei Fang , Li Yuan , Yonghong Tian

Speech enhancement (SE) is crucial for reliable communication devices or robust speech recognition systems. Although conventional artificial neural networks (ANN) have demonstrated remarkable performance in SE, they require significant…

Sound · Computer Science 2023-07-28 Abir Riahi , Éric Plourde

Spiking neural networks (SNNs) that enables energy efficient implementation on emerging neuromorphic hardware are gaining more attention. Yet now, SNNs have not shown competitive performance compared with artificial neural networks (ANNs),…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

Spiking Neural Networks (SNN) exhibit higher energy efficiency compared to Artificial Neural Networks (ANN) due to their unique spike-driven mechanism. Additionally, SNN possess a crucial characteristic, namely the ability to process…

Neural and Evolutionary Computing · Computer Science 2025-04-02 Huaxu He

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

This work presents a novel spiking neural network (SNN) decoding method, combining SNNs with Hyperdimensional computing (HDC). The goal is to create a decoding method with high accuracy, high noise robustness, low latency and low energy…

Artificial Intelligence · Computer Science 2026-04-24 Cedrick Kinavuidi , Luca Peres , Oliver Rhodes