English
Related papers

Related papers: Enhancing Graph Representation Learning with Atten…

200 papers

Spiking neural networks (SNNs) are gaining increasing attention as potential computationally efficient alternatives to traditional artificial neural networks(ANNs). However, the unique information propagation mechanisms and the complexity…

Neural and Evolutionary Computing · Computer Science 2024-06-19 Shuaijie Shen , Rui Zhang , Chao Wang , Renzhuo Huang , Aiersi Tuerhong , Qinghai Guo , Zhichao Lu , Jianguo Zhang , Luziwei Leng

Spiking Neural Networks (SNNs) offer a biologically inspired alternative to conventional artificial neural networks, with potential advantages in power efficiency due to their event-driven computation. Despite their promise, SNNs have yet…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Wangdan Liao , Weidong Wang

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Shahriar Rezghi Shirsavar , Abdol-Hossein Vahabie , Mohammad-Reza A. Dehaqani

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Eike-Manuel Edelmann

To bridge the semantic gap between vision and language (VL), it is necessary to develop a good alignment strategy, which includes handling semantic diversity, abstract representation of visual information, and generalization ability of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Siyu Zhang , Wenzhe Liu , Yeming Chen , Yiming Wu , Heming Zheng , Cheng Cheng

Continuous graph neural networks (CGNNs) have garnered significant attention due to their ability to generalize existing discrete graph neural networks (GNNs) by introducing continuous dynamics. They typically draw inspiration from…

Neural and Evolutionary Computing · Computer Science 2025-07-15 Nan Yin , Mengzhu Wan , Li Shen , Hitesh Laxmichand Patel , Baopu Li , Bin Gu , Huan Xiong

While contrastive self-supervised learning has become the de-facto learning paradigm for graph neural networks, the pursuit of higher task accuracy requires a larger hidden dimensionality to learn informative and discriminative…

Neural and Evolutionary Computing · Computer Science 2024-02-20 Jintang Li , Huizhe Zhang , Ruofan Wu , Zulun Zhu , Baokun Wang , Changhua Meng , Zibin Zheng , Liang Chen

Spiking Neural Networks (SNNs) are biologically inspired machine learning models that build on dynamic neuronal models processing binary and sparse spiking signals in an event-driven, online, fashion. SNNs can be implemented on neuromorphic…

Neural and Evolutionary Computing · Computer Science 2020-12-10 Hyeryung Jang , Nicolas Skatchkovsky , Osvaldo Simeone

Spiking neural networks (SNNs) are emerging as a promising alternative to traditional artificial neural networks (ANNs), offering biological plausibility and energy efficiency. Despite these merits, SNNs are frequently hampered by limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Wenke Huang , Qiang Zhang , Tingting Zheng , Chia-Wen Lin , Liangpei Zhang

Spiking neural networks (SNNs) have captured apparent interest over the recent years, stemming from neuroscience and reaching the field of artificial intelligence. However, due to their nature SNNs remain far behind in achieving the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Katerina Maria Oikonomou , Vasiliki Balaska , Konstantinos A. Tsintotas , Christos N. Mavridis , Ioannis Kansizoglou , Antonios Gasteratos

Spiking Neural Networks (SNNs) have been recently integrated into Transformer architectures due to their potential to reduce computational demands and to improve power efficiency. Yet, the implementation of the attention mechanism using…

Hardware Architecture · Computer Science 2024-11-12 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

Transformers have demonstrated outstanding performance across a wide range of tasks, owing to their self-attention mechanism, but they are highly energy-consuming. Spiking Neural Networks have emerged as a promising energy-efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yufei Guo , Xiaode Liu , Yuanpei Chen , Weihang Peng , Yuhan Zhang , Zhe Ma

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Spiking Neural Networks (SNNs) represent a biologically inspired paradigm offering an energy-efficient alternative to conventional artificial neural networks (ANNs) for Computer Vision (CV) applications. This paper presents a systematic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Craig Iaboni , Pramod Abichandani

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Sales G. Aribe

Inspired by more detailed modeling of biological neurons, Spiking neural networks (SNNs) have been investigated both as more biologically plausible and potentially more powerful models of neural computation, and also with the aim of…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Bojian Yin , Federico Corradi , Sander M. Bohte

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that…

Machine Learning · Computer Science 2022-05-23 Davide Buffelli , Fabio Vandin

Benefiting from the event-driven and sparse spiking characteristics of the brain, spiking neural networks (SNNs) are becoming an energy-efficient alternative to artificial neural networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Man Yao , Guangshe Zhao , Hengyu Zhang , Yifan Hu , Lei Deng , Yonghong Tian , Bo Xu , Guoqi Li

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak