English
Related papers

Related papers: Enhancing Audio-Visual Spiking Neural Networks thr…

200 papers

Spiking neural networks (SNNs) are powerful models of spatiotemporal computation and are well suited for deployment on resource-constrained edge devices and neuromorphic hardware due to their low power consumption. Leveraging attention…

Neural and Evolutionary Computing · Computer Science 2024-11-13 Boxun Xu , Junyoung Hwang , Pruek Vanna-iampikul , Sung Kyu Lim , Peng Li

Large-scale pre-trained Vision-Language Models (VLMs) have become essential for transfer learning across diverse tasks. However, adapting these models with limited few-shot data often leads to overfitting, diminishing their performance on…

Machine Learning · Computer Science 2025-03-27 Yuncheng Guo , Xiaodong Gu

Spiking recurrent neural networks (RNNs) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing. However training spiking RNNs on dedicated…

Neural and Evolutionary Computing · Computer Science 2021-09-28 Yigit Demirag , Charlotte Frenkel , Melika Payvand , Giacomo Indiveri

Spiking Neural Networks (SNN) are the so-called third generation of neural networks which attempt to more closely match the functioning of the biological brain. They inherently encode temporal data, allowing for training with less energy…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Chethan M. Parameshwara , Simin Li , Cornelia Fermüller , Nitin J. Sanket , Matthew S. Evanusa , Yiannis Aloimonos

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Computation on a large volume of data at high speed and low power requires energy-efficient computing architectures. Spiking neural network (SNN) with bio-inspired spike-timing-dependent plasticity learning (STDP) is a promising solution…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Sahibia Kaur Vohra , Sherin A Thomas , Mahendra Sakare , Devarshi Mrinal Das

Spiking neural network (SNN) is a biologically-plausible model and exhibits advantages of high computational capability and low power consumption. While the training of deep SNN is still an open problem, which limits the real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shuiying Xiang , Tao Zhang , Shuqing Jiang , Yanan Han , Yahui Zhang , Chenyang Du , Xingxing Guo , Licun Yu , Yuechun Shi , Yue Hao

Spiking Neural Networks (SNNs) are gaining interest due to their event-driven processing which potentially consumes low power/energy computations in hardware platforms, while offering unsupervised learning capability due to the…

Neural and Evolutionary Computing · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Cross-modal learning has become a fundamental paradigm for integrating heterogeneous information sources such as images, text, and structured attributes. However, multimodal representations often suffer from modality dominance, redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuecheng Li , Weikuan Jia , Alisher Kurbonaliev , Qurbonaliev Alisher , Khudzhamkulov Rustam , Ismoilov Shuhratjon , Eshmatov Javhariddin , Yuanjie Zheng

Structural magnetic resonance imaging (sMRI) has shown great clinical value and has been widely used in deep learning (DL) based computer-aided brain disease diagnosis. Previous approaches focused on local shapes and textures in sMRI that…

Image and Video Processing · Electrical Eng. & Systems 2023-06-09 Gongshu Wang , Ning Jiang , Yunxiao Ma , Tiantian Liu , Duanduan Chen , Jinglong Wu , Guoqi Li , Dong Liang , Tianyi Yan

Cross-modal alignment is essential for vision-language pre-training (VLP) models to learn the correct corresponding information across different modalities. For this purpose, inspired by the success of masked language modeling (MLM) tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yatai Ji , Rongcheng Tu , Jie Jiang , Weijie Kong , Chengfei Cai , Wenzhe Zhao , Hongfa Wang , Yujiu Yang , Wei Liu

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Eike-Manuel Edelmann

Neuromorphic computing is an emerging technology enabling low-latency and energy-efficient signal processing. A key algorithmic tool in neuromorphic computing is spiking neural networks (SNNs). SNNs are biologically inspired neural networks…

Machine Learning · Computer Science 2025-08-11 Sanja Karilanova , Subhrakanti Dey , Ayça Özçelikkale

Network architectures and learning principles are key in forming complex functions in artificial neural networks (ANNs) and spiking neural networks (SNNs). SNNs are considered the new-generation artificial networks by incorporating more…

Neural and Evolutionary Computing · Computer Science 2022-02-15 Shuncheng Jia , Ruichen Zuo , Tielin Zhang , Hongxing Liu , Bo Xu

In Collaborative Intelligence (CI), the Artificial Intelligence (AI) model is divided between the edge and the cloud, with intermediate features being sent from the edge to the cloud for inference. Several deep learning-based Semantic…

Signal Processing · Electrical Eng. & Systems 2023-10-16 Mengyang Wang , Jiahui Li , Mengyao Ma , Xiaopeng Fan

Spiking neural networks (SNNs) have garnered interest due to their energy efficiency and superior effectiveness on neuromorphic chips compared with traditional artificial neural networks (ANNs). One of the mainstream approaches to…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Zhipeng Huang , Jianhao Ding , Zhiyu Pan , Haoran Li , Ying Fang , Zhaofei Yu , Jian K. Liu

Despite the recent success of deep learning in continuous sign language recognition (CSLR), deep models typically focus on the most discriminative features, ignoring other potentially non-trivial and informative contents. Such…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Hao Zhou , Wengang Zhou , Yun Zhou , Houqiang Li

Spiking Neural Networks (SNNs) demonstrate significant potential for energy-efficient neuromorphic computing through an event-driven paradigm. While training methods and computational models have greatly advanced, SNNs struggle to achieve…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Jieyuan Zhang , Xiaolong Zhou , Shuai Wang , Wenjie Wei , Hanwen Liu , Qian Sun , Malu Zhang , Yang Yang , Haizhou Li

Integrating autonomous mobile robots into human environments requires human-like decision-making and energy-efficient, event-based computation. Despite progress, neuromorphic methods are rarely applied to Deep Reinforcement Learning (DRL)…

Spiking neural networks (SNNs) exhibit temporal, sparse, and event-driven dynamics that make them appealing for efficient inference. However, extending these models to self-supervised regimes remains challenging because the discontinuities…

Emerging Technologies · Computer Science 2025-11-25 Chengwei Zhou , Gourav Datta