English
Related papers

Related papers: SNN-Driven Multimodal Human Action Recognition via…

200 papers

Skeleton Action Recognition (SAR) involves identifying human actions using skeletal joint coordinates and their interconnections. While plain Transformers have been attempted for this task, they still fall short compared to the current…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Soumyabrata Chaudhuri , Saumik Bhattacharya

This work proposes an end-to-end multi-modal reinforcement learning framework for high-level decision-making in autonomous vehicles. The framework integrates heterogeneous sensory input, including camera images, LiDAR point clouds, and…

Machine Learning · Computer Science 2025-12-02 Aref Ghoreishee , Abhishek Mishra , Lifeng Zhou , John Walsh , Nagarajan Kandasamy

Detecting human actions is a crucial task for autonomous robots and vehicles, often requiring the integration of various data modalities for improved accuracy. In this study, we introduce a novel approach to Human Action Recognition (HAR)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Mohammad Mahdavian , Mohammad Loni , Ted Samuelsson , Mo Chen

Spiking neural networks (SNNs) have captured apparent interest over the recent years, stemming from neuroscience and reaching the field of artificial intelligence. However, due to their nature SNNs remain far behind in achieving the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Katerina Maria Oikonomou , Vasiliki Balaska , Konstantinos A. Tsintotas , Christos N. Mavridis , Ioannis Kansizoglou , Antonios Gasteratos

Human activity recognition (HAR) from inertial sensors is essential for ubiquitous computing, mobile health, and ambient intelligence. Conventional deep models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs),…

Human-Computer Interaction · Computer Science 2025-11-27 Thai-Khanh Nguyen , Uyen Vo , Tan M. Nguyen , Thieu N. Vo , Trung-Hieu Le , Cuong Pham

Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from…

Hardware Architecture · Computer Science 2023-12-05 Souvik Kundu , Rui-Jie Zhu , Akhilesh Jaiswal , Peter A. Beerel

Over the past few years, Spiking Neural Networks (SNNs) have become popular as a possible pathway to enable low-power event-driven neuromorphic hardware. However, their application in machine learning have largely been limited to very…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Abhronil Sengupta , Yuting Ye , Robert Wang , Chiao Liu , Kaushik Roy

In this work, we have proposed a revolutionary neuromorphic computing methodology to implement All-Skyrmion Spiking Neural Network (AS-SNN). Such proposed methodology is based on our finding that skyrmion is a topological stable spin…

Neural and Evolutionary Computing · Computer Science 2017-05-09 Zhezhi He , Deliang Fan

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li

The event streams generated by dynamic vision sensors (DVS) are sparse and non-uniform in the spatial domain, while still dense and redundant in the temporal domain. Although spiking neural network (SNN), the event-driven neuromorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yuan Zhang , Jian Cao , Ling Zhang , Jue Chen , Wenyu Sun , Yuan Wang

Spiking Neural Network (SNN), as a brain-inspired and energy-efficient network, is currently facing the pivotal challenge of exploring a suitable and efficient learning framework. The predominant training methodologies, namely…

Neural and Evolutionary Computing · Computer Science 2025-05-27 Zecheng Hao , Qichao Ma , Kang Chen , Yi Zhang , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically…

Neural and Evolutionary Computing · Computer Science 2025-10-29 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Speech Emotion Recognition (SER) is widely deployed in Human-Computer Interaction, yet the high computational cost of conventional models hinders their implementation on resource-constrained edge devices. Spiking Neural Networks (SNNs)…

Artificial Intelligence · Computer Science 2026-02-10 Xun Su , Huamin Wang , Qi Zhang

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to…

Neurons and Cognition · Quantitative Biology 2022-12-02 Melani Sanchez-Garcia , Tushar Chauhan , Benoit R. Cottereau , Michael Beyeler

Neuromorphic computing mimics computational principles of the brain in $\textit{silico}$ and motivates research into event-based vision and spiking neural networks (SNNs). Event cameras (ECs) exclusively capture local intensity changes and…

Robotics · Computer Science 2024-04-10 Ahmed Faisal Abdelrahman , Matias Valdenegro-Toro , Maren Bennewitz , Paul G. Plöger

Spiking Neural Networks (SNNs), models inspired by neural mechanisms in the brain, allow for energy-efficient implementation on neuromorphic hardware. However, SNNs trained with current direct training approaches are constrained to a…

Machine Learning · Computer Science 2025-03-25 Kangrui Du , Yuhang Wu , Shikuang Deng , Shi Gu

Spiking neural network (SNN) is studied in multidisciplinary domains to (i) enable order-of-magnitudes energy-efficient AI inference and (ii) computationally simulate neuro-scientific mechanisms. The lack of discrete theory obstructs the…

Neural and Evolutionary Computing · Computer Science 2024-07-03 Hyunseok Oh , Youngki Lee

Spiking Neural Networks (SNNs) hold great potential to realize brain-inspired, energy-efficient computational systems. However, current SNNs still fall short in terms of multi-scale temporal processing compared to their biological…

Neural and Evolutionary Computing · Computer Science 2024-08-28 Xinyi Chen , Jibin Wu , Chenxiang Ma , Yinsong Yan , Yujie Wu , Kay Chen Tan

Spiking neural networks (SNNs) promise low-power event-driven computation for temporally rich tasks, but commonly used neuron models often trade off gradient-based trainability, dynamical richness, and high activity sparsity. These…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Alex Fulleda-Garcia , Saray Soldado-Magraner , Josep Maria Margarit-Taulé

Facial Expression Recognition (FER) is an active research domain that has shown great progress recently, notably thanks to the use of large deep learning models. However, such approaches are particularly energy intensive, which makes their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Sami Barchid , Benjamin Allaert , Amel Aissaoui , José Mennesson , Chaabane Djéraba