English
Related papers

Related papers: Event-Enhanced Multi-Modal Spiking Neural Network …

200 papers

Benefiting from the event-driven and sparse spiking characteristics of the brain, spiking neural networks (SNNs) are becoming an energy-efficient alternative to artificial neural networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Man Yao , Guangshe Zhao , Hengyu Zhang , Yifan Hu , Lei Deng , Yonghong Tian , Bo Xu , Guoqi Li

We introduce a novel multimodality synergistic knowledge distillation scheme tailored for efficient single-eye motion recognition tasks. This method allows a lightweight, unimodal student spiking neural network (SNN) to extract rich…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yang Wang , Haiyang Mei , Qirui Bao , Ziqi Wei , Mike Zheng Shou , Haizhou Li , Bo Dong , Xin Yang

Spiking Neural Networks (SNNs) are a biologically plausible neural network model with significant advantages in both event-driven processing and spatio-temporal information processing, rendering SNNs an appealing choice for energyefficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jilong Luo , Shanlin Xiao , Yinsheng Chen , Zhiyi Yu

Speech enhancement (SE) improves communication in noisy environments, affecting areas such as automatic speech recognition, hearing aids, and telecommunications. With these domains typically being power-constrained and event-based while…

Sound · Computer Science 2024-08-15 Tao Sun , Sander Bohté

Deep reinforcement learning (DRL) finds extensive application in autonomous drone navigation within complex, high-risk environments. However, its practical deployment faces a safety-exploration dilemma: soft penalty mechanisms encourage…

Robotics · Computer Science 2026-05-04 Wentao Chen , Jingtang Chen , Mingjian Fu , Tiantian Li , Youfeng Su , Wenxi Liu , Yuanlong Yu

Bio-inspired Address Event Representation (AER) sensors have attracted significant popularity owing to their low power consumption, high sparsity, and high temporal resolution. Spiking Neural Network (SNN) has become the inherent choice for…

Neural and Evolutionary Computing · Computer Science 2024-02-16 Lakshmi Annamalai , Chetan Singh Thakur

The integration of Spiking Neural Networks (SNNs) and Graph Neural Networks (GNNs) is gradually attracting attention due to the low power consumption and high efficiency in processing the non-Euclidean data represented by graphs. However,…

Neural and Evolutionary Computing · Computer Science 2025-07-15 Nan Yin , Mengzhu Wang , Zhenghan Chen , Giulia De Masi , Bin Gu , Huan Xiong

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking Neural Networks (SNNs) have recently attracted widespread research interest as an efficient alternative to traditional Artificial Neural Networks (ANNs) because of their capability to process sparse and binary spike information and…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Yuhang Li , Abhishek Moitra , Tamar Geller , Priyadarshini Panda

Deep reinforcement learning (DRL) provides a promising way for intelligent agents (e.g., autonomous vehicles) to learn to navigate complex scenarios. However, DRL with neural networks as function approximators is typically considered a…

Robotics · Computer Science 2023-11-28 Jiachen Li , David Isele , Kanghoon Lee , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely faster data rate,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yi Tian , Juan Andrade-Cetto

Event cameras are bio-inspired vision sensors that naturally capture the dynamics of a scene, filtering out redundant information. This paper presents a deep neural network approach that unlocks the potential of event cameras on a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Ana I. Maqueda , Antonio Loquercio , Guillermo Gallego , Narciso Garcia , Davide Scaramuzza

As the foundation of driverless vehicle and intelligent robots, Simultaneous Localization and Mapping(SLAM) has attracted much attention these days. However, non-geometric modules of traditional SLAM algorithms are limited by data…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Rong Kang , Jieqi Shi , Xueming Li , Yang Liu , Xiao Liu

Semantic segmentation is a crucial component for perception in automated driving. Deep neural networks (DNNs) are commonly used for this task and they are usually trained on a closed set of object classes appearing in a closed operational…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Robin Chan , Svenja Uhlemeyer , Matthias Rottmann , Hanno Gottschalk

Recent advances in event-based shape determination from polarization offer a transformative approach that tackles the trade-off between speed and accuracy in capturing surface geometries. In this paper, we investigate event-based shape from…

Neural and Evolutionary Computing · Computer Science 2023-12-27 Peng Kang , Srutarshi Banerjee , Henry Chopp , Aggelos Katsaggelos , Oliver Cossairt

Obstacle Detection is a central problem for any robotic system, and critical for autonomous systems that travel at high speeds in unpredictable environment. This is often achieved through scene depth estimation, by various means. When fast…

Robotics · Computer Science 2016-07-22 Michele Mancini , Gabriele Costante , Paolo Valigi , Thomas A. Ciarfuglia

Optical neural networks (ONNs) perform extensive computations using photons instead of electrons, resulting in passively energy-efficient and low-latency computing. Among various ONNs, the diffractive optical neural networks (DONNs)…

Spiking Neural Networks (SNNs) have emerged as a promising alternative to conventional Artificial Neural Networks (ANNs), demonstrating comparable performance in both visual and linguistic tasks while offering the advantage of improved…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Changze Lv , Tianlong Li , Wenhao Liu , Yufei Gu , Jianhan Xu , Cenyuan Zhang , Muling Wu , Xiaoqing Zheng , Xuanjing Huang

Autonomous embedded systems (e.g., robots) typically necessitate intelligent computation with low power/energy processing for completing their tasks. Such requirements can be fulfilled by embodied neuromorphic intelligence with spiking…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Iqra Bano , Rachmad Vidya Wicaksana Putra , Alberto Marchisio , Muhammad Shafique

Spiking neural networks (SNNs) offer both compelling potential advantages, including energy efficiency and low latencies and challenges including the non-differentiable nature of event spikes. Much of the initial research in this area has…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Somayeh Hussaini , Michael Milford , Tobias Fischer