English
Related papers

Related papers: S3CE-Net: Spike-guided Spatiotemporal Semantic Cou…

200 papers

Spiking neural networks (SNNs) have made great progress on both performance and efficiency over the last few years,but their unique working pattern makes it hard to train a high-performance low-latency SNN.Thus the development of SNNs still…

Neural and Evolutionary Computing · Computer Science 2022-11-22 Yudong Li , Yunlin Lei , Xu Yang

Deep Spiking Neural Networks (SNNs) present optimization difficulties for gradient-based approaches due to discrete binary activation and complex spatial-temporal dynamics. Considering the huge success of ResNet in deep learning, it would…

Neural and Evolutionary Computing · Computer Science 2022-01-25 Wei Fang , Zhaofei Yu , Yanqi Chen , Tiejun Huang , Timothée Masquelier , Yonghong Tian

We consider the problem of object recognition with a large number of classes. In order to overcome the low amount of labeled examples available in this setting, we introduce a new feature learning and extraction procedure based on a factor…

Machine Learning · Computer Science 2012-07-03 Ian Goodfellow , Aaron Courville , Yoshua Bengio

Spiking neural networks (SNNs) serve as one type of efficient model to process spatio-temporal patterns in time series, such as the Address-Event Representation data collected from Dynamic Vision Sensor (DVS). Although convolutional SNNs…

Neural and Evolutionary Computing · Computer Science 2024-01-09 Qi Xu , Yuyuan Gao , Jiangrong Shen , Yaxin Li , Xuming Ran , Huajin Tang , Gang Pan

Reconstructing a sequence of sharp images from the blurry input is crucial for enhancing our insights into the captured scene and poses a significant challenge due to the limited temporal features embedded in the image. Spike cameras,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Kang Chen , Shiyan Chen , Jiyuan Zhang , Baoyue Zhang , Yajing Zheng , Tiejun Huang , Zhaofei Yu

We focus on a very challenging task: imaging at nighttime dynamic scenes. Most previous methods rely on the low-light enhancement of a conventional RGB camera. However, they would inevitably face a dilemma between the long exposure time of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Haoyue Liu , Shihan Peng , Lin Zhu , Yi Chang , Hanyu Zhou , Luxin Yan

Semantic Change Detection (SCD) refers to the task of simultaneously extracting the changed areas and the semantic categories (before and after the changes) in Remote Sensing Images (RSIs). This is more meaningful than Binary Change…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Lei Ding , Jing Zhang , Kai Zhang , Haitao Guo , Bing Liu , Lorenzo Bruzzone

3D semantic scene understanding is a fundamental challenge in computer vision. It enables mobile agents to autonomously plan and navigate arbitrary environments. SSC formalizes this challenge as jointly estimating dense geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Adrian Hayler , Felix Wimbauer , Dominik Muhle , Christian Rupprecht , Daniel Cremers

In the era of AI at the edge, self-driving cars, and climate change, the need for energy-efficient, small, embedded AI is growing. Spiking Neural Networks (SNNs) are a promising approach to address this challenge, with their event-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Lennard Bodden , Franziska Schwaiger , Duc Bach Ha , Lars Kreuzberg , Sven Behnke

Bio-inspired Address Event Representation (AER) sensors have attracted significant popularity owing to their low power consumption, high sparsity, and high temporal resolution. Spiking Neural Network (SNN) has become the inherent choice for…

Neural and Evolutionary Computing · Computer Science 2024-02-16 Lakshmi Annamalai , Chetan Singh Thakur

Efficiently selecting an appropriate spike stream data length to extract precise information is the key to the spike vision tasks. To address this issue, we propose a dynamic timing representation for spike streams. Based on multi-layers…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lujie Xia , Ziluo Ding , Rui Zhao , Jiyuan Zhang , Lei Ma , Zhaofei Yu , Tiejun Huang , Ruiqin Xiong

Spiking Neural Networks (SNNs) demonstrate significant potential for energy-efficient neuromorphic computing through an event-driven paradigm. While training methods and computational models have greatly advanced, SNNs struggle to achieve…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Jieyuan Zhang , Xiaolong Zhou , Shuai Wang , Wenjie Wei , Hanwen Liu , Qian Sun , Malu Zhang , Yang Yang , Haizhou Li

Event cameras provide superior temporal resolution, dynamic range, power efficiency, and pixel bandwidth. Spiking Neural Networks (SNNs) naturally complement event data through discrete spike signals, making them ideal for event-based…

Humans naturally perform audiovisual speech recognition (AVSR), enhancing the accuracy and robustness by integrating auditory and visual information. Spiking neural networks (SNNs), which mimic the brain's information-processing mechanisms,…

Multimedia · Computer Science 2025-08-28 Qianhui Liu , Jiadong Wang , Yang Wang , Xin Yang , Gang Pan , Haizhou Li

Recently, there is growing demand for effective and efficient long sequence modeling, with State Space Models (SSMs) proving to be effective for long sequence tasks. To further reduce energy consumption, SSMs can be adapted to Spiking…

Neural and Evolutionary Computing · Computer Science 2024-10-31 Yulong Huang , Zunchang Liu , Changchun Feng , Xiaopeng Lin , Hongwei Ren , Haotian Fu , Yue Zhou , Hong Xing , Bojun Cheng

The intrinsic dynamics and event-driven nature of spiking neural networks (SNNs) make them excel in processing temporal information by naturally utilizing embedded time sequences as time steps. Recent studies adopting this approach have…

Machine Learning · Computer Science 2024-12-18 Jiaqi Wang , Liutao Yu , Liwei Huang , Chenlin Zhou , Han Zhang , Zhenxi Song , Min Zhang , Zhengyu Ma , Zhiguo Zhang

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data representations.…

Information Retrieval · Computer Science 2020-08-19 Kun Zhou , Hui Wang , Wayne Xin Zhao , Yutao Zhu , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen

Adverse weather conditions, particularly heavy snowfall, pose significant challenges to both human drivers and autonomous vehicles. Traditional image-based de-snowing methods often introduce hallucination artifacts as they rely solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Manasi Muglikar , Nico Messikommer , Marco Cannici , Davide Scaramuzza

The audio-visual event localization task requires identifying concurrent visual and auditory events from unconstrained videos within a network model, locating them, and classifying their category. The efficient extraction and integration of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiang He , Xiangxi Liu , Yang Li , Dongcheng Zhao , Guobin Shen , Qingqun Kong , Xin Yang , Yi Zeng

Video-based person re-identification (ReID) has become increasingly important due to its applications in video surveillance applications. By employing events in video-based person ReID, more motion information can be provided between…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Renkai Li , Xin Yuan , Wei Liu , Xin Xu