English
Related papers

Related papers: Spatio-Temporal Recurrent Networks for Event-Based…

200 papers

Brain-inspired spiking neural networks (SNNs) have gained prominence in the field of neuromorphic computing owing to their low energy consumption during feedforward inference on neuromorphic hardware. However, it remains an open challenge…

Neural and Evolutionary Computing · Computer Science 2024-03-04 Wenjie Wei , Malu Zhang , Jilin Zhang , Ammar Belatreche , Jibin Wu , Zijing Xu , Xuerui Qiu , Hong Chen , Yang Yang , Haizhou Li

Event cameras are bio-inspired sensors that capture the per-pixel intensity changes asynchronously and produce event streams encoding the time, pixel position, and polarity (sign) of the intensity changes. Event cameras possess a myriad of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Xu Zheng , Yexin Liu , Yunfan Lu , Tongyan Hua , Tianbo Pan , Weiming Zhang , Dacheng Tao , Lin Wang

Event-based motion field estimation is an important task. However, current optical flow methods face challenges: learning-based approaches, often frame-based and relying on CNNs, lack cross-domain transferability, while model-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Dehao Yuan , Levi Burner , Jiayi Wu , Minghui Liu , Jingxi Chen , Yiannis Aloimonos , Cornelia Fermüller

Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-09-07 Wachirawit Ponghiran , Kaushik Roy

Traffic data exhibits complex temporal, spatial, and spatial-temporal correlations. Most of models use either independent modules to separately extract temporal and spatial correlations or joint modules to synchronously extract them,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Kai Hu , Zhidan Zhao , Zhifeng Hao

Although spatio-temporal graph neural networks have achieved great empirical success in handling multiple correlated time series, they may be impractical in some real-world scenarios due to a lack of sufficient high-quality training data.…

Signal Processing · Electrical Eng. & Systems 2021-02-10 Chao Pan , Siheng Chen , Antonio Ortega

Leveraging the high temporal resolution and dynamic range, object detection with event cameras can enhance the performance and safety of automotive and robotics applications in real-world scenarios. However, processing sparse event data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Shenqi Wang , Yingfu Xu , Amirreza Yousefzadeh , Sherif Eissa , Henk Corporaal , Federico Corradi , Guangzhi Tang

Event cameras are innovative neuromorphic sensors that asynchronously capture the scene dynamics. Due to the event-triggering mechanism, such cameras record event streams with much shorter response latency and higher intensity sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yunhao Zou , Ying Fu , Tsuyoshi Takatani , Yinqiang Zheng

Effective and Efficient spatio-temporal modeling is essential for action recognition. Existing methods suffer from the trade-off between model performance and model complexity. In this paper, we present a novel Spatio-Temporal Hybrid…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Xu Li , Jingwen Wang , Lin Ma , Kaihao Zhang , Fengzong Lian , Zhanhui Kang , Jinjun Wang

In this work, we propose a novel transformation for events from an event camera that is equivariant to optical flow under convolutions in the 3-D spatiotemporal domain. Events are generated by changes in the image, which are typically due…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Alex Zihao Zhu , Ziyun Wang , Kostas Daniilidis

In recent years, spiking neural networks (SNNs) have attracted substantial interest due to their potential to replicate the energy-efficient and event-driven processing of biological neurons. Despite this, the application of SNNs in graph…

Artificial Intelligence · Computer Science 2024-07-31 Mingkun Xu , Huifeng Yin , Yujie Wu , Guoqi Li , Faqiang Liu , Jing Pei , Shuai Zhong , Lei Deng

Event cameras are novel sensors that report brightness changes in the form of asynchronous "events" instead of intensity frames. They have significant advantages over conventional cameras: high temporal resolution, high dynamic range, and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Henri Rebecq , René Ranftl , Vladlen Koltun , Davide Scaramuzza

The event camera is a novel bio-inspired vision sensor. When the brightness change exceeds the preset threshold, the sensor generates events asynchronously. The number of valid events directly affects the performance of event-based tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Xijie Xiang , Lin Zhu , Jianing Li , Yonghong Tian , Tiejun Huang

This paper explores the promising interplay between spiking neural networks (SNNs) and event-based cameras for privacy-preserving human action recognition (HAR). The unique feature of event cameras in capturing only the outlines of motion,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Siyuan Yang , Shilin Lu , Shizheng Wang , Meng Hwa Er , Zengwei Zheng , Alex C. Kot

Spiking Neural Networks (SNNs) represent a biologically inspired paradigm offering an energy-efficient alternative to conventional artificial neural networks (ANNs) for Computer Vision (CV) applications. This paper presents a systematic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Craig Iaboni , Pramod Abichandani

Active vision enables dynamic visual perception, offering an alternative to static feedforward architectures in computer vision, which rely on large datasets and high computational resources. Biological selective attention mechanisms allow…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Giulia D'Angelo , Victoria Clerico , Chiara Bartolozzi , Matej Hoffmann , P. Michael Furlong , Alexander Hadjiivanov

Sound event localization frameworks based on deep neural networks have shown increased robustness with respect to reverberation and noise in comparison to classical parametric approaches. In particular, recurrent architectures that…

Recently, the recognition task of spontaneous facial micro-expressions has attracted much attention with its various real-world applications. Plenty of handcrafted or learned features have been employed for a variety of classifiers and…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Zhaoqiang Xia , Xiaopeng Hong , Xingyu Gao , Xiaoyi Feng , Guoying Zhao

We propose a novel deep structured learning framework for event temporal relation extraction. The model consists of 1) a recurrent neural network (RNN) to learn scoring functions for pair-wise relations, and 2) a structured support vector…

Computation and Language · Computer Science 2019-09-26 Rujun Han , I-Hung Hsu , Mu Yang , Aram Galstyan , Ralph Weischedel , Nanyun Peng

Recurrent Networks are one of the most powerful and promising artificial neural network algorithms to processing the sequential data such as natural languages, sound, time series data. Unlike traditional feed-forward network, Recurrent…

Machine Learning · Computer Science 2018-07-11 Pushparaja Murugan