English
Related papers

Related papers: Context-aware Sparse Spatiotemporal Learning for E…

200 papers

Event cameras offer unparalleled advantages such as high temporal resolution, low latency, and high dynamic range. However, their limited spatial resolution poses challenges for fine-grained perception tasks. In this work, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chuanzhi Xu , Haoxian Zhou , Langyi Chen , Yuk Ying Chung , Qiang Qu

Event-based cameras offer much potential to the fields of robotics and computer vision, in part due to their large dynamic range and extremely high "frame rates". These attributes make them, at least in theory, particularly suitable for…

Neuromorphic event-based dynamic vision sensors (DVS) have much faster sampling rates and a higher dynamic range than frame-based imaging sensors. However, they are sensitive to background activity (BA) events that are unwanted. There are…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Shasha Guo , Lei Wang , Xiaofan Chen , Limeng Zhang , Ziyang Kang , Weixia Xu

This study introduces a novel approach to enhance the spatial-temporal resolution of time-event pixels based on luminance changes captured by event cameras. These cameras present unique challenges due to their low resolution and the sparse,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-14 Waseem Shariff , Joe Lemley , Peter Corcoran

Event cameras capture sparse, asynchronous brightness changes which offer high temporal resolution, high dynamic range, low power consumption, and sparse data output. These advantages make them ideal for Space Situational Awareness,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Sami Arja , Alexandre Marcireau , Nicholas Owen Ralph , Saeed Afshar , Gregory Cohen

This paper presents a sparse Change-Based Convolutional Long Short-Term Memory (CB-ConvLSTM) model for event-based eye tracking, key for next-generation wearable healthcare technology such as AR/VR headsets. We leverage the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Qinyu Chen , Zuowen Wang , Shih-Chii Liu , Chang Gao

Event camera, a novel neuromorphic vision sensor, records data with high temporal resolution and wide dynamic range, offering new possibilities for accurate visual representation in challenging scenarios. However, event data is inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Lin Zhu , Ruonan Liu , Xiao Wang , Lizhi Wang , Hua Huang

Event-based data are commonly encountered in edge computing environments where efficiency and low latency are critical. To interface with such data and leverage their rich temporal features, we propose a causal spatiotemporal convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yan Ru Pei , Sasskia Brüers , Sébastien Crouzet , Douglas McLelland , Olivier Coenen

Event cameras unlock new frontiers that were previously unthinkable with standard frame-based cameras. One notable example is low-latency motion estimation (optical flow), which is critical for many real-time applications. In such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Muhammad Ahmed Humais , Xiaoqian Huang , Hussain Sajwani , Sajid Javed , Yahya Zweiri

We propose a learning approach to corner detection for event-based cameras that is stable even under fast and abrupt motions. Event-based cameras offer high temporal resolution, power efficiency, and high dynamic range. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Jacques Manderscheid , Amos Sironi , Nicolas Bourdis , Davide Migliore , Vincent Lepetit

Bio-inspired neuromorphic cameras asynchronously record pixel brightness changes and generate sparse event streams. They can capture dynamic scenes with little motion blur and more details in extreme illumination conditions. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Pei Zhang , Chutian Wang , Edmund Y. Lam

Despite the success of deep neural network (DNN) on sequential data (i.e., scene text and speech) recognition, it suffers from the over-confidence problem mainly due to overfitting in training with the cross-entropy loss, which may make the…

Artificial Intelligence · Computer Science 2023-03-14 Shuangping Huang , Yu Luo , Zhenzhou Zhuang , Jin-Gang Yu , Mengchao He , Yongpan Wang

Dynamic Vision Sensors (DVSs) asynchronously stream events in correspondence of pixels subject to brightness changes. Differently from classic vision devices, they produce a sparse representation of the scene. Therefore, to apply standard…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Marco Cannici , Marco Ciccone , Andrea Romanoni , Matteo Matteucci

Event-based multimodal large language models (MLLMs) enable robust perception in high-speed and low-light scenarios, addressing key limitations of frame-based MLLMs. However, current event-based MLLMs often rely on dense image-like…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shaoyu Liu , Jianing Li , Guanghui Zhao , Yunjian Zhang , Wen Jiang , Ming Li , Xiangyang Ji

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are ideally suited for real-time motion analysis. The unique properties encompassed in the readings of such sensors provide high temporal resolution, superior sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Anton Mitrokhin , Cornelia Fermuller , Chethan Parameshwara , Yiannis Aloimonos

Face analysis has been studied from different angles to infer emotion, poses, shapes, and landmarks. Traditionally RGB cameras are used, yet for fine-grained tasks standard sensors might not be up to the task due to their latency, making it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Luca Cultrera , Federico Becattini , Lorenzo Berlincioni , Claudio Ferrari , Alberto Del Bimbo

Event cameras are neuromorphic sensors that capture asynchronous and sparse event stream when per-pixel brightness changes. The state-of-the-art processing methods for event signals typically aggregate events into a frame or a grid.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Beibei Yang , Weiling Li , Yan Fang

In this work, we present optical space imaging using an unconventional yet promising class of imaging devices known as neuromorphic event-based sensors. These devices, which are modeled on the human retina, do not operate with frames, but…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Saeed Afshar , Andrew P Nicholson , Andre van Schaik , Gregory Cohen

In recent years, dynamic vision sensors (DVS), also known as event-based cameras or neuromorphic sensors, have seen increased use due to various advantages over conventional frame-based cameras. Using principles inspired by the retina, its…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Nicholas F. Y. Chen

Event cameras are considered to have great potential for computer vision and robotics applications because of their high temporal resolution and low power consumption characteristics. However, the event stream output from event cameras has…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Xiaoshan Wu , Weihua He , Man Yao , Ziyang Zhang , Yaoyuan Wang , Guoqi Li