English
Related papers

Related papers: Spatiotemporal Attention Learning Framework for Ev…

200 papers

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are ideally suited for real-time motion analysis. The unique properties encompassed in the readings of such sensors provide high temporal resolution, superior sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Anton Mitrokhin , Cornelia Fermuller , Chethan Parameshwara , Yiannis Aloimonos

Mainstream visual object tracking frameworks predominantly rely on template matching paradigms. Their performance heavily depends on the quality of template features, which becomes increasingly challenging to maintain in complex scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Meng Zhou , Jiadong Xie , Mingsheng Xu

We present an attention-based modular neural framework for computer vision. The framework uses a soft attention mechanism allowing models to be trained with gradient descent. It consists of three modules: a recurrent attention module…

Machine Learning · Computer Science 2016-04-29 Samira Ebrahimi Kahou , Vincent Michalski , Roland Memisevic

Event-based cameras are bio-inspired sensors that capture brightness change of every pixel in an asynchronous manner. Compared with frame-based sensors, event cameras have microsecond-level latency and high dynamic range, hence showing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Dongsheng Wang , Xu Jia , Yang Zhang , Xinyu Zhang , Yaoyuan Wang , Ziyang Zhang , Dong Wang , Huchuan Lu

Triggered by the success of transformers in various visual tasks, the spatial self-attention mechanism has recently attracted more and more attention in the computer vision community. However, we empirically found that a typical vision…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Jiayin Sun , Hong Wang , Qiulei Dong

Event cameras asynchronously capture brightness changes with low latency, high temporal resolution, and high dynamic range. However, annotation of event data is a costly and laborious process, which limits the use of deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Simon Klenk , David Bonello , Lukas Koestler , Nikita Araslanov , Daniel Cremers

Deep learning inference that needs to largely take place on the 'edge' is a highly computational and memory intensive workload, making it intractable for low-power, embedded platforms such as mobile nodes and remote security applications.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Andres Ussa , Chockalingam Senthil Rajen , Deepak Singla , Jyotibdha Acharya , Gideon Fu Chuanrong , Arindam Basu , Bharath Ramesh

Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Nico Messikommer , Daniel Gehrig , Mathias Gehrig , Davide Scaramuzza

In this paper a pure-attention bottom-up approach, called ViGAT, that utilizes an object detector together with a Vision Transformer (ViT) backbone network to derive object and frame features, and a head network to process these features…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Nikolaos Gkalelis , Dimitrios Daskalakis , Vasileios Mezaris

Visual place recognition is an important problem towards global localization in many robotics tasks. One of the biggest challenges is that it may suffer from illumination or appearance changes in surrounding environments. Event cameras are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Xiang Ji , Jiaxin Wei , Yifu Wang , Huiliang Shang , Laurent Kneip

Object detection is crucial in various cutting-edge applications, such as autonomous vehicles and advanced robotics systems, primarily relying on data from conventional frame-based RGB sensors. However, these sensors often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Diego A. Silva , Kamilya Smagulova , Ahmed Elsheikh , Mohammed E. Fouda , Ahmed M. Eltawil

Event-based cameras are bio-inspired novel sensors that asynchronously record changes in illumination in the form of events, thus resulting in significant advantages over conventional cameras in terms of low power utilization, high dynamic…

Machine Learning · Statistics 2020-02-18 Lakshmi Annamalai , Anirban Chakraborty , Chetan Singh Thakur

Recognizing and comprehending human actions and gestures is a crucial perception requirement for robots to interact with humans and carry out tasks in diverse domains, including service robotics, healthcare, and manufacturing. Event…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Tristan de Blegiers , Ishan Rajendrakumar Dave , Adeel Yousaf , Mubarak Shah

The Dynamic Vision Sensor (DVS) is an innovative technology that efficiently captures and encodes visual information in an event-driven manner. By combining it with event-driven neuromorphic processing, the sparsity in DVS camera output can…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Yiming Bu , Jiayang Liu , Qinru Qiu

Event cameras provide an advantage over traditional frame-based cameras when capturing fast-moving objects without a motion blur. They achieve this by recording changes in light intensity (known as events), thus allowing them to operate at…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Wachirawit Ponghiran , Chamika Mihiranga Liyanagedera , Kaushik Roy

Neuromorphic vision sensors (event cameras) simulate biological visual perception systems and have the advantages of high temporal resolution, less data redundancy, low power consumption, and large dynamic range. Since both events and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Haibo Shen , Juyu Xiao , Yihao Luo , Xiang Cao , Liangqi Zhang , Tianjiang Wang

Event-based object detection has gained increasing attention due to its advantages such as high temporal resolution, wide dynamic range, and asynchronous address-event representation. Leveraging these advantages, Spiking Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Qi Xu , Jie Deng , Jiangrong Shen , Biwu Chen , Huajin Tang , Gang Pan

Dynamic Vision Sensors (DVS) capture event data with high temporal resolution and low power consumption, presenting a more efficient solution for visual processing in dynamic and real-time scenarios compared to conventional video capture…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Yiting Dong , Xiang He , Guobin Shen , Dongcheng Zhao , Yang Li , Yi Zeng

Environment perception including detection, classification, tracking, and motion prediction are key enablers for automated driving systems and intelligent transportation applications. Fueled by the advances in sensing technologies and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Zhensong Wei , Xuewei Qi , Zhengwei Bai , Guoyuan Wu , Saswat Nayak , Peng Hao , Matthew Barth , Yongkang Liu , Kentaro Oguchi

Event cameras, which are asynchronous bio-inspired vision sensors, have shown great potential in computer vision and artificial intelligence. However, the application of event cameras to object-level motion estimation or tracking is still…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Haosheng Chen , David Suter , Qiangqiang Wu , Hanzi Wang