English
Related papers

Related papers: Spatiotemporal Filtering for Event-Based Action Re…

200 papers

Deep spatiotemporal models are used in a variety of computer vision tasks, such as action recognition and video object segmentation. Currently, there is a limited understanding of what information is captured by these models in their…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Matthew Kowal , Mennatullah Siam , Md Amirul Islam , Neil D. B. Bruce , Richard P. Wildes , Konstantinos G. Derpanis

Event-based cameras have recently drawn the attention of the Computer Vision community thanks to their advantages in terms of high temporal resolution, low power consumption and high dynamic range, compared to traditional frame-based…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Amos Sironi , Manuele Brambilla , Nicolas Bourdis , Xavier Lagorce , Ryad Benosman

A primary challenge faced in few-shot action recognition is inadequate video data for training. To address this issue, current methods in this field mainly focus on devising algorithms at the feature level while little attention is paid to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Huabin Liu , Weixian Lv , John See , Weiyao Lin

Event-based vision sensors, inspired by biological neural systems, asynchronously capture local pixel-level intensity changes as a sparse event stream containing position, polarity, and timestamp information. These neuromorphic sensors…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Tiantian Xie , Pengpai Wang , Rosa H. M. Chan

Event-based cameras are dynamic vision sensors that provide asynchronous measurements of changes in per-pixel brightness at a microsecond level. This makes them significantly faster than conventional frame-based cameras, and an appealing…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Sai Vemprala , Sami Mian , Ashish Kapoor

Event-based cameras offer much potential to the fields of robotics and computer vision, in part due to their large dynamic range and extremely high "frame rates". These attributes make them, at least in theory, particularly suitable for…

Event-based camera is a bio-inspired vision sensor that records intensity changes (called event) asynchronously in each pixel. As an instance of event-based camera, Dynamic and Active-pixel Vision Sensor (DAVIS) combines a standard camera…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Yuhu Guo , Han Xiao , Yidong Chen , Xiaodong Shi

In this paper we discuss several forms of spatiotemporal convolutions for video analysis and study their effects on action recognition. Our motivation stems from the observation that 2D CNNs applied to individual frames of the video have…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Du Tran , Heng Wang , Lorenzo Torresani , Jamie Ray , Yann LeCun , Manohar Paluri

Event-based cameras are bio-inspired sensors with pixels that independently and asynchronously respond to brightness changes at microsecond resolution, offering the potential to handle visual tasks in challenging scenarios. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Sheng Zhong , Zhongyang Ren , Xiya Zhu , Dehao Yuan , Cornelia Fermuller , Yi Zhou

With the increase in interest in deployment of robots in unstructured environments to work alongside humans, the development of human-like sense of touch for robots becomes important. In this work, we implement a multi-channel neuromorphic…

Robotics · Computer Science 2021-09-06 Anupam K. Gupta , Andrei Nakagawa , Nathan F. Lepora , Nitish V. Thakor

We address human action recognition from multi-modal video data involving articulated pose and RGB frames and propose a two-stream approach. The pose stream is processed with a convolutional model taking as input a 3D tensor holding data…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Fabien Baradel , Christian Wolf , Julien Mille

In contrast to traditional cameras, whose pixels have a common exposure time, event-based cameras are novel bio-inspired sensors whose pixels work independently and asynchronously output intensity changes (called "events"), with microsecond…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Timo Stoffregen , Guillermo Gallego , Tom Drummond , Lindsay Kleeman , Davide Scaramuzza

Neuromorphic, or event, cameras represent a transformation in the classical approach to visual sensing encodes detected instantaneous per-pixel illumination changes into an asynchronous stream of event packets. Their novelty compared to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Claudio Cimarelli , Jose Andres Millan-Romera , Holger Voos , Jose Luis Sanchez-Lopez

Event camera has offered promising alternative for visual perception, especially in high speed and high dynamic range scenes. Recently, many deep learning methods have shown great success in providing promising solutions to many event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Ziluo Ding , Rui Zhao , Jiyuan Zhang , Tianxiao Gao , Ruiqin Xiong , Zhaofei Yu , Tiejun Huang

Event camera-based pattern recognition is a newly arising research topic in recent years. Current researchers usually transform the event streams into images, graphs, or voxels, and adopt deep neural networks for event-based classification.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xiao Wang , Yao Rong , Zongzhen Wu , Lin Zhu , Bo Jiang , Jin Tang , Yonghong Tian

For deepfake detection, video-level detectors have not been explored as extensively as image-level detectors, which do not exploit temporal data. In this paper, we empirically show that existing approaches on image and sequence classifiers…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ipek Ganiyusufoglu , L. Minh Ngô , Nedko Savov , Sezer Karaoglu , Theo Gevers

Aerial surveillance demands rapid and precise detection of moving objects in dynamic environments. Event cameras, which draw inspiration from biological vision systems, present a promising alternative to frame-based sensors due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Sami Arja , Alexandre Marcireau , Saeed Afshar , Bharath Ramesh , Gregory Cohen

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are ideally suited for real-time motion analysis. The unique properties encompassed in the readings of such sensors provide high temporal resolution, superior sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Anton Mitrokhin , Cornelia Fermuller , Chethan Parameshwara , Yiannis Aloimonos

This paper introduces an unsupervised compact architecture that can extract features and classify the contents of dynamic scenes from the temporal output of a neuromorphic asynchronous event-based camera. Event-based cameras are clock-less…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Germain Haessig , Ryad Benosman

Despite the dynamic development of computer vision algorithms, the implementation of perception and control systems for autonomous vehicles such as drones and self-driving cars still poses many challenges. A video stream captured by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Piotr Wzorek , Tomasz Kryjak