English
Related papers

Related papers: Sub-Millisecond Event-Based Eye Tracking on a Reso…

200 papers

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are ideally suited for real-time motion analysis. The unique properties encompassed in the readings of such sensors provide high temporal resolution, superior sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Anton Mitrokhin , Cornelia Fermuller , Chethan Parameshwara , Yiannis Aloimonos

Eye tracking is a key technology for gaze-based interactions in Extended Reality (XR), but traditional frame-based systems struggle to meet XR's demands for high accuracy, low latency, and power efficiency. Event cameras offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Junyuan Ding , Ziteng Wang , Chang Gao , Min Liu , Qinyu Chen

Outdoor acoustic events detection is an exciting research field but challenged by the need for complex algorithms and deep learning techniques, typically requiring many computational, memory, and energy resources. This challenge discourages…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-30 Gianmarco Cerutti , Rahul Prasad , Alessio Brutti , Elisabetta Farella

Eye-tracking technology has gained significant attention in recent years due to its wide range of applications in human-computer interaction, virtual and augmented reality, and wearable health. Traditional RGB camera-based eye-tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Argha Sen , Nuwan Bandara , Ila Gokarn , Thivya Kandappu , Archan Misra

With the success of deep learning, object recognition systems that can be deployed for real-world applications are becoming commonplace. However, inference that needs to largely take place on the `edge' (not processed on servers), is a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Andres Ussa , Luca Della Vedova , Vandana Reddy Padala , Deepak Singla , Jyotibdha Acharya , Charles Zhang Lei , Garrick Orchard , Arindam Basu , Bharath Ramesh

A significant limitation of current smartphone-based eye-tracking algorithms is their low accuracy when applied to video-type visual stimuli, as they are typically trained on static images. Also, the increasing demand for real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Nishan Gunawardena , Gough Yumu Lui , Jeewani Anupama Ginige , Bahman Javadi

Contextual Artificial Intelligence (AI) based on emerging Transformer models is predicted to drive the next technology revolution in interactive wearable devices such as new-generation smart glasses. By coupling numerous sensors with small,…

Hardware Architecture · Computer Science 2025-03-27 Severin Bochem , Victor J. B. Jung , Arpan Prasad , Francesco Conti , Luca Benini

Object detection and tracking are challenging tasks for resource-constrained embedded systems. While these tasks are among the most compute-intensive tasks from the artificial intelligence domain, they are only allowed to use limited…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Xiaofan Zhang , Haoming Lu , Cong Hao , Jiachen Li , Bowen Cheng , Yuhong Li , Kyle Rupnow , Jinjun Xiong , Thomas Huang , Honghui Shi , Wen-mei Hwu , Deming Chen

Event-based vision sensors offer asynchronous, high-temporal-resolution measurements that are attractive for low-latency robotic perception, but many event-based motion estimation methods are computationally intensive and difficult to map…

Robotics · Computer Science 2026-05-28 Arianna Alonso Bizzi , Fernando Cladera , C. J. Taylor

Event-based data are commonly encountered in edge computing environments where efficiency and low latency are critical. To interface with such data and leverage their rich temporal features, we propose a causal spatiotemporal convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yan Ru Pei , Sasskia Brüers , Sébastien Crouzet , Douglas McLelland , Olivier Coenen

A key task in embedded vision is visual odometry (VO), which estimates camera motion from visual sensors, and it is a core component in many embedded power-constrained systems, from autonomous robots to augmented and virtual reality…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Alessandro Marchei , Lorenzo Lamberti , Daniele Palossi , Luca Benini

Event-based eye tracking holds significant promise for fine-grained cognitive state inference, offering high temporal resolution and robustness to motion artifacts, critical features for decoding subtle mental states such as attention,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Nuwan Bandara , Thivya Kandappu , Archan Misra

Deep learning inference that needs to largely take place on the 'edge' is a highly computational and memory intensive workload, making it intractable for low-power, embedded platforms such as mobile nodes and remote security applications.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Andres Ussa , Chockalingam Senthil Rajen , Deepak Singla , Jyotibdha Acharya , Gideon Fu Chuanrong , Arindam Basu , Bharath Ramesh

Recently, we have witnessed the rise of novel ``event-based'' camera sensors for high-speed, low-power video capture. Rather than recording discrete image frames, these sensors output asynchronous ``event'' tuples with microsecond…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Andrew Hamara , Benjamin Kilpatrick , Alex Baratta , Brendon Kofink , Andrew C. Freeman

Egomotion estimation is crucial for applications such as autonomous navigation and robotics, where accurate and real-time motion tracking is required. However, traditional methods relying on inertial sensors are highly sensitive to external…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Hugh Greatorex , Michele Mastella , Madison Cotteret , Ole Richter , Elisabetta Chicca

The complexity of event-based object detection (OD) poses considerable challenges. Spiking Neural Networks (SNNs) show promising results and pave the way for efficient event-based OD. Despite this success, the path to efficient SNNs on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Jonathan Courtois , Pierre-Emmanuel Novac , Edgar Lemaire , Alain Pegatoquet , Benoit Miramond

Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time,…

High-speed vision sensing is essential for real-time perception in applications such as robotics, autonomous vehicles, and industrial automation. Traditional frame-based vision systems suffer from motion blur, high latency, and redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Riadul Islam , Joey Mulé , Dhandeep Challagundla , Shahmir Rizvi , Sean Carson

Edge computing solutions that enable the extraction of high-level information from a variety of sensors is in increasingly high demand. This is due to the increasing number of smart devices that require sensory processing for their…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Ole Richter , Yannan Xing , Michele De Marchi , Carsten Nielsen , Merkourios Katsimpris , Roberto Cattaneo , Yudi Ren , Yalun Hu , Qian Liu , Sadique Sheik , Tugba Demirci , Ning Qiao

This survey serves as a review for the 2025 Event-Based Eye Tracking Challenge organized as part of the 2025 CVPR event-based vision workshop. This challenge focuses on the task of predicting the pupil center by processing event camera…