English
Related papers

Related papers: A Framework for Pupil Tracking with Event Cameras

200 papers

Event-based object detection has recently garnered attention in the computer vision community due to the exceptional properties of event cameras, such as high dynamic range and no motion blur. However, feature asynchronism and sparsity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Ting-Kang Yen , Igor Morawski , Shusil Dangi , Kai He , Chung-Yi Lin , Jia-Fong Yeh , Hung-Ting Su , Winston Hsu

Eye movements provide a window into human behaviour, attention, and interaction dynamics. Challenges in real-world, multi-person environments have, however, restrained eye-tracking research predominantly to single-person, in-lab settings.…

Human-Computer Interaction · Computer Science 2025-05-27 Shreshth Saxena , Areez Visram , Neil Lobo , Zahid Mirza , Mehak Rafi Khan , Biranugan Pirabaharan , Alexander Nguyen , Lauren K. Fink

This thesis describes the development of fast algorithms for the computation of PERcentage CLOSure of eyes (PERCLOS) and Saccadic Ratio (SR). PERCLOS and SR are two ocular parameters reported to be measures of alertness levels in human…

Computer Vision and Pattern Recognition · Computer Science 2015-06-01 Anirban Dasgupta , Aurobinda Routray

Object detection is crucial in various cutting-edge applications, such as autonomous vehicles and advanced robotics systems, primarily relying on data from conventional frame-based RGB sensors. However, these sensors often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Diego A. Silva , Kamilya Smagulova , Ahmed Elsheikh , Mohammed E. Fouda , Ahmed M. Eltawil

This paper presents a long-term object tracking framework with a moving event camera under general tracking conditions. A first of its kind for these revolutionary cameras, the tracking framework uses a discriminative representation for the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Bharath Ramesh , Shihao Zhang , Hong Yang , Andres Ussa , Matthew Ong , Garrick Orchard , Cheng Xiang

Neuromorphic vision sensors or event cameras have made the visual perception of extremely low reaction time possible, opening new avenues for high-dynamic robotics applications. These event cameras' output is dependent on both motion and…

Among prerequisites for a synthetic agent to interact with dynamic scenes, the ability to identify independently moving objects is specifically important. From an application perspective, nevertheless, standard cameras may deteriorate…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Xiuyuan Lu , Yi Zhou , Shaojie Shen

Algorithms for accurate localization of pupil centre is essential for gaze tracking in real world conditions. Most of the algorithms fail in real world conditions like illumination variations, contact lenses, glasses, eye makeup, motion…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Anjith George , Aurobinda Routray

Inspired by the complementarity between conventional frame-based and bio-inspired event-based cameras, we propose a multi-modal based approach to fuse visual cues from the frame- and event-domain to enhance the single object tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jiqing Zhang , Xin Yang , Yingkai Fu , Xiaopeng Wei , Baocai Yin , Bo Dong

We built a custom video-based eye-tracker that saves every video frame as a full resolution image (MJPEG). Images can be processed offline for the detection of ocular features, including the pupil and corneal reflection (First Purkinje…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Evgeniy Abdulin , Lee Friedman , Oleg Komogortsev

Understanding the decision process underlying gaze control is an important question in cognitive neuroscience with applications in diverse fields ranging from psychology to computer vision. The decision for choosing an upcoming saccade…

Neurons and Cognition · Quantitative Biology 2021-01-27 Noa Malem-Shinitski , Manfred Opper , Sebastian Reich , Lisa Schwetlick , Stefan A. Seelig , Ralf Engbert

Being inspired by the biological eye, event camera is a novel asynchronous technology that pose a paradigm shift in acquisition of visual information. This paradigm enables event cameras to capture pixel-size fast motions much more…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 David El-Chai Ben-Ezra , Ron Arad , Ayelet Padowicz , Israel Tugendhaft

3D hand pose estimation from monocular videos is a long-standing and challenging problem, which is now seeing a strong upturn. In this work, we address it for the first time using a single event camera, i.e., an asynchronous vision sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Viktor Rudnev , Vladislav Golyanik , Jiayi Wang , Hans-Peter Seidel , Franziska Mueller , Mohamed Elgharib , Christian Theobalt

Recent methods to automatically calibrate stationary eye trackers were shown to effectively reduce inherent calibration distortion. However, these methods require additional information, such as mouse clicks or on-screen content. We propose…

Human-Computer Interaction · Computer Science 2019-03-12 Michael Xuelin Huang , Andreas Bulling

In this paper we consider the problem of tracking the progression of reading through eye-gaze measurements. Such an algorithm is novel and will ultimately help to develop a method of analyzing eye-gaze data which had been collected during…

Human-Computer Interaction · Computer Science 2019-05-09 Stephen Bottos , Balakumar Balasingam

3D object detection is essential for autonomous systems, enabling precise localization and dimension estimation. While LiDAR and RGB cameras are widely used, their fixed frame rates create perception gaps in high-speed scenarios. Event…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jae-Young Kang , Hoonhee Cho , Kuk-Jin Yoon

Existing tracking algorithms typically rely on low-frame-rate RGB cameras coupled with computationally intensive deep neural network architectures to achieve effective tracking. However, such frame-based methods inherently face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiao Wang , Xiao Wang , Liye Jin , Bo Jiang , Lin Zhu , Lan Chen , Yonghong Tian , Bin Luo

We introduce a wearable single-eye emotion recognition device and a real-time approach to recognizing emotions from partial observations of an emotion that is robust to changes in lighting conditions. At the heart of our method is a…

Graphics · Computer Science 2023-10-09 Haiwei Zhang , Jiqing Zhang , Bo Dong , Pieter Peers , Wenwei Wu , Xiaopeng Wei , Felix Heide , Xin Yang

Despite the dynamic development of computer vision algorithms, the implementation of perception and control systems for autonomous vehicles such as drones and self-driving cars still poses many challenges. A video stream captured by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Piotr Wzorek , Tomasz Kryjak

Tracking any point (TAP) recently shifted the motion estimation paradigm from focusing on individual salient points with local templates to tracking arbitrary points with global image contexts. However, while research has mostly focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Friedhelm Hamann , Daniel Gehrig , Filbert Febryanto , Kostas Daniilidis , Guillermo Gallego