English
Related papers

Related papers: Towards End-to-end Video-based Eye-Tracking

200 papers

Despite decades of research on data collection and model architectures, current gaze estimation models encounter significant challenges in generalizing across diverse data domains. Recent advances in self-supervised pre-training have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jiawei Qin , Xucong Zhang , Yusuke Sugano

The integration of Transparent Displays (TD) in various applications, such as Heads-Up Displays (HUDs) in vehicles, is a burgeoning field, poised to revolutionize user experiences. However, this innovation brings forth significant…

Human-Computer Interaction · Computer Science 2024-06-28 Esmaeil Seraj , Harsh Bhate , Walter Talamonti

With the rapid development and widespread application of VR/AR technology, maximizing the quality of immersive panoramic video services that match users' personal preferences and habits has become a long-standing challenge. Understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yutong Xu , Junhao Du , Jiahe Wang , Yuwei Ning , Sihan Zhou Yang Cao

Human eye tracking devices can help to investigate principles of processing visual information by humans. The attention focus movement during the gaze can be used for behavioural analysis of humans. In this work we describe our experimental…

Human-Computer Interaction · Computer Science 2022-01-05 R. Kovtun , S. Radchenko , A. Netreba , O. Sudakov , R. Natarov , Z. Dyka , I. Kabin , P. Langendörfer

Gaze behaviors such as eye-contact or shared attention are important markers for diagnosing developmental disorders in children. While previous studies have looked at some of these elements, the analysis is usually performed on private…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Samy Tafasca , Anshul Gupta , Jean-Marc Odobez

In video surveillance applications, person search is a challenging task consisting in detecting people and extracting features from their silhouette for re-identification (re-ID) purpose. We propose a new end-to-end model that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Angelique Loesch , Jaonary Rabarisoa , Romaric Audigier

Most Gaze estimation research only works on a setup condition that a camera perfectly captures eyes gaze. They have not literarily specified how to set up a camera correctly for a given position of a person. In this paper, we carry out a…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Linh Van Ma , Tin Trung Tran , Moongu Jeon

Human eye gaze detection plays an important role in various fields, including human-computer interaction, virtual reality and cognitive science. Although different relatively accurate systems of eye tracking and gaze detection exist, they…

Human-Computer Interaction · Computer Science 2017-09-13 Ehsan Arbabi , Mohammad Shabani , Ali Yarigholi

We present CasualGaze, a novel eye-gaze-based target selection technique to support natural and casual eye-gaze input. Unlike existing solutions that require users to keep the eye-gaze center on the target actively, CasualGaze allows users…

Human-Computer Interaction · Computer Science 2024-08-26 Yingtian Shi , Yukang Yan , Zisu Li , Chen Liang , Yuntao Wang , Chun Yu , Yuanchun Shi

Eye movements provide a window into human behaviour, attention, and interaction dynamics. Challenges in real-world, multi-person environments have, however, restrained eye-tracking research predominantly to single-person, in-lab settings.…

Human-Computer Interaction · Computer Science 2025-05-27 Shreshth Saxena , Areez Visram , Neil Lobo , Zahid Mirza , Mehak Rafi Khan , Biranugan Pirabaharan , Alexander Nguyen , Lauren K. Fink

Eye tracking research is important in computer vision because it can help us understand how humans interact with the visual world. Specifically for high-risk applications, such as in medical imaging, eye tracking can help us to comprehend…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Bin Wang , Hongyi Pan , Armstrong Aboah , Zheyuan Zhang , Elif Keles , Drew Torigian , Baris Turkbey , Elizabeth Krupinski , Jayaram Udupa , Ulas Bagci

We introduce a new task called Defeasible Visual Entailment (DVE), where the goal is to allow the modification of the entailment relationship between an image premise and a text hypothesis based on an additional update. While this concept…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yue Zhang , Liqiang Jing , Vibhav Gogate

Joint visual attention (JVA) provides informative cues on human behavior during social interactions. The ubiquity of egocentric eye-trackers and large-scale datasets on everyday interactions offer research opportunities in identifying JVA…

Human-Computer Interaction · Computer Science 2025-09-17 Kumushini Thennakoon , Yasasi Abeysinghe , Bhanuka Mahanama , Vikas Ashok , Sampath Jayarathna

We present a large scale data set, OpenEDS: Open Eye Dataset, of eye-images captured using a virtual-reality (VR) head mounted display mounted with two synchronized eyefacing cameras at a frame rate of 200 Hz under controlled illumination.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Stephan J. Garbin , Yiru Shen , Immo Schuetz , Robert Cavin , Gregory Hughes , Sachin S. Talathi

To predict the most salient regions of complex natural scenes, saliency models commonly compute several feature maps (contrast, orientation, motion...) and linearly combine them into a master saliency map. Since feature maps have different…

Computer Vision and Pattern Recognition · Computer Science 2017-02-03 Antoine Coutrot , Nathalie Guyader

Accurate 3D gaze estimation in unconstrained real-world environments remains a significant challenge due to variations in appearance, head pose, occlusion, and the limited availability of in-the-wild 3D gaze datasets. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Pierre Vuillecard , Jean-Marc Odobez

Traditional computer vision models often necessitate extensive data acquisition, annotation, and validation. These models frequently struggle in real-world applications, resulting in high false positive and negative rates, and exhibit poor…

Model-based eye tracking has been a dominant approach for eye gaze tracking because of its ability to generalize to different subjects, without the need of any training data and eye gaze annotations. Model-based eye tracking, however, is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Qiang Ji , Kang Wang

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

Eye tracking is handled as one of the key technologies for applications that assess and evaluate human attention, behavior, and biometrics, especially using gaze, pupillary, and blink behaviors. One of the challenges with regard to the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Efe Bozkir , Ali Burak Ünal , Mete Akgün , Enkelejda Kasneci , Nico Pfeifer