English
Related papers

Related papers: 360-Degree Gaze Estimation in the Wild Using Multi…

200 papers

World-wide-web, with the website and webpage as the main interface, facilitates the dissemination of important information. Hence it is crucial to optimize them for better user interaction, which is primarily done by analyzing users'…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Ciheng Zhang , Decky Aspandi , Steffen Staab

Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and requires specialized hardware setups. We propose MTGLS: a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Shreya Ghosh , Munawar Hayat , Abhinav Dhall , Jarrod Knibbe

Online egocentric gaze estimation predicts where a camera wearer is looking from first-person video using only past and current frames, a task essential for augmented reality and assistive technologies. Unlike third-person gaze estimation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jia Li , Wenjie Zhao , Shijian Deng , Bolin Lai , Yuheng Wu , RUijia Chen , Jon E. Froehlich , Yuhang Zhao , Yapeng Tian

Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap where existing AGE models often fail in practical, unconstrained scenarios, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhenhao Li , Zheng Liu , Seunghyun Lee , Amin Fadaeinejad , Yuanhao Yu

Gaze estimation, which is a method to determine where a person is looking at given the person's full face, is a valuable clue for understanding human intention. Similarly to other domains of computer vision, deep learning (DL) methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Longzhao Huang , Yujie Li , Xu Wang , Haoyu Wang , Ahmed Bouridane , Ahmad Chaddad

Human gaze is a crucial cue used in various applications such as human-robot interaction and virtual reality. Recently, convolution neural network (CNN) approaches have made notable progress in predicting gaze direction. However, estimating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Ahmed A. Abdelrahman , Thorsten Hempel , Aly Khalifa , Ayoub Al-Hamadi

Eye gaze estimation has become increasingly significant in computer vision.In this paper,we systematically study the mainstream of eye gaze estimation methods,propose a novel methodology to estimate eye gaze points and eye gaze directions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yong Huang , Ben Chen , Daiming Qu

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze analysis still remains challenging due to the uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Shreya Ghosh , Abhinav Dhall , Munawar Hayat , Jarrod Knibbe , Qiang Ji

In this letter, we propose a new method, Multi-Clue Gaze (MCGaze), to facilitate video gaze estimation via capturing spatial-temporal interaction context among head, face, and eye in an end-to-end learning way, which has not been well…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yiran Guan , Zhuoguang Chen , Wenzheng Zeng , Zhiguo Cao , Yang Xiao

Mutual gaze detection, i.e., predicting whether or not two people are looking at each other, plays an important role in understanding human interactions. In this work, we focus on the task of image-based mutual gaze detection, and propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Bardia Doosti , Ching-Hui Chen , Raviteja Vemulapalli , Xuhui Jia , Yukun Zhu , Bradley Green

Eye-tracking applications that utilize the human gaze in video understanding tasks have become increasingly important. To effectively automate the process of video analysis based on eye-tracking data, it is important to accurately replicate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Suleyman Ozdel , Yao Rong , Berat Mert Albaba , Yen-Ling Kuo , Xi Wang , Enkelejda Kasneci

360{\deg} videos in recent years have experienced booming development. Compared to traditional videos, 360{\deg} videos are featured with uncertain user behaviors, bringing opportunities as well as challenges. Datasets are necessary for…

Multimedia · Computer Science 2022-08-09 Yili Jin , Junhua Liu , Fangxin Wang , Shuguang Cui

Many cameras implement auto-focus functionality. However, they typically require the user to manually identify the location to be focused on. While such an approach works for temporally-sparse autofocusing functionality (e.g., photo…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Wolfgang Fuhl , Thiago Santini , Enkelejda Kasneci

Despite significant advances in improving the gaze tracking accuracy under controlled conditions, the tracking robustness under real-world conditions, such as large head pose and movements, use of eyeglasses, illumination and eye type…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Nuri Murat Arar , Jean-Philippe Thiran

Recent research has demonstrated the ability to estimate gaze on mobile devices by performing inference on the image from the phone's front-facing camera, and without requiring specialized hardware. While this offers wide potential…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Matan Sela , Pingmei Xu , Junfeng He , Vidhya Navalpakkam , Dmitry Lagun

Human eye contact is a form of non-verbal communication and can have a great influence on social behavior. Since the location and size of the eye contact targets vary across different videos, learning a generic video-independent eye contact…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Tianyi Wu , Yusuke Sugano

In human-robot collaboration, one challenging task is to teach a robot new yet unknown objects enabling it to interact with them. Thereby, gaze can contain valuable information. We investigate if it is possible to detect objects (object or…

Robotics · Computer Science 2023-01-26 Daniel Weber , Wolfgang Fuhl , Andreas Zell , Enkelejda Kasneci

Gaze Target Detection (GTD), i.e., determining where a person is looking within a scene from an external viewpoint, is a challenging task, particularly in 3D space. Existing approaches heavily rely on analyzing the person's appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Andrea Toaiari , Vittorio Murino , Marco Cristani , Cigdem Beyan

Eye gaze can provide rich information on human psychological activities, and has garnered significant attention in the field of Human-Robot Interaction (HRI). However, existing gaze estimation methods merely predict either the gaze…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Haoming Huang , Musen Zhang , Jianxin Yang , Zhen Li , Jinkai Li , Yao Guo

Technical progress in hardware and software enables us to record gaze data in everyday situations and over long time spans. Among a multitude of research opportunities, this technology enables visualization researchers to catch a glimpse…

Human-Computer Interaction · Computer Science 2020-10-01 Kuno Kurzhals , Michael Burch , Daniel Weiskopf