English
Related papers

Related papers: Generalizing Gaze Estimation with Outlier-guided C…

200 papers

Image restoration schemes based on the pre-trained deep models have received great attention due to their unique flexibility for solving various inverse problems. In particular, the Plug-and-Play (PnP) framework is a popular and powerful…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Chong Wang , Rongkai Zhang , Saiprasad Ravishankar , Bihan Wen

In domain adaptation (DA), the effectiveness of deep learning-based models is often constrained by batch learning strategies that fail to fully apprehend the global statistical and geometric characteristics of data distributions. Addressing…

Machine Learning · Computer Science 2025-02-11 Lingkun Luo , Shiqiang Hu , Liming Chen

This paper presents the selective use of eye-gaze information in learning human actions in Atari games. Vast evidence suggests that our eye movement convey a wealth of information about the direction of our attention and mental states and…

Machine Learning · Computer Science 2020-12-08 Chaitanya Thammineni , Hemanth Manjunatha , Ehsan T. Esfahani

Human eye gaze estimation is an important cognitive ingredient for successful human-robot interaction, enabling the robot to read and predict human behavior. We approach this problem using artificial neural networks and build a modular…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Dmytro Herashchenko , Igor Farkaš

Unconstrained remote gaze estimation remains challenging mostly due to its vulnerability to the large variability in head-pose. Prior solutions struggle to maintain reliable accuracy in unconstrained remote gaze tracking. Among them,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Zhecan Wang , Jian Zhao , Cheng Lu , Han Huang , Fan Yang , Lianji Li , Yandong Guo

Predicting the target of visual search from eye fixation (gaze) data is a challenging problem with many applications in human-computer interaction. In contrast to previous work that has focused on individual instances as a search target, we…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Hosnieh Sattar , Andreas Bulling , Mario Fritz

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yu Yu , Gang Liu , Jean-Marc Odobez

The availability of extensive datasets containing gaze information for each subject has significantly enhanced gaze estimation accuracy. However, the discrepancy between domains severely affects a model's performance explicitly trained for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Younghan Kim , Kangryun Moon , Yongjun Park , Yonggyu Kim

Achieving accurate and reliable gaze predictions in complex and diverse environments remains challenging. Fortunately, it is straightforward to access diverse gaze datasets in real-world applications. We discover that training these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Shijing Wang , Yaping Huang , Jun Xie , Yi Tian , Feng Chen , Zhepeng Wang

We propose a novel plug-and-play (PnP) module for improving depth prediction with taking arbitrary patterns of sparse depths as input. Given any pre-trained depth prediction model, our PnP module updates the intermediate feature map such…

Image and Video Processing · Electrical Eng. & Systems 2019-04-12 Tsun-Hsuan Wang , Fu-En Wang , Juan-Ting Lin , Yi-Hsuan Tsai , Wei-Chen Chiu , Min Sun

Recently, graph-based models designed for downstream tasks have significantly advanced research on graph neural networks (GNNs). GNN baselines based on neural message-passing mechanisms such as GCN and GAT perform worse as the network…

Machine Learning · Computer Science 2023-01-26 Jiayuan Chen , Xiang Zhang , Yinfei Xu , Tianli Zhao , Renjie Xie , Wei Xu

Rather than regressing gaze direction directly from images, we show that adding a 3D shape model can: i) improve gaze estimation accuracy, ii) perform well with lower resolution inputs and iii) provide a richer understanding of the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Hao Sun , Nick Pears

The complex application scenarios have raised critical requirements for precise and generalizable gaze estimation methods. Recently, the pre-trained CLIP has achieved remarkable performance on various vision tasks, but its potentials have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Lin Zhang , Yi Tian , XiYun Wang , Wanru Xu , Yi Jin , Yaping Huang

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

Gaze estimation, the task of predicting where an individual is looking, is a critical task with direct applications in areas such as human-computer interaction and virtual reality. Estimating the direction of looking in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Andy Cătrună , Adrian Cosma , Emilian Rădoi

Unsupervised domain adaptation is used in many machine learning applications where, during training, a model has access to unlabeled data in the target domain, and a related labeled dataset. In this paper, we introduce a novel and general…

Machine Learning · Computer Science 2021-06-23 David Acuna , Guojun Zhang , Marc T. Law , Sanja Fidler

The study of human gaze behavior in natural contexts requires algorithms for gaze estimation that are robust to a wide range of imaging conditions. However, algorithms often fail to identify features such as the iris and pupil centroid in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Rakshit S. Kothari , Reynold J. Bailey , Christopher Kanan , Jeff B. Pelz , Gabriel J. Diaz

Although recent gaze estimation methods lay great emphasis on attentively extracting gaze-relevant features from facial or eye images, how to define features that include gaze-relevant components has been ambiguous. This obscurity makes the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Isack Lee , Jun-Seok Yun , Hee Hyeon Kim , Youngju Na , Seok Bong Yoo

Gaze following aims to predict where a person is looking in a scene, by predicting the target location, or indicating that the target is located outside the image. Recent works detect the gaze target by training a heatmap regression task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Qiaomu Miao , Minh Hoai , Dimitris Samaras

While pose estimation is an important computer vision task, it requires expensive annotation and suffers from domain shift. In this paper, we investigate the problem of domain adaptive 2D pose estimation that transfers knowledge learned on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Donghyun Kim , Kaihong Wang , Kate Saenko , Margrit Betke , Stan Sclaroff