English
Related papers

Related papers: Object-aware Gaze Target Detection

200 papers

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Mingfang Zhang , Yunfei Liu , Feng Lu

Predicting the target of visual search from eye fixation (gaze) data is a challenging problem with many applications in human-computer interaction. In contrast to previous work that has focused on individual instances as a search target, we…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Hosnieh Sattar , Andreas Bulling , Mario Fritz

We discuss an attentional model for simultaneous object tracking and recognition that is driven by gaze data. Motivated by theories of perception, the model consists of two interacting pathways: identity and control, intended to mirror the…

Artificial Intelligence · Computer Science 2011-09-20 Misha Denil , Loris Bazzani , Hugo Larochelle , Nando de Freitas

We present CasualGaze, a novel eye-gaze-based target selection technique to support natural and casual eye-gaze input. Unlike existing solutions that require users to keep the eye-gaze center on the target actively, CasualGaze allows users…

Human-Computer Interaction · Computer Science 2024-08-26 Yingtian Shi , Yukang Yan , Zisu Li , Chen Liang , Yuntao Wang , Chun Yu , Yuanchun Shi

Although recent gaze estimation methods lay great emphasis on attentively extracting gaze-relevant features from facial or eye images, how to define features that include gaze-relevant components has been ambiguous. This obscurity makes the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Isack Lee , Jun-Seok Yun , Hee Hyeon Kim , Youngju Na , Seok Bong Yoo

Mutual gaze detection, i.e., predicting whether or not two people are looking at each other, plays an important role in understanding human interactions. In this work, we focus on the task of image-based mutual gaze detection, and propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Bardia Doosti , Ching-Hui Chen , Raviteja Vemulapalli , Xuhui Jia , Yukun Zhu , Bradley Green

Shared control can help in teleoperated object manipulation by assisting with the execution of the user's intention. To this end, robust and prompt intention estimation is needed, which relies on behavioral observations. Here, an intention…

Robotics · Computer Science 2022-08-19 Anna Belardinelli , Anirudh Reddy Kondapally , Dirk Ruiken , Daniel Tanneberg , Tomoki Watabe

Humans utilize their gaze to concentrate on essential information while perceiving and interpreting intentions in videos. Incorporating human gaze into computational algorithms can significantly enhance model performance in video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Suleyman Ozdel , Yao Rong , Berat Mert Albaba , Yen-Ling Kuo , Xi Wang , Enkelejda Kasneci

Predicting where a person is looking is a complex task, requiring to understand not only the person's gaze and scene content, but also the 3D scene structure and the person's situation (are they manipulating? interacting or observing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Anshul Gupta , Samy Tafasca , Jean-Marc Odobez

Joint visual attention is characterized by two or more individuals looking at a common target at the same time. The ability to identify joint attention in scenes, the people involved, and their common target, is fundamental to the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Daniel Harari , Joshua B. Tenenbaum , Shimon Ullman

We propose a novel 3D gaze estimation approach that learns spatial relationships between the subject and objects in the scene, and outputs 3D gaze direction. Our method targets unconstrained settings, including cases where close-up views of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuki Kawana , Shintaro Shiba , Quan Kong , Norimasa Kobori

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

Gaze redirection methods aim to generate realistic human face images with controllable eye movement. However, recent methods often struggle with 3D consistency, efficiency, or quality, limiting their practical applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Hengfei Wang , Zhongqun Zhang , Yihua Cheng , Hyung Jin Chang

In this work, we present interpGaze, a novel framework for controllable gaze redirection that achieves both precise redirection and continuous interpolation. Given two gaze images with different attributes, our goal is to redirect the eye…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Wensen Feng

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Introduction: In the realm of human-computer interaction and behavioral research, accurate real-time gaze estimation is critical. Traditional methods often rely on expensive equipment or large datasets, which are impractical in many…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Esther Enhui Ye , John Enzhou Ye , Joseph Ye , Jacob Ye , Runzhou Ye

This paper proposes an efficient and effective method for joint gaze location detection (GL-D) and gaze object detection (GO-D), \emph{i.e.}, gaze following detection. Current approaches frame GL-D and GO-D as two separate tasks, employing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Danyang Tu , Wei Shen , Wei Sun , Xiongkuo Min , Guangtao Zhai

We introduce GazeD, a new 3D gaze estimation method that jointly provides 3D gaze and human pose from a single RGB image. Leveraging the ability of diffusion models to deal with uncertainty, it generates multiple plausible 3D gaze and pose…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Riccardo Catalini , Davide Di Nucci , Guido Borghi , Davide Davoli , Lorenzo Garattoni , Gianpiero Francesca , Yuki Kawana , Roberto Vezzani

Gaze estimation, which predicts gaze direction, commonly faces the challenge of interference from complex gaze-irrelevant information in face images. In this work, we propose DMAGaze, a novel gaze estimation framework that exploits…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Haohan Chen , Hongjia Liu , Shiyong Lan , Wenwu Wang , Yixin Qiao , Yao Li , Guonan Deng