English
Related papers

Related papers: NeRF-Gaze: A Head-Eye Redirection Parametric Model…

200 papers

Gaze estimation is a crucial task in computer vision, however, existing methods suffer from high computational costs, which limit their practical deployment in resource-limited environments. In this paper, we propose a novel lightweight…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Tao Xu , Bo Wu , Ruilong Fan , Yun Zhou , Di Huang

Gaze estimation, which is a method to determine where a person is looking at given the person's full face, is a valuable clue for understanding human intention. Similarly to other domains of computer vision, deep learning (DL) methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Longzhao Huang , Yujie Li , Xu Wang , Haoyu Wang , Ahmed Bouridane , Ahmad Chaddad

Appearance-based gaze estimation has attracted more and more attention because of its wide range of applications. The use of deep convolutional neural networks has improved the accuracy significantly. In order to improve the estimation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Zhaokang Chen , Bertram E. Shi

We introduce GazeD, a new 3D gaze estimation method that jointly provides 3D gaze and human pose from a single RGB image. Leveraging the ability of diffusion models to deal with uncertainty, it generates multiple plausible 3D gaze and pose…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Riccardo Catalini , Davide Di Nucci , Guido Borghi , Davide Davoli , Lorenzo Garattoni , Gianpiero Francesca , Yuki Kawana , Roberto Vezzani

Determining the direction in which a person is looking is an important problem in a wide range of HCI applications. In this paper we describe a highly accurate algorithm that performs gaze estimation using an affordable and widely available…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Reza Shoja Ghiass , Ognjen Arandjelovic

Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on custom datasets, making comparison across methods challenging.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Xucong Zhang , Seonwook Park , Thabo Beeler , Derek Bradley , Siyu Tang , Otmar Hilliges

In this paper, we present a survey of deep learning-based methods for the regression of gaze direction vector from head and eye images. We describe in detail numerous published methods with a focus on the input data, architecture of the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Franko Šikić , Donik Vršnak , Sven Lončarić

Eye gaze can provide rich information on human psychological activities, and has garnered significant attention in the field of Human-Robot Interaction (HRI). However, existing gaze estimation methods merely predict either the gaze…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Haoming Huang , Musen Zhang , Jianxin Yang , Zhen Li , Jinkai Li , Yao Guo

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

3D gaze information is important for scene-centric attention analysis but accurate estimation and analysis of 3D gaze in real-world environments remains challenging. We present a novel 3D gaze estimation method for monocular head-mounted…

Human-Computer Interaction · Computer Science 2017-02-07 Mohsen Mansouryar , Julian Steil , Yusuke Sugano , Andreas Bulling

Gaze redirection aims at manipulating the gaze of a given face image with respect to a desired direction (i.e., a reference angle) and it can be applied to many real life scenarios, such as video-conferencing or taking group photos.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jingjing Chen , Jichao Zhang , Enver Sangineto , Jiayuan Fan , Tao Chen , Nicu Sebe

We propose a novel 3D gaze estimation approach that learns spatial relationships between the subject and objects in the scene, and outputs 3D gaze direction. Our method targets unconstrained settings, including cases where close-up views of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuki Kawana , Shintaro Shiba , Quan Kong , Norimasa Kobori

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

We study the problem of reconstructing 3D feature curves of an object from a set of calibrated multi-view images. To do so, we learn a neural implicit field representing the density distribution of 3D edges which we refer to as Neural Edge…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yunfan Ye , Renjiao Yi , Zhirui Gao , Chenyang Zhu , Zhiping Cai , Kai Xu

Gaze estimation involves predicting where the person is looking at within an image or video. Technically, the gaze information can be inferred from two different magnification levels: face orientation and eye orientation. The inference is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Ashesh , Chu-Song Chen , Hsuan-Tien Lin

Deep learning appearance-based 3D gaze estimation is gaining popularity due to its minimal hardware requirements and being free of constraint. Unreliable and overconfident inferences, however, still limit the adoption of this gaze…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Qiaojie Zheng , Xiaoli Zhang

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

Gaze correction aims to redirect the person's gaze into the camera by manipulating the eye region, and it can be considered as a specific image resynthesis problem. Gaze correction has a wide range of applications in real life, such as…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jichao Zhang , Meng Sun , Jingjing Chen , Hao Tang , Yan Yan , Xueying Qin , Nicu Sebe

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Mingfang Zhang , Yunfei Liu , Feng Lu