English
Related papers

Related papers: Multimodal Across Domains Gaze Target Detection

200 papers

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Gaze following estimates gaze targets of in-scene person by understanding human behavior and scene information. Existing methods usually analyze scene images for gaze following. However, compared with visual images, audio also provides…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yuqi Hou , Zhongqun Zhang , Nora Horanyi , Jaewon Moon , Yihua Cheng , Hyung Jin Chang

Despite impressive progress in object detection over the last years, it is still an open challenge to reliably detect objects across visual domains. Although the topic has attracted attention recently, current approaches all rely on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Antonio D'Innocente , Francesco Cappio Borlino , Silvia Bucci , Barbara Caputo , Tatiana Tommasi

Human gaze offers rich supervisory signals for understanding visual attention in complex visual environments. In this paper, we propose Eyes on Target, a novel depth-aware and gaze-guided object detection framework designed for egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Vishakha Lall , Yisi Liu

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yu Yu , Gang Liu , Jean-Marc Odobez

Gaze is an essential prompt for analyzing human behavior and attention. Recently, there has been an increasing interest in determining gaze direction from facial videos. However, video gaze estimation faces significant challenges, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Swati Jindal , Mohit Yadav , Roberto Manduchi

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Mingfang Zhang , Yunfei Liu , Feng Lu

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze analysis still remains challenging due to the uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Shreya Ghosh , Abhinav Dhall , Munawar Hayat , Jarrod Knibbe , Qiang Ji

Recent LiDAR-based 3D Object Detection (3DOD) methods show promising results, but they often do not generalize well to target domains outside the source (or training) data distribution. To reduce such domain gaps and thus to make 3DOD…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Gyusam Chang , Wonseok Roh , Sujin Jang , Dongwook Lee , Daehyun Ji , Gyeongrok Oh , Jinsun Park , Jinkyu Kim , Sangpil Kim

Along with the recent development of deep neural networks, appearance-based gaze estimation has succeeded considerably when training and testing within the same domain. Compared to the within-domain task, the variance of different domains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiawei Qin , Takuru Shimoyama , Xucong Zhang , Yusuke Sugano

Gaze correction aims to redirect the person's gaze into the camera by manipulating the eye region, and it can be considered as a specific image resynthesis problem. Gaze correction has a wide range of applications in real life, such as…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jichao Zhang , Meng Sun , Jingjing Chen , Hao Tang , Yan Yan , Xueying Qin , Nicu Sebe

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

Reasoning human object interactions is a core problem in human-centric scene understanding and detecting such relations poses a unique challenge to vision systems due to large variations in human-object configurations, multiple co-occurring…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Bo Wan , Desen Zhou , Yongfei Liu , Rongjie Li , Xuming He

Gaze estimation, the task of predicting where an individual is looking, is a critical task with direct applications in areas such as human-computer interaction and virtual reality. Estimating the direction of looking in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Andy Cătrună , Adrian Cosma , Emilian Rădoi

By borrowing the wisdom of human in gaze following, we propose a two-stage solution for gaze point prediction of the target persons in a scene. Specifically, in the first stage, both head image and its position are fed into a gaze direction…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Dongze Lian , Zehao Yu , Shenghua Gao

Estimating human gaze target from visible images is a critical task for robots to understand human attention, yet the development of generalizable neural architectures and training paradigms remains challenging. While recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zhuangzhuang Dai , Zhongxi Lu , Vincent G. Zakka , Luis J. Manso , Jose M Alcaraz Calero , Chen Li

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen

We propose a novel 3D gaze estimation approach that learns spatial relationships between the subject and objects in the scene, and outputs 3D gaze direction. Our method targets unconstrained settings, including cases where close-up views of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuki Kawana , Shintaro Shiba , Quan Kong , Norimasa Kobori

We address the problem of gaze target estimation, which aims to predict where a person is looking in a scene. Predicting a person's gaze target requires reasoning both about the person's appearance and the contents of the scene. Prior works…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Fiona Ryan , Ajay Bati , Sangmin Lee , Daniel Bolya , Judy Hoffman , James M. Rehg