English
Related papers

Related papers: Automatic Gaze Analysis: A Survey of Deep Learning…

200 papers

Many computer vision tasks rely on labeled data. Rapid progress in generative modeling has led to the ability to synthesize photorealistic images. However, controlling specific aspects of the generation process such that the data can be…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Yufeng Zheng , Seonwook Park , Xucong Zhang , Shalini De Mello , Otmar Hilliges

Human-Computer Interaction(HCI) is a field that studies interactions between human users and computer systems. With the development of HCI, individuals or groups of people can use various digital technologies to achieve the optimal user…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Hoyeon Ahn

Gaze tracking devices have the potential to greatly expand interactivity, yet miscalibration remains a significant barrier to use. As devices miscalibrate, people tend to compensate by intentionally offsetting their gaze, which makes…

Human-Computer Interaction · Computer Science 2023-11-01 Akanksha Saran , Jacob Alber , Cyril Zhang , Ann Paradiso , Danielle Bragg , John Langford

Vision Language Models (VLMs) have demonstrated strong capabilities in understanding visual content, yet their ability to predict where humans look on user interfaces remains unexplored. We present UIGaze, a study investigating how closely…

Human-Computer Interaction · Computer Science 2026-04-30 Min Song , Yoonseong Lee , Yeonhu Seo

Medical image segmentation remains challenging due to the high cost of pixel-level annotations for training. In the context of weak supervision, clinician gaze data captures regions of diagnostic interest; however, its sparsity limits its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingkun Chen , Haoran Duan , Xiao Zhang , Boyan Gao , Vicente Grau , Jungong Han

Gaze estimation is instrumental in modern virtual reality (VR) systems. Despite significant progress in remote-camera gaze estimation, VR gaze research remains constrained by data scarcity, particularly the lack of large-scale, accurately…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Gil Shapira , Ishay Goldin , Evgeny Artyomov , Donghoon Kim , Yosi Keller , Niv Zehngut

Effective assisted living environments must be able to perform inferences on how their occupants interact with one another as well as with surrounding objects. To accomplish this goal using a vision-based automated approach, multiple tasks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Philipe A. Dias , Damiano Malafronte , Henry Medeiros , Francesca Odone

Following the gaze of other people and analyzing the target they are looking at can help us understand what they are thinking, and doing, and predict the actions that may follow. Existing methods for gaze following struggle to perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Feiyang Liu , Dan Guo , Jingyuan Xu , Zihao He , Shengeng Tang , Kun Li , Meng Wang

Intention prediction has become a relevant field of research in Human-Machine and Human-Robot Interaction. Indeed, any artificial system (co)-operating with and along humans, designed to assist and coordinate its actions with a human…

Robotics · Computer Science 2025-03-20 Anna Belardinelli

The visual focus of attention (VFOA) has been recognized as a prominent conversational cue. We are interested in estimating and tracking the VFOAs associated with multi-party social interactions. We note that in this type of situations the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Benoît Massé , Silèye Ba , Radu Horaud

What does human gaze reveal about a users' intents and to which extend can these intents be inferred or even visualized? Gaze was proposed as an implicit source of information to predict the target of visual search and, more recently, to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Hosnieh Sattar , Mario Fritz , Andreas Bulling

Unconstrained remote gaze tracking using off-the-shelf cameras is a challenging problem. Recently, promising algorithms for appearance-based gaze estimation using convolutional neural networks (CNN) have been proposed. Improving their…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Rajeev Ranjan , Shalini De Mello , Jan Kautz

Automated estimation of the allocation of a driver's visual attention may be a critical component of future Advanced Driver Assistance Systems. In theory, vision-based tracking of the eye can provide a good estimate of gaze location. In…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Lex Fridman , Philipp Langhans , Joonbum Lee , Bryan Reimer

Human-machine interaction through augmented reality (AR) and virtual reality (VR) is increasingly prevalent, requiring accurate and efficient gaze estimation which hinges on the accuracy of eye segmentation to enable smooth user…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Zhengyuan Peng , Jianqing Xu , Shen Li , Jiazhen Ji , Yuge Huang , Jingyun Zhang , Jinmin Li , Shouhong Ding , Rizen Guo , Xin Tan , Lizhuang Ma

Eye-tracking technology is an integral component of new display devices such as virtual and augmented reality headsets. Applications of gaze information range from new interaction techniques exploiting eye patterns to gaze-contingent…

Human-Computer Interaction · Computer Science 2022-05-05 Elena Arabadzhiyska , Cara Tursun , Hans-Peter Seidel , Piotr Didyk

A person's gaze offers valuable insights into their focus of attention, level of social engagement, and confidence. In this work, we investigate how contextual cues combined with visual scene and facial information can be effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Surbhi Madan , Shreya Ghosh , Ramanathan Subramanian , Abhinav Dhall , Tom Gedeon

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

Fine-grained image analysis (FGIA) is a longstanding and fundamental problem in computer vision and pattern recognition, and underpins a diverse set of real-world applications. The task of FGIA targets analyzing visual objects from…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Xiu-Shen Wei , Yi-Zhe Song , Oisin Mac Aodha , Jianxin Wu , Yuxin Peng , Jinhui Tang , Jian Yang , Serge Belongie

In this paper a number of problems are considered which are related to the modelling of eye guidance under visual attention in a natural setting. From a crude discussion of a variety of available models spelled in probabilistic terms, it…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Giuseppe Boccignone

Gaze following and social gaze prediction are fundamental tasks providing insights into human communication behaviors, intent, and social interactions. Most previous approaches addressed these tasks separately, either by designing highly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Anshul Gupta , Samy Tafasca , Arya Farkhondeh , Pierre Vuillecard , Jean-Marc Odobez