English
Related papers

Related papers: LNSMM: Eye Gaze Estimation With Local Network Shar…

200 papers

World-wide-web, with the website and webpage as the main interface, facilitates the dissemination of important information. Hence it is crucial to optimize them for better user interaction, which is primarily done by analyzing users'…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Ciheng Zhang , Decky Aspandi , Steffen Staab

Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-regularized framework that enhances VLMs for two key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Anupam Pani , Yanchao Yang

Joint visual attention is characterized by two or more individuals looking at a common target at the same time. The ability to identify joint attention in scenes, the people involved, and their common target, is fundamental to the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Daniel Harari , Joshua B. Tenenbaum , Shimon Ullman

Multi-task-learning(MTL) is a multi-target optimization task. Neural networks try to realize each target using a shared interpretative space within MTL. However, as the scale of datasets expands and the complexity of tasks increases,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ruiyuan Zhang , Yuyao Chen , Yuchi Huo , Jiaxiang Liu , Dianbing Xi , Jie Liu , Chao Wu

Introduction: In the realm of human-computer interaction and behavioral research, accurate real-time gaze estimation is critical. Traditional methods often rely on expensive equipment or large datasets, which are impractical in many…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Esther Enhui Ye , John Enzhou Ye , Joseph Ye , Jacob Ye , Runzhou Ye

Multiple datasets have been created for training and testing appearance-based gaze estimators. Intuitively, more data should lead to better performance. However, combining datasets to train a single esti-mator rarely improves gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Liang Wu , Bertram E. Shi

The task of predicting 3D eye gaze from eye images can be performed either by (a) end-to-end learning for image-to-gaze mapping or by (b) fitting a 3D eye model onto images. The former case requires 3D gaze labels, while the latter requires…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Nikola Popovic , Dimitrios Christodoulou , Danda Pani Paudel , Xi Wang , Luc Van Gool

Gaze redirection is the task of changing the gaze to a desired direction for a given monocular eye patch image. Many applications such as videoconferencing, films, games, and generation of training data for gaze estimation require…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Zhe He , Adrian Spurr , Xucong Zhang , Otmar Hilliges

Gaze and face tracking algorithms have traditionally battled a compromise between computational complexity and accuracy; the most accurate neural net algorithms cannot be implemented in real time, but less complex real-time algorithms…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 George He , Sami Oueida , Tucker Ward

Despite recent advances in appearance-based gaze estimation techniques, the need for training data that covers the target head pose and gaze distribution remains a crucial challenge for practical deployment. This work examines a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Jiawei Qin , Takuru Shimoyama , Yusuke Sugano

With the escalated demand of human-machine interfaces for intelligent systems, development of gaze controlled system have become a necessity. Gaze, being the non-intrusive form of human interaction, is one of the best suited approach.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Somsukla Maiti , Akshansh Gupta

From smoothly pursuing moving objects to rapidly shifting gazes during visual search, humans employ a wide variety of eye movement strategies in different contexts. While eye movements provide a rich window into mental processes, building…

Machine Learning · Computer Science 2022-12-21 Jason Li , Nicholas Watters , Yingting , Wang , Hansem Sohn , Mehrdad Jazayeri

Human eye gaze detection plays an important role in various fields, including human-computer interaction, virtual reality and cognitive science. Although different relatively accurate systems of eye tracking and gaze detection exist, they…

Human-Computer Interaction · Computer Science 2017-09-13 Ehsan Arbabi , Mohammad Shabani , Ali Yarigholi

This paper addresses the gaze target detection problem in single images captured from the third-person perspective. We present a multimodal deep architecture to infer where a person in a scene is looking. This spatial model is trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Francesco Tonini , Cigdem Beyan , Elisa Ricci

Eye trackers can provide visual guidance to sonographers during ultrasound (US) scanning. Such guidance is potentially valuable for less experienced operators to improve their scanning skills on how to manipulate the probe to achieve the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Qianhui Men , Clare Teng , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

3D and 2D gaze estimation share the fundamental objective of capturing eye movements but are traditionally treated as two distinct research domains. In this paper, we introduce a novel cross-task few-shot 2D gaze estimation approach, aiming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yihua Cheng , Hengfei Wang , Zhongqun Zhang , Yang Yue , Bo Eun Kim , Feng Lu , Hyung Jin Chang

Unconstrained remote gaze tracking using off-the-shelf cameras is a challenging problem. Recently, promising algorithms for appearance-based gaze estimation using convolutional neural networks (CNN) have been proposed. Improving their…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Rajeev Ranjan , Shalini De Mello , Jan Kautz

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

This paper addresses the challenge of training a single network to jointly perform multiple dense prediction tasks, such as segmentation and depth estimation, i.e., multi-task learning (MTL). Current approaches mainly capture cross-task…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xiaoye Wang , Chen Tang , Xiangyu Yue , Wei-Hong Li

Purpose: As visual inspection is an inherent process during radiological screening, the associated eye gaze data can provide valuable insights into relevant clinical decisions. As deep learning has become the state-of-the-art for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Zirui Qiu , Hassan Rivaz , Yiming Xiao