English
Related papers

Related papers: Gaze Prediction in Virtual Reality Without Eye Tra…

200 papers

Eye gaze estimation has become increasingly significant in computer vision.In this paper,we systematically study the mainstream of eye gaze estimation methods,propose a novel methodology to estimate eye gaze points and eye gaze directions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yong Huang , Ben Chen , Daiming Qu

State-of-the-art appearance-based gaze estimation methods, usually based on deep learning techniques, mainly rely on static features. However, temporal trace of eye gaze contains useful information for estimating a given gaze point. For…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Cristina Palmero , Oleg V. Komogortsev , Sachin S. Talathi

By borrowing the wisdom of human in gaze following, we propose a two-stage solution for gaze point prediction of the target persons in a scene. Specifically, in the first stage, both head image and its position are fed into a gaze direction…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Dongze Lian , Zehao Yu , Shenghua Gao

Predicting user intentions in virtual reality (VR) is crucial for creating immersive experiences, particularly in tasks involving complex grasping motions where accurate haptic feedback is essential. In this work, we leverage time-series…

Human-Computer Interaction · Computer Science 2025-08-26 Linghao Zeng

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

Human gaze is a crucial cue used in various applications such as human-robot interaction and virtual reality. Recently, convolution neural network (CNN) approaches have made notable progress in predicting gaze direction. However, estimating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Ahmed A. Abdelrahman , Thorsten Hempel , Aly Khalifa , Ayoub Al-Hamadi

Virtual Reality (VR) has been a beneficial training tool in fields such as advanced manufacturing. However, users may experience a high cognitive load due to various factors, such as the use of VR hardware or tasks within the VR…

Human-Computer Interaction · Computer Science 2024-11-21 Mahsa Nasri , Mehmet Kosa , Leanne Chukoskie , Mohsen Moghaddam , Casper Harteveld

Virtual Reality (VR) sickness commonly known as cybersickness is one of the major problems for the comfortable use of VR systems. Researchers have proposed different approaches for predicting cybersickness from bio-physiological data (e.g.,…

Human-Computer Interaction · Computer Science 2021-08-17 Rifatul Islam , Kevin Desai , John Quarles

Volumetric video, also known as hologram video, is a novel medium that portrays natural content in Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It is expected to be the next-gen video technology and a prevalent use…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Jie Li , Zhixin Li , Zhi Liu , Pengyuan Zhou , Richang Hong , Qiyue Li , Han Hu

The challenge of navigation in environments with dynamic objects continues to be a central issue in the study of autonomous agents. While predictive methods hold promise, their reliance on precise state information makes them less practical…

Robotics · Computer Science 2024-10-28 Hsuan-Kung Yang , Tsung-Chih Chiang , Ting-Ru Liu , Chun-Wei Huang , Jou-Min Liu , Chun-Yi Lee

Body actions and head gestures are natural interfaces for interaction in virtual environments. Existing methods for in-place body action recognition often require hardware more than a head-mounted display (HMD), making body action…

Human-Computer Interaction · Computer Science 2023-02-28 Jingbo Zhao , Mingjun Shao , Yaojun Wang , Ruolin Xu

Eye gaze, encompassing fixations and saccades, provides critical insights into human intentions and future actions. This study introduces a gaze-regularized framework that enhances Vision Language Models (VLMs) for egocentric behavior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Anupam Pani , Yanchao Yang

With the rapid development and widespread application of VR/AR technology, maximizing the quality of immersive panoramic video services that match users' personal preferences and habits has become a long-standing challenge. Understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yutong Xu , Junhao Du , Jiahe Wang , Yuwei Ning , Sihan Zhou Yang Cao

3D and 2D gaze estimation share the fundamental objective of capturing eye movements but are traditionally treated as two distinct research domains. In this paper, we introduce a novel cross-task few-shot 2D gaze estimation approach, aiming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yihua Cheng , Hengfei Wang , Zhongqun Zhang , Yang Yue , Bo Eun Kim , Feng Lu , Hyung Jin Chang

This paper presents a method that utilizes multiple camera views for the gaze target estimation (GTE) task. The approach integrates information from different camera views to improve accuracy and expand applicability, addressing limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Qiaomu Miao , Vivek Raju Golani , Jingyi Xu , Progga Paromita Dutta , Minh Hoai , Dimitris Samaras

Eye movement prediction is a promising area of research with the potential to improve performance and the user experience of systems based on eye-tracking technology. In this study, we analyze individual differences in gaze prediction…

Human-Computer Interaction · Computer Science 2025-01-30 Kateryna Melnyk , Lee Friedman , Dmytro Katrychuk , Oleg Komogortsev

Eye Tracking (ET) can help to understand visual attention and cognitive processes in interactive environments. In attention tasks, distinguishing between relevant target objects and distractors is crucial for effective performance, yet the…

Human-Computer Interaction · Computer Science 2025-08-29 Abdul Rehman , Ilona Heldal , Jerry Chun-Wei Lin

Eye tracking has been found to be useful in various tasks including diagnostic and screening tools. However, traditional eye trackers had a complicated setup and operated at a higher frequency to measure eye movements. The use of more…

Human-Computer Interaction · Computer Science 2025-03-13 Teran Bukenberger , Brent Davis

In recent years, Virtual Reality (VR) Head-Mounted Displays (HMD) have been used to provide an immersive, first-person view in real-time for the remote-control of Unmanned Ground Vehicles (UGV). One critical issue is that it is challenging…

Human-Computer Interaction · Computer Science 2022-01-11 Yiming Luo , Jialin Wang , Rongkai Shi , Hai-Ning Liang , Shan Luo

Visual gaze estimation, with its wide-ranging application scenarios, has garnered increasing attention within the research community. Although existing approaches infer gaze solely from image signals, recent advances in visual-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jun Wang , Hao Ruan , Liangjian Wen , Yong Dai , Mingjie Wang