English
Related papers

Related papers: Modeling Human Eye Movements with Neural Networks …

200 papers

Smooth and seamless robot navigation while interacting with humans depends on predicting human movements. Forecasting such human dynamics often involves modeling human trajectories (global motion) or detailed body joint movements (local…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Vida Adeli , Ehsan Adeli , Ian Reid , Juan Carlos Niebles , Hamid Rezatofighi

Visual search is an essential part of almost any everyday human goal-directed interaction with the environment. Nowadays, several algorithms are able to predict gaze positions during simple observation, but few models attempt to simulate…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 F. Travi , G. Ruarte , G. Bujia , J. E. Kamienkowski

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

Photo collections and its applications today attempt to reflect user interactions in various forms. Moreover, photo collections aim to capture the users' intention with minimum effort through applications capturing user intentions. Human…

Computer Vision and Pattern Recognition · Computer Science 2016-01-13 Jinsoo Choi , Tae-Hyun Oh , In So Kweon

We present a novel computational model employing hierarchical active inference to simulate reading and eye movements. The model characterizes linguistic processing as inference over a hierarchical generative model, facilitating predictions…

Neurons and Cognition · Quantitative Biology 2025-08-11 Francesco Donnarumma , Mirco Frosolone , Giovanni Pezzulo

Study of eye-movement is being employed in Human Computer Interaction (HCI) research. Eye - gaze tracking is one of the most challenging problems in the area of computer vision. The goal of this paper is to present a review of latest…

Computer Vision and Pattern Recognition · Computer Science 2013-12-24 H. R. Chennamma , Xiaohui Yuan

The eyes play an important role in human collaboration. Mutual and shared gaze help communicate visual attention to each other or to a specific object of interest. Shared gaze was typically investigated for pair collaborations in remote…

Making accurate inferences about other individuals' locus of attention is essential for human social interactions and will be important for AI to effectively interact with humans. In this study, we compare how a CNN (convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Nicole X. Han , William Yang Wang , Miguel P. Eckstein

Gaze following and social gaze prediction are fundamental tasks providing insights into human communication behaviors, intent, and social interactions. Most previous approaches addressed these tasks separately, either by designing highly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Anshul Gupta , Samy Tafasca , Arya Farkhondeh , Pierre Vuillecard , Jean-Marc Odobez

This report reviews recent advancements in human motion prediction, reconstruction, and generation. Human motion prediction focuses on forecasting future poses and movements from historical data, addressing challenges like nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Canxuan Gang , Yiran Wang

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

3D human motion prediction, predicting future poses from a given sequence, is an issue of great significance and challenge in computer vision and machine intelligence, which can help machines in understanding human behaviors. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Kedi Lyu , Haipeng Chen , Zhenguang Liu , Beiqi Zhang , Ruili Wang

Digitization is penetrating more and more areas of life. Tasks are increasingly being completed digitally, and are therefore not only fulfilled faster, more efficiently but also more purposefully and successfully. The rapid developments in…

Human-Computer Interaction · Computer Science 2022-02-10 Benedikt Hosp

Predicting human gaze scanpaths is crucial for understanding visual attention, with applications in human-computer interaction, autonomous systems, and cognitive robotics. While deep learning models have advanced scanpath prediction, most…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Giuseppe Cartella , Vittorio Cuculo , Alessandro D'Amelio , Marcella Cornia , Giuseppe Boccignone , Rita Cucchiara

Human eye gaze plays an important role in delivering information, communicating intent, and understanding others' mental states. Previous research shows that a robot's gaze can also affect humans' decision-making and strategy during an…

Robotics · Computer Science 2022-08-26 Di Fu , Fares Abawi , Erik Strahl , Stefan Wermter

Human motion modelling is a classical problem at the intersection of graphics and computer vision, with applications spanning human-computer interaction, motion synthesis, and motion prediction for virtual and augmented reality. Following…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Julieta Martinez , Michael J. Black , Javier Romero

Yarbus' claim to decode the observer's task from eye movements has received mixed reactions. In this paper, we have supported the hypothesis that it is possible to decode the task. We conducted an exploratory analysis on the dataset by…

Machine Learning · Computer Science 2019-07-31 Ayush Kumar , Anjul Tyagi , Michael Burch , Daniel Weiskopf , Klaus Mueller

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

Eye movements are intricate and dynamic events that contain a wealth of information about the subject and the stimuli. We propose an abstract representation of eye movements that preserve the important nuances in gaze behavior while being…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Louise Gillian C. Bautista , Prospero C. Naval

Effective assisted living environments must be able to perform inferences on how their occupants interact with one another as well as with surrounding objects. To accomplish this goal using a vision-based automated approach, multiple tasks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Philipe A. Dias , Damiano Malafronte , Henry Medeiros , Francesca Odone