English
Related papers

Related papers: Modeling Human Eye Movements with Neural Networks …

200 papers

Comprehensively interpreting human behavior is a core challenge in human-aware artificial intelligence. However, prior works typically focused on body behavior, neglecting the crucial role of eye gaze and its synergy with body motion. We…

Human-Computer Interaction · Computer Science 2025-11-21 Qing Chang , Zhiming Hu

Understanding how people behave in strategic settings--where they make decisions based on their expectations about the behavior of others--is a long-standing problem in the behavioral sciences. We conduct the largest study to date of…

General Economics · Economics 2024-08-16 Jian-Qiao Zhu , Joshua C. Peterson , Benjamin Enke , Thomas L. Griffiths

Popular computational models of visual attention tend to neglect the influence of saccadic eye movements whereas it has been shown that the primates perform on average three of them per seconds and that the neural substrate for the…

Neural and Evolutionary Computing · Computer Science 2008-09-29 Jérémy Fix , Nicolas P. Rougier , Frédéric Alexandre

The primary objective of the dataset is to provide a better understanding of the coupling between human actions and gaze in a shared working environment with a cobot, with the aim of signifcantly enhancing the effciency and safety of…

Robotics · Computer Science 2025-03-17 Maxence Grand , Damien Pellier , Francis Jambon

Understanding what makes a video memorable has important applications in advertising or education technology. Towards this goal, we investigate spatio-temporal attention mechanisms underlying video memorability. Different from previous…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Prajneya Kumar , Eshika Khandelwal , Makarand Tapaswi , Vishnu Sreekumar

Imitation learning for acquiring generalizable policies often requires a large volume of demonstration data, making the process significantly costly. One promising strategy to address this challenge is to leverage the cognitive and…

Robotics · Computer Science 2025-06-09 Yutaro Ishida , Takamitsu Matsubara , Takayuki Kanai , Kazuhiro Shintani , Hiroshi Bito

Humans have consciousness as the ability to perceive events and objects: a mental model of the world developed from the most impoverished of visual stimuli, enabling humans to make rapid decisions and take actions. Although spatial and…

Artificial Intelligence · Computer Science 2018-11-06 Lisheng Wu , Minne Li , Jun Wang

A user's eyes provide means for Human Computer Interaction (HCI) research as an important modal. The time to time scientific explorations of the eye has already seen an upsurge of the benefits in HCI applications from gaze estimation to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Atul Sahay , Imon Mukherjee , Kavi Arya

In imitation learning for robotic manipulation, decomposing object manipulation tasks into sub-tasks enables the reuse of learned skills and the combination of learned behaviors to perform novel tasks, rather than simply replicating…

Robotics · Computer Science 2025-02-28 Ryo Takizawa , Yoshiyuki Ohmura , Yasuo Kuniyoshi

This investigates the relationship between eye fixation patterns and performance in Java programming exercises using eye-tracking technology. Thirty-one students from a university in Metro Manila participated, and their eye movements were…

Human-Computer Interaction · Computer Science 2025-04-21 Michael T. Lopez

This paper digs deeper into factors that influence egocentric gaze. Instead of training deep models for this purpose in a blind manner, we propose to inspect factors that contribute to gaze guidance during daily tasks. Bottom-up saliency…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Hamed R. Tavakoli , Esa Rahtu , Juho Kannala , Ali Borji

Humans can naturally and effectively find salient regions in complex scenes. Motivated by this observation, attention mechanisms were introduced into computer vision with the aim of imitating this aspect of the human visual system. Such an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Meng-Hao Guo , Tian-Xing Xu , Jiang-Jiang Liu , Zheng-Ning Liu , Peng-Tao Jiang , Tai-Jiang Mu , Song-Hai Zhang , Ralph R. Martin , Ming-Ming Cheng , Shi-Min Hu

Human capabilities in understanding visual relations are far superior to those of AI systems, especially for previously unseen objects. For example, while AI systems struggle to determine whether two such objects are visually the same or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Oleh Kolner , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

Human-centred systems require an understanding of human actions in the physical world. Temporally extended sequences of actions are intentional and structured, yet existing methods for recognising what actions are performed often do not…

Artificial Intelligence · Computer Science 2026-04-21 Rimvydas Rubavicius , Manisha Dubey , N. Siddharth , Subramanian Ramamoorthy

Humans intuitively recognize objects' physical properties and predict their motion, even when the objects are engaged in complicated interactions. The abilities to perform physical reasoning and to adapt to new environments, while intrinsic…

Machine Learning · Computer Science 2020-06-30 Yunzhu Li , Toru Lin , Kexin Yi , Daniel M. Bear , Daniel L. K. Yamins , Jiajun Wu , Joshua B. Tenenbaum , Antonio Torralba

Visual search is a ubiquitous and often challenging daily task, exemplified by looking for the car keys at home or a friend in a crowd. An intriguing property of some classical search tasks is an asymmetry such that finding a target A among…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Shashi Kant Gupta , Mengmi Zhang , Chia-Chien Wu , Jeremy M. Wolfe , Gabriel Kreiman

Human motion prediction from historical pose sequence is at the core of many applications in machine intelligence. However, in current state-of-the-art methods, the predicted future motion is confined within the same activity. One can…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Zhenguang Liu , Kedi Lyu , Shuang Wu , Haipeng Chen , Yanbin Hao , Shouling Ji

Eye-gaze tracking research offers significant promise in enhancing various healthcare-related tasks, above all in medical image analysis and interpretation. Eye tracking, a technology that monitors and records the movement of the eyes,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Sahar Moradizeyveh , Mehnaz Tabassum , Sidong Liu , Robert Ahadizad Newport , Amin Beheshti , Antonio Di Ieva

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

To design data visualizations that are easy to comprehend, we need to understand how people with different interests read them. Computational models of predicting scanpaths on charts could complement empirical studies by offering estimates…

Human-Computer Interaction · Computer Science 2025-02-07 Danqing Shi , Yao Wang , Yunpeng Bai , Andreas Bulling , Antti Oulasvirta