English
Related papers

Related papers: Actions in the Eye: Dynamic Gaze Datasets and Lear…

200 papers

Distinguishing target from non-target fixations during visual search is a fundamental building block to understand users' intended actions and to build effective assistance systems. While prior research indicated the feasibility of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Mansi Sharma , Camilo Andrés Martínez Martínez , Benedikt Emanuel Wirth , Antonio Krüger , Philipp Müller

In this work, we present a novel dataset consisting of eye movements and verbal descriptions recorded synchronously over images. Using this data, we study the differences in human attention during free-viewing and image captioning tasks. We…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Sen He , Hamed R. Tavakoli , Ali Borji , Nicolas Pugeault

Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Karan Uppal , Jaeah Kim , Shashank Singh

Data-driven saliency detection has attracted strong interest as a result of applying convolutional neural networks to the detection of eye fixations. Although a number of imagebased salient object and fixation detection models have been…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Meijun Sun , Ziqi Zhou , QinGhua Hu , Zheng Wang , Jianmin Jiang

Eye contact is a crucial element of non-verbal communication that signifies interest, attention, and participation in social interactions. As a result, measures of eye contact arise in a variety of applications such as the assessment of the…

Human-Computer Interaction · Computer Science 2019-02-05 Eunji Chong , Katha Chanda , Zhefan Ye , Audrey Southerland , Nataniel Ruiz , Rebecca M. Jones , Agata Rozga , James M. Rehg

The application of psychophysiologicy in human-computer interaction is a growing field with significant potential for future smart personalised systems. Working in this emerging field requires comprehension of an array of physiological…

Human-Computer Interaction · Computer Science 2016-09-26 Kristian Lukander

Understanding human actions in visual data is tied to advances in complementary research areas including object recognition, human dynamics, domain adaptation and semantic segmentation. Over the last decade, human action analysis evolved…

Computer Vision and Pattern Recognition · Computer Science 2017-02-02 Samitha Herath , Mehrtash Harandi , Fatih Porikli

A plethora of research in the literature shows how human eye fixation pattern varies depending on different factors, including genetics, age, social functioning, cognitive functioning, and so on. Analysis of these variations in visual…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shafin Rahman , Sejuti Rahman , Omar Shahid , Md. Tahmeed Abdullah , Jubair Ahmed Sourov

Recent studies in the field of human vision science suggest that the human responses to the stimuli on a visual display are non-deterministic. People may attend to different locations on the same visual input at the same time. Based on this…

Computer Vision and Pattern Recognition · Computer Science 2015-03-13 Akisato kimura , Derek Pang , Tatsuto Takeuchi , Kouji Miyazato , Junji Yamato , Kunio Kashino

Visual Attention Models (VAMs) predict the location of an image or video regions that are most likely to attract human attention. Although saliency detection is well explored for 2D image and video content, there are only few attempts made…

Image and Video Processing · Electrical Eng. & Systems 2018-03-14 Amin Banitalebi-Dehkordi , Eleni Nasiopoulos , Mahsa T. Pourazad , Panos Nasiopoulos

The Human visual perception of the world is of a large fixed image that is highly detailed and sharp. However, receptor density in the retina is not uniform: a small central region called the fovea is very dense and exhibits high…

Computer Vision and Pattern Recognition · Computer Science 2017-01-26 Alon Hazan , Yuval Harel , Ron Meir

Face Emotion Recognition (FER) is essential for social interactions and understanding others' mental states. Utilizing eye tracking to investigate FER has yielded insights into cognitive processes. In this study, we utilized an…

Human-Computer Interaction · Computer Science 2025-03-21 Meisam J. Seikavandi , Maria J. Barrett , Paolo Burelli

Most existing attention prediction research focuses on salient instances like humans and objects. However, the more complex interaction-oriented attention, arising from the comprehension of interactions between instances by human observers,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Yuchen Zhou , Linkai Liu , Chao Gou

In real-world scene perception human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional…

Neurons and Cognition · Quantitative Biology 2022-08-15 Lisa Schwetlick , Daniel Backhaus , Ralf Engbert

We present a new public dataset with a focus on simulating robotic vision tasks in everyday indoor environments using real imagery. The dataset includes 20,000+ RGB-D images and 50,000+ 2D bounding boxes of object instances densely captured…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Phil Ammirato , Patrick Poirson , Eunbyung Park , Jana Kosecka , Alexander C. Berg

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

Eye movements are intricate and dynamic events that contain a wealth of information about the subject and the stimuli. We propose an abstract representation of eye movements that preserve the important nuances in gaze behavior while being…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Louise Gillian C. Bautista , Prospero C. Naval

We study the ability of human observer to control fixation duration during execution of visual search tasks. We conducted the eye-tracking experiments with natural and synthetic images and found the dependency of fixation duration on…

Neurons and Cognition · Quantitative Biology 2020-04-24 Alexander Vasilyev

Human affect recognition has been a significant topic in psychophysics and computer vision. However, the currently published datasets have many limitations. For example, most datasets contain frames that contain only information about…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Zhihang Ren , Jefferson Ortega , Yifan Wang , Zhimin Chen , Yunhui Guo , Stella X. Yu , David Whitney

Dogs have a unique evolutionary relationship with humans and serve many important roles e.g. search and rescue, blind assistance, emotional support. However, few datasets exist to categorize visual features and objects available to dogs, as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shreyas Sundara Raman , Madeline H. Pelgrim , Daphna Buchsbaum , Thomas Serre