English
Related papers

Related papers: Gaze Perception in Humans and CNN-Based Model

200 papers

Human gaze is a crucial cue used in various applications such as human-robot interaction and virtual reality. Recently, convolution neural network (CNN) approaches have made notable progress in predicting gaze direction. However, estimating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Ahmed A. Abdelrahman , Thorsten Hempel , Aly Khalifa , Ayoub Al-Hamadi

Humans actively observe the visual surroundings by focusing on salient objects and ignoring trivial details. However, computer vision models based on convolutional neural networks (CNN) often analyze visual input all at once through a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Minkyu Choi , Yizhen Zhang , Kuan Han , Xiaokai Wang , Zhongming Liu

The existing computational visual attention systems have focused on the objective to basically simulate and understand the concept of visual attention system in adults. Consequently, the impact of observer's age in scene viewing behavior…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Onkar Krishna , Kiyoharu Aizawa , Go Irie

Joint visual attention is characterized by two or more individuals looking at a common target at the same time. The ability to identify joint attention in scenes, the people involved, and their common target, is fundamental to the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Daniel Harari , Joshua B. Tenenbaum , Shimon Ullman

Modern machine learning models for computer vision exceed humans in accuracy on specific visual recognition tasks, notably on datasets like ImageNet. However, high accuracy can be achieved in many ways. The particular decision function…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Shikhar Tuli , Ishita Dasgupta , Erin Grant , Thomas L. Griffiths

Visual attention is a mechanism closely intertwined with vision and memory. Top-down information influences visual processing through attention. We designed a neural network model inspired by aspects of human visual attention. This model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruoyang Hu , Robert A. Jacobs

Human visual system can selectively attend to parts of a scene for quick perception, a biological mechanism known as Human attention. Inspired by this, recent deep learning models encode attention mechanisms to focus on the most…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Qiuxia Lai , Salman Khan , Yongwei Nie , Jianbing Shen , Hanqiu Sun , Ling Shao

Online social networks contain a constantly increasing amount of images - most of them focusing on people. Due to cultural and climate factors, fashion trends and physical appearance of individuals differ from city to city. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2018-02-01 Kaili Wang , Yu-Hui Huang , Jose Oramas , Luc Van Gool , Tinne Tuytelaars

Recognizing the actions of others from visual stimuli is a crucial aspect of human visual perception that allows individuals to respond to social cues. Humans are able to identify similar behaviors and discriminate between distinct actions…

Neurons and Cognition · Quantitative Biology 2018-02-07 Andrea Tacchetti , Leyla Isik , Tomaso Poggio

Advancements in convolutional neural networks (CNNs) have made significant strides toward achieving high performance levels on multiple object recognition tasks. While some approaches utilize information from the entire scene to propose…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Kevin Wu , Eric Wu , Gabriel Kreiman

Following the gaze of people inside videos is an important signal for understanding people and their actions. In this paper, we present an approach for following gaze across views by predicting where a particular person is looking…

Computer Vision and Pattern Recognition · Computer Science 2016-12-12 Adrià Recasens , Carl Vondrick , Aditya Khosla , Antonio Torralba

In the task of Object Recognition, there exists a dichotomy between the categorization of objects and estimating object pose, where the former necessitates a view-invariant representation, while the latter requires a representation capable…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Mohamed Elhoseiny , Tarek El-Gaaly , Amr Bakry , Ahmed Elgammal

Gaze target detection aims to predict the image location where the person is looking and the probability that a gaze is out of the scene. Several works have tackled this task by regressing a gaze heatmap centered on the gaze location,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Francesco Tonini , Nicola Dall'Asen , Cigdem Beyan , Elisa Ricci

Human eye gaze plays an important role in delivering information, communicating intent, and understanding others' mental states. Previous research shows that a robot's gaze can also affect humans' decision-making and strategy during an…

Robotics · Computer Science 2022-08-26 Di Fu , Fares Abawi , Erik Strahl , Stefan Wermter

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

In this work, we address two coupled tasks of gaze prediction and action recognition in egocentric videos by exploring their mutual context. Our assumption is that in the procedure of performing a manipulation task, what a person is doing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yifei Huang , Zhenqiang Li , Minjie Cai , Yoichi Sato

Data-driven saliency has recently gained a lot of attention thanks to the use of Convolutional Neural Networks for predicting gaze fixations. In this paper we go beyond standard approaches to saliency prediction, in which gaze maps are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

How similar is the human mind to the sophisticated machine-learning systems that mirror its performance? Models of object categorization based on convolutional neural networks (CNNs) have achieved human-level benchmarks in assigning known…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Zhenglong Zhou , Chaz Firestone

It is well known that human gaze carries significant information about visual attention. However, there are three main difficulties in incorporating the gaze data in an attention mechanism of deep neural networks: 1) the gaze fixation…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kyle Min , Jason J. Corso

Human affordance learning investigates contextually relevant novel pose prediction such that the estimated pose represents a valid human action within the scene. While the task is fundamental to machine perception and automated interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Prasun Roy , Saumik Bhattacharya , Subhankar Ghosh , Umapada Pal , Michael Blumenstein