English
Related papers

Related papers: Guiding human gaze with convolutional neural netwo…

200 papers

Humans represent scenes and objects in rich feature spaces, carrying information that allows us to generalise about category memberships and abstract functions with few examples. What determines whether a neural network model generalises…

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

Human vision is highly adaptive, efficiently sampling intricate environments by sequentially fixating on task-relevant regions. In contrast, prevailing machine vision models passively process entire scenes at once, resulting in excessive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yulin Wang , Yang Yue , Yang Yue , Huanqian Wang , Haojun Jiang , Yizeng Han , Zanlin Ni , Yifan Pu , Minglei Shi , Rui Lu , Qisen Yang , Andrew Zhao , Zhuofan Xia , Shiji Song , Gao Huang

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Creating high-quality and realistic images is now possible thanks to the impressive advancements in image generation. A description in natural language of your desired output is all you need to obtain breathtaking results. However, as the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Giuseppe Cartella , Vittorio Cuculo , Marcella Cornia , Rita Cucchiara

Gaze correction aims to redirect the person's gaze into the camera by manipulating the eye region, and it can be considered as a specific image resynthesis problem. Gaze correction has a wide range of applications in real life, such as…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jichao Zhang , Meng Sun , Jingjing Chen , Hao Tang , Yan Yan , Xueying Qin , Nicu Sebe

Many tasks in computer vision are often calibrated and evaluated relative to human perception. In this paper, we propose to directly approximate the perceptual function performed by human observers completing a visual detection task.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Alan Dolhasz , Carlo Harvey , Ian Williams

Deep convolutional neural networks (CNN) have revolutionized various fields of vision research and have seen unprecedented adoption for multiple tasks such as classification, detection, captioning, etc. However, they offer little…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Konda Reddy Mopuri , Utsav Garg , R. Venkatesh Babu

Visual attention is very an essential factor that affects how human perceives visual signals. This report investigates how distortions in an image could distract human's visual attention using Bayesian visual search models, specifically,…

Image and Video Processing · Electrical Eng. & Systems 2021-02-09 Zhengzhong Tu

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Joshua C. Peterson , Joshua T. Abbott , Thomas L. Griffiths

The human visual system processes images with varied degrees of resolution, with the fovea, a small portion of the retina, capturing the highest acuity region, which gradually declines toward the field of view's periphery. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Beatriz Paula , Plinio Moreno

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

In interactive object segmentation a user collaborates with a computer vision model to segment an object. Recent works employ convolutional neural networks for this task: Given an image and a set of corrections made by the user as input,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Theodora Kontogianni , Michael Gygli , Jasper Uijlings , Vittorio Ferrari

Visual illusions teach us that what we see is not always what it is represented in the physical world. Its special nature make them a fascinating tool to test and validate any new vision model proposed. In general, current vision models are…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Alexander Gomez-Villa , Adrián Martín , Javier Vazquez-Corral , Marcelo Bertalmío

The spreading of attention has been proposed as a mechanism for how humans group features to segment objects. However, such a mechanism has not yet been implemented and tested in naturalistic images. Here, we leverage the feature maps from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Hossein Adeli , Seoyoung Ahn , Nikolaus Kriegeskorte , Gregory Zelinsky

The field of collaborative robotics and human-robot interaction often focuses on the prediction of human behaviour, while assuming the information about the robot setup and configuration being known. This is often the case with fixed…

Robotics · Computer Science 2019-02-18 Justinas Miseikis , Inka Brijacak , Saeed Yahyanejad , Kyrre Glette , Ole Jakob Elle , Jim Torresen

We study the ability of human observer to control fixation duration during execution of visual search tasks. We conducted the eye-tracking experiments with natural and synthetic images and found the dependency of fixation duration on…

Neurons and Cognition · Quantitative Biology 2020-04-24 Alexander Vasilyev

Photo collections and its applications today attempt to reflect user interactions in various forms. Moreover, photo collections aim to capture the users' intention with minimum effort through applications capturing user intentions. Human…

Computer Vision and Pattern Recognition · Computer Science 2016-01-13 Jinsoo Choi , Tae-Hyun Oh , In So Kweon

In this paper a number of problems are considered which are related to the modelling of eye guidance under visual attention in a natural setting. From a crude discussion of a variety of available models spelled in probabilistic terms, it…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Giuseppe Boccignone

Previous work on predicting the target of visual search from human fixations only considered closed-world settings in which training labels are available and predictions are performed for a known set of potential targets. In this work we go…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Hosnieh Sattar , Sabine Müller , Mario Fritz , Andreas Bulling