English
Related papers

Related papers: Deep semantic gaze embedding and scanpath comparis…

200 papers

Predicting human gaze behavior within computer vision is integral for developing interactive systems that can anticipate user attention, address fundamental questions in cognitive science, and hold implications for fields like…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Akash Awasthi , Ngan Le , Zhigang Deng , Rishi Agrawal , Carol C. Wu , Hien Van Nguyen

Purpose: As visual inspection is an inherent process during radiological screening, the associated eye gaze data can provide valuable insights into relevant clinical decisions. As deep learning has become the state-of-the-art for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Zirui Qiu , Hassan Rivaz , Yiming Xiao

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Video-based gaze estimation methods aim to capture the inherently temporal dynamics of human eye gaze from multiple image frames. However, since models must capture both spatial and temporal relationships, performance is limited by the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Alexandre Personnic , Mihai Bâce

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Image thumbnails are a valuable data source for fixation filtering, scanpath classification, and visualization of eye tracking data. They are typically extracted with a constant size, approximating the foveated area. As a consequence, the…

Human-Computer Interaction · Computer Science 2024-04-30 Maurice Koch , Nelusa Pathmanathan , Daniel Weiskopf , Kuno Kurzhals

Representations learned by convolutional neural networks (CNNs) exhibit a remarkable resemblance to information processing patterns observed in the primate visual system on large neuroimaging datasets collected under diverse, naturalistic…

Neurons and Cognition · Quantitative Biology 2026-03-16 Dora Gozukara , Nasir Ahmad , Katja Seeliger , Djamari Oetringer , Linda Geerligs

Automatic detection of cognates helps downstream NLP tasks of Machine Translation, Cross-lingual Information Retrieval, Computational Phylogenetics and Cross-lingual Named Entity Recognition. Previous approaches for the task of cognate…

Computation and Language · Computer Science 2021-12-16 Diptesh Kanojia , Prashant Sharma , Sayali Ghodekar , Pushpak Bhattacharyya , Gholamreza Haffari , Malhar Kulkarni

In this paper, we present two approaches and algorithms that adapt areas of interest We present a new deep neural network (DNN) that can be used to directly determine gaze position using EEG data. EEG-based eye tracking is a new and…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Wolfgang Fuhl , Susanne Zabel , Theresa Harbig , Julia Astrid Moldt , Teresa Festl Wiete , Anne Herrmann Werner , Kay Nieselt

In real-world scene perception human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional…

Neurons and Cognition · Quantitative Biology 2022-08-15 Lisa Schwetlick , Daniel Backhaus , Ralf Engbert

In the field of dentistry, there is a growing demand for increased precision in diagnostic tools, with a specific focus on advanced imaging techniques such as computed tomography, cone beam computed tomography, magnetic resonance imaging,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Walid Brahmi , Imen Jdey , Fadoua Drira

Convolutional neural networks (CNNs) are used in many areas of computer vision, such as object tracking and recognition, security, military, and biomedical image analysis. This review presents the application of convolutional neural…

Deep Learning models like Convolutional Neural Networks (CNN) are powerful image classifiers, but what factors determine whether they attend to similar image areas as humans do? While previous studies have focused on technological factors,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Romy Müller , Marcel Dürschmidt , Julian Ullrich , Carsten Knoll , Sascha Weber , Steffen Seitz

In humans and in foveated animals visual acuity is highly concentrated at the center of gaze, so that choosing where to look next is an important example of online, rapid decision making. Computational neuroscientists have developed…

Neurons and Cognition · Quantitative Biology 2014-12-05 Ralf Engbert , Hans A. Trukenbrod , Simon Barthelmé , Felix A. Wichmann

Recent work in XAI for eye tracking data has evaluated the suitability of feature attribution methods to explain the output of deep neural sequence models for the task of oculomotric biometric identification. These methods provide saliency…

Machine Learning · Computer Science 2023-04-27 Daniel G. Krakowczyk , Paul Prasse , David R. Reich , Sebastian Lapuschkin , Tobias Scheffer , Lena A. Jäger

Unconstrained remote gaze tracking using off-the-shelf cameras is a challenging problem. Recently, promising algorithms for appearance-based gaze estimation using convolutional neural networks (CNN) have been proposed. Improving their…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Rajeev Ranjan , Shalini De Mello , Jan Kautz

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-03 Linchuan Xu , Jun Huang , Atsushi Nitanda , Ryo Asaoka , Kenji Yamanishi

Photosensor oculography (PS-OG) eye movement sensors offer desirable performance characteristics for integration within wireless head mounted devices (HMDs), including low power consumption and high sampling rates. To address the known…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Henry K. Griffith , Dmytro Katrychuk , Oleg V. Komogortsev

Eye tracking research is important in computer vision because it can help us understand how humans interact with the visual world. Specifically for high-risk applications, such as in medical imaging, eye tracking can help us to comprehend…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Bin Wang , Hongyi Pan , Armstrong Aboah , Zheyuan Zhang , Elif Keles , Drew Torigian , Baris Turkbey , Elizabeth Krupinski , Jayaram Udupa , Ulas Bagci

The attention mechanisms in deep neural networks are inspired by human's attention that sequentially focuses on the most relevant parts of the information over time to generate prediction output. The attention parameters in those models are…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Youngjae Yu , Jongwook Choi , Yeonhwa Kim , Kyung Yoo , Sang-Hun Lee , Gunhee Kim