中文
相关论文

相关论文: Deep semantic gaze embedding and scanpath comparis…

200 篇论文

Predicting human gaze behavior within computer vision is integral for developing interactive systems that can anticipate user attention, address fundamental questions in cognitive science, and hold implications for fields like…

图像与视频处理 · 电气工程与系统科学 2024-07-02 Akash Awasthi , Ngan Le , Zhigang Deng , Rishi Agrawal , Carol C. Wu , Hien Van Nguyen

Purpose: As visual inspection is an inherent process during radiological screening, the associated eye gaze data can provide valuable insights into relevant clinical decisions. As deep learning has become the state-of-the-art for…

图像与视频处理 · 电气工程与系统科学 2025-02-18 Zirui Qiu , Hassan Rivaz , Yiming Xiao

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

计算机视觉与模式识别 · 计算机科学 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Video-based gaze estimation methods aim to capture the inherently temporal dynamics of human eye gaze from multiple image frames. However, since models must capture both spatial and temporal relationships, performance is limited by the…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Alexandre Personnic , Mihai Bâce

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

计算机视觉与模式识别 · 计算机科学 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Image thumbnails are a valuable data source for fixation filtering, scanpath classification, and visualization of eye tracking data. They are typically extracted with a constant size, approximating the foveated area. As a consequence, the…

人机交互 · 计算机科学 2024-04-30 Maurice Koch , Nelusa Pathmanathan , Daniel Weiskopf , Kuno Kurzhals

Representations learned by convolutional neural networks (CNNs) exhibit a remarkable resemblance to information processing patterns observed in the primate visual system on large neuroimaging datasets collected under diverse, naturalistic…

神经元与认知 · 定量生物学 2026-03-16 Dora Gozukara , Nasir Ahmad , Katja Seeliger , Djamari Oetringer , Linda Geerligs

Automatic detection of cognates helps downstream NLP tasks of Machine Translation, Cross-lingual Information Retrieval, Computational Phylogenetics and Cross-lingual Named Entity Recognition. Previous approaches for the task of cognate…

In this paper, we present two approaches and algorithms that adapt areas of interest We present a new deep neural network (DNN) that can be used to directly determine gaze position using EEG data. EEG-based eye tracking is a new and…

信号处理 · 电气工程与系统科学 2023-03-13 Wolfgang Fuhl , Susanne Zabel , Theresa Harbig , Julia Astrid Moldt , Teresa Festl Wiete , Anne Herrmann Werner , Kay Nieselt

In real-world scene perception human observers generate sequences of fixations to move image patches into the high-acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two-dimensional…

神经元与认知 · 定量生物学 2022-08-15 Lisa Schwetlick , Daniel Backhaus , Ralf Engbert

In the field of dentistry, there is a growing demand for increased precision in diagnostic tools, with a specific focus on advanced imaging techniques such as computed tomography, cone beam computed tomography, magnetic resonance imaging,…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Walid Brahmi , Imen Jdey , Fadoua Drira

Convolutional neural networks (CNNs) are used in many areas of computer vision, such as object tracking and recognition, security, military, and biomedical image analysis. This review presents the application of convolutional neural…

Deep Learning models like Convolutional Neural Networks (CNN) are powerful image classifiers, but what factors determine whether they attend to similar image areas as humans do? While previous studies have focused on technological factors,…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Romy Müller , Marcel Dürschmidt , Julian Ullrich , Carsten Knoll , Sascha Weber , Steffen Seitz

In humans and in foveated animals visual acuity is highly concentrated at the center of gaze, so that choosing where to look next is an important example of online, rapid decision making. Computational neuroscientists have developed…

神经元与认知 · 定量生物学 2014-12-05 Ralf Engbert , Hans A. Trukenbrod , Simon Barthelmé , Felix A. Wichmann

Recent work in XAI for eye tracking data has evaluated the suitability of feature attribution methods to explain the output of deep neural sequence models for the task of oculomotric biometric identification. These methods provide saliency…

Unconstrained remote gaze tracking using off-the-shelf cameras is a challenging problem. Recently, promising algorithms for appearance-based gaze estimation using convolutional neural networks (CNN) have been proposed. Improving their…

计算机视觉与模式识别 · 计算机科学 2018-04-24 Rajeev Ranjan , Shalini De Mello , Jan Kautz

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a…

图像与视频处理 · 电气工程与系统科学 2020-08-03 Linchuan Xu , Jun Huang , Atsushi Nitanda , Ryo Asaoka , Kenji Yamanishi

Photosensor oculography (PS-OG) eye movement sensors offer desirable performance characteristics for integration within wireless head mounted devices (HMDs), including low power consumption and high sampling rates. To address the known…

计算机视觉与模式识别 · 计算机科学 2019-09-13 Henry K. Griffith , Dmytro Katrychuk , Oleg V. Komogortsev

Eye tracking research is important in computer vision because it can help us understand how humans interact with the visual world. Specifically for high-risk applications, such as in medical imaging, eye tracking can help us to comprehend…

计算机视觉与模式识别 · 计算机科学 2023-08-31 Bin Wang , Hongyi Pan , Armstrong Aboah , Zheyuan Zhang , Elif Keles , Drew Torigian , Baris Turkbey , Elizabeth Krupinski , Jayaram Udupa , Ulas Bagci

The attention mechanisms in deep neural networks are inspired by human's attention that sequentially focuses on the most relevant parts of the information over time to generate prediction output. The attention parameters in those models are…

计算机视觉与模式识别 · 计算机科学 2017-07-20 Youngjae Yu , Jongwook Choi , Yeonhwa Kim , Kyung Yoo , Sang-Hun Lee , Gunhee Kim