English
Related papers

Related papers: A Discriminative Model for Identifying Readers and…

200 papers

With the recent proliferation of large language models (LLMs), such as Generative Pre-trained Transformers (GPT), there has been a significant shift in exploring human and machine comprehension of semantic language meaning. This shift calls…

Computation and Language · Computer Science 2023-10-18 Yuhong Zhang , Qin Li , Sujal Nahata , Tasnia Jamal , Shih-kuen Cheng , Gert Cauwenberghs , Tzyy-Ping Jung

While neural networks with attention mechanisms have achieved superior performance on many natural language processing tasks, it remains unclear to which extent learned attention resembles human visual attention. In this paper, we propose a…

Computation and Language · Computer Science 2020-10-28 Ekta Sood , Simon Tannert , Diego Frassinelli , Andreas Bulling , Ngoc Thang Vu

Educational videos are a cornerstone of remote and blended learning. However, learners' fluctuating attention remains a significant barrier to effective information retention. Prior research has attempted to mitigate this by detecting and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Gabriel Becquet , Sébastien Lallé , Vanda Luengo , Ali Abou-Hassan

We conducted an eye-tracking study where 30 participants performed searches on the web. We measured their topical knowledge before and after each task. Their eye-fixations were labelled as "reading" or "scanning". The series of reading…

Human-Computer Interaction · Computer Science 2019-08-16 Nilavra Bhattacharya , Jacek Gwizdka

The objects we perceive guide our eye movements when observing real-world dynamic scenes. Yet, gaze shifts and selective attention are critical for perceiving details and refining object boundaries. Object segmentation and gaze behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Vito Mengers , Nicolas Roth , Oliver Brock , Klaus Obermayer , Martin Rolfs

Eye-tracking data has been shown to correlate with a user's knowledge level and query formulation behaviour. While previous work has focused primarily on eye gaze fixations for attention analysis, often requiring additional contextual…

Information Retrieval · Computer Science 2025-05-07 Jiaman He , Zikang Leng , Dana McKay , Johanne R. Trippas , Damiano Spina

Scanpath similarity metrics are central to eye-movement research, yet existing methods predominantly evaluate spatial and temporal alignment while neglecting semantic equivalence between attended image regions. We present a semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mohamed Amine Kerkouri , Marouane Tliba , Bin Wang , Aladine Chetouani , Ulas Bagci , Alessandro Bruno

Previous work combines word-level and character-level representations using concatenation or scalar weighting, which is suboptimal for high-level tasks like reading comprehension. We present a fine-grained gating mechanism to dynamically…

Computation and Language · Computer Science 2017-09-13 Zhilin Yang , Bhuwan Dhingra , Ye Yuan , Junjie Hu , William W. Cohen , Ruslan Salakhutdinov

Support Vector Machines (SVMs) are a cornerstone of supervised learning, widely used for data classification. A central component of their success lies in kernel functions, which enable efficient computation of inner products in…

Quantum Physics · Physics 2025-09-16 A. Mandilara , A. D. Papadopoulos , D. Syvridis

This work presents a study on the extraction and analysis of a set of 101 categories of eye movement features from three types of eye movement events: fixations, saccades, and post-saccadic oscillations. The eye movements were recorded…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Ioannis Rigas , Lee Friedman , Oleg Komogortsev

Eye tracking is handled as one of the key technologies for applications that assess and evaluate human attention, behavior, and biometrics, especially using gaze, pupillary, and blink behaviors. One of the challenges with regard to the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Efe Bozkir , Ali Burak Ünal , Mete Akgün , Enkelejda Kasneci , Nico Pfeifer

Despite significant advancements in vision-language models (VLMs), there lacks effective approaches to enhance response quality by scaling inference-time computation. This capability is known to be a core step towards the self-improving…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xiyao Wang , Zhengyuan Yang , Linjie Li , Hongjin Lu , Yuancheng Xu , Chung-Ching Lin , Kevin Lin , Furong Huang , Lijuan Wang

Supervised learning models are one of the most fundamental classes of models. Viewing supervised learning from a probabilistic perspective, the set of training data to which the model is fitted is usually assumed to follow a stationary…

Machine Learning · Statistics 2022-09-14 Kungang Zhang , Anh T. Bui , Daniel W. Apley

Previous research shows that eye-tracking data contains information about the lexical and syntactic properties of text, which can be used to improve natural language processing models. In this work, we leverage eye movement features from…

Computation and Language · Computer Science 2019-03-29 Nora Hollenstein , Ce Zhang

Yarbus' claim to decode the observer's task from eye movements has received mixed reactions. In this paper, we have supported the hypothesis that it is possible to decode the task. We conducted an exploratory analysis on the dataset by…

Machine Learning · Computer Science 2019-07-31 Ayush Kumar , Anjul Tyagi , Michael Burch , Daniel Weiskopf , Klaus Mueller

In this paper we investigate the value of gaze-driven adaptive interventions to support processing of textual documents with embedded visualizations, i.e., Magazine Style Narrative Visualizations (MSNVs). These interventions are provided…

Human-Computer Interaction · Computer Science 2019-12-13 Sébastien Lallé , Dereck Toker , Cristina Conati

Visual attention plays a critical role when our visual system executes active visual tasks by interacting with the physical scene. However, how to encode the visual object relationship in the psychological world of our brain deserves to be…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Kai-Fu Yang , Yong-Jie Li

How people look at visual information reveals fundamental information about themselves, their interests and their state of mind. While previous visual attention models output static 2-dimensional saliency maps, saccadic models aim to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-16 Olivier Le Meur , Antoine Coutrot , Zhi Liu , Adrien Le Roch , Andrea Helo , Pia Rama

Understanding reader behaviors such as skimming, deep reading, and scanning is essential for improving educational instruction. While prior eye-tracking studies have trained models to recognize reading behaviors, they often rely on…

In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, we collect a new…

Computation and Language · Computer Science 2020-10-16 Jonathan Malmaud , Roger Levy , Yevgeni Berzak