English
Related papers

Related papers: UEyes: An Eye-Tracking Dataset across User Interfa…

200 papers

Advanced multimodal AI agents can now collaborate with users to solve challenges in the world. Yet, these emerging contextual AI systems rely on explicit communication channels between the user and system. We hypothesize that implicit…

Interaction data is widely used in multiple domains such as cognitive science, visualization, human computer interaction, and cybersecurity, among others. Applications range from cognitive analyses over user/behavior modeling, adaptation,…

User interface (UI) design goes beyond visuals to shape user experience (UX), underscoring the shift toward UI/UX as a unified concept. While recent studies have explored UI evaluation using Multimodal Large Language Models (MLLMs), they…

Computation and Language · Computer Science 2026-01-13 Jaehyun Jeon , Min Soo Kim , Jang Han Yoon , Sumin Shim , Yejin Choi , Hanbin Kim , Dae Hyun Kim , Youngjae Yu

In Brain-Computer Interface (BCI) research, the detailed study of blinks is crucial. They can be considered as noise, affecting the efficiency and accuracy of decoding users' cognitive states and intentions, or as potential features,…

Neurons and Cognition · Quantitative Biology 2025-06-10 E. Guttmann-Flury , X. Sheng , X. Zhu

Eye-based information channels include the pupils, gaze, saccades, fixational movements, and numerous forms of eye opening and closure. Pupil size variation indicates cognitive load and emotion, while a person's gaze direction is said to be…

Human-Computer Interaction · Computer Science 2020-01-24 Jonny O'Dwyer , Niall Murray , Ronan Flynn

Dogs have a unique evolutionary relationship with humans and serve many important roles e.g. search and rescue, blind assistance, emotional support. However, few datasets exist to categorize visual features and objects available to dogs, as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shreyas Sundara Raman , Madeline H. Pelgrim , Daphna Buchsbaum , Thomas Serre

Enterprise software companies maintain thousands of user interface screens across products and versions, creating critical challenges for design consistency, pattern discovery, and compliance check. Existing approaches rely on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Maroun Ayli , Youssef Bakouny , Tushar Sharma , Nader Jalloul , Hani Seifeddine , Rima Kilany

With developments in computer graphics, hardware technology, perception engineering, and human-computer interaction, virtual reality and virtual environments are becoming more integrated into our daily lives. Head-mounted displays, however,…

Human-Computer Interaction · Computer Science 2022-03-30 Efe Bozkir

This research investigates User Experience (UX) issues in dataset search, targeting Google Dataset Search and data.europa.eu. It focuses on 6 areas within UX: Initial Interaction, Search Process, Dataset Exploration, Filtering and Sorting,…

Human-Computer Interaction · Computer Science 2026-03-03 Yihang Zhao , Albert Meroño-Peñuela , Elena Simperl

Humans can learn to operate the user interface (UI) of an application by reading an instruction manual or how-to guide. Along with text, these resources include visual content such as UI screenshots and images of application icons…

Computation and Language · Computer Science 2023-01-25 Pratyay Banerjee , Shweti Mahajan , Kushal Arora , Chitta Baral , Oriana Riva

In Interactive Information Retrieval (IIR) experiments the user's gaze motion on web pages is often recorded with eye tracking. The data is used to analyze gaze behavior or to identify Areas of Interest (AOI) the user has looked at. So far,…

Information Retrieval · Computer Science 2019-02-13 Daniel Hienert , Dagmar Kern , Matthew Mitsui , Chirag Shah , Nicholas J. Belkin

Instant messaging with texts and stickers has become a widely adopted communication medium, enabling efficient expression of user semantics and emotions. With the increased use of stickers conveying information and feelings, sticker…

Information Retrieval · Computer Science 2025-07-11 Heng Er Metilda Chee , Jiayin Wang , Zhiqiang Guo , Weizhi Ma , Qinglang Guo , Min Zhang

This paper presents eye2vec, an infrastructure for analyzing software developers' eye movements while reading source code. In common eye-tracking studies in program comprehension, researchers must preselect analysis targets such as control…

Software Engineering · Computer Science 2025-10-16 Haruhiko Yoshioka , Kazumasa Shimari , Hidetake Uwano , Kenichi Matsumoto

Improving the accessibility and automation capabilities of mobile devices can have a significant positive impact on the daily lives of countless users. To stimulate research in this direction, we release a human-annotated dataset with…

Human-Computer Interaction · Computer Science 2022-10-07 Srinivas Sunkara , Maria Wang , Lijuan Liu , Gilles Baechler , Yu-Chung Hsiao , Jindong , Chen , Abhanshu Sharma , James Stout

The exchange of personal information in digital environments poses significant risks, including identity theft, privacy breaches, and data misuse. Addressing these challenges requires a deep understanding of user behavior and mental models…

Human-Computer Interaction · Computer Science 2025-09-22 Reza Shahriari , Eric D. Ragan

Graphs are typically visualized as node-link diagrams. Although there is a fair amount of research focusing on crossing minimization to improve readability, little attention has been paid on how to handle crossings when they are an…

Human-Computer Interaction · Computer Science 2008-10-27 Weidong Huang

Human intention is an internal, mental characterization for acquiring desired information. From interactive interfaces containing either textual or graphical information, intention to perceive desired information is subjective and strongly…

Human-Computer Interaction · Computer Science 2022-07-07 Shahed Anzarus Sabab , Mohammad Ridwan Kabir , Sayed Rizban Hussain , Hasan Mahmud , Md. Kamrul Hasan , Husne Ara Rubaiyeat

Recently, iris recognition is regaining prominence in immersive applications such as extended reality as a means of seamless user identification. This application scenario introduces unique challenges compared to traditional iris…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yuxi Mi , Qiuyang Yuan , Zhizhou Zhong , Xuan Zhao , Jiaogen Zhou , Fubao Zhu , Jihong Guan , Shuigeng Zhou

Driver distraction has become a significant cause of severe traffic accidents over the past decade. Despite the growing development of vision-driven driver monitoring systems, the lack of comprehensive perception datasets restricts road…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Dingkang Yang , Shuai Huang , Zhi Xu , Zhenpeng Li , Shunli Wang , Mingcheng Li , Yuzheng Wang , Yang Liu , Kun Yang , Zhaoyu Chen , Yan Wang , Jing Liu , Peixuan Zhang , Peng Zhai , Lihua Zhang

Webcam-based eye tracking is a cost-effective, scalable method for remote research that effectively reaches broader populations. However, uncontrolled environments and hardware diversity lead to inconsistent data quality in crowdsourcing.…

Human-Computer Interaction · Computer Science 2026-05-06 Ka Hei Carrie Lau , Enkelejda Kasneci