English
Related papers

Related papers: Chartist: Task-driven Eye Movement Control for Cha…

200 papers

Decision-making is a central yet under-defined goal in visualization research. While existing task models address decision processes, they often neglect the conditions framing a decision. To better support decision-making tasks, we propose…

Human-Computer Interaction · Computer Science 2025-07-25 Lena Cibulski , Stefan Bruckner

The study of attentional processing in vision has a long and deep history. Recently, several papers have presented insightful perspectives into how the coordination of multiple attentional functions in the brain might occur. These begin…

Artificial Intelligence · Computer Science 2021-01-06 John K. Tsotsos , Omar Abid , Iuliia Kotseruba , Markus D. Solbach

Large Language Models (LLMs) have shown promising results on various language and vision tasks. Recently, there has been growing interest in applying LLMs to graph-based tasks, particularly on Text-Attributed Graphs (TAGs). However, most…

Machine Learning · Computer Science 2024-06-10 Zhongmou He , Jing Zhu , Shengyi Qian , Joyce Chai , Danai Koutra

Advances in voice-controlled assistants paved the way into the consumer market. For professional or industrial use, the capabilities of such assistants are too limited or too time-consuming to implement due to the higher complexity of data,…

Computation and Language · Computer Science 2020-07-28 Bekir Bayrak , Florian Giger , Christian Meurisch

Recent advancements in reasoning abilities of Large Language Models (LLM) has promoted their usage in problems that require high-level planning for robots and artificial agents. However, current techniques that utilize LLMs for such…

Artificial Intelligence · Computer Science 2023-10-17 Yash Shukla , Wenchang Gao , Vasanth Sarathy , Alvaro Velasquez , Robert Wright , Jivko Sinapov

We present a model inspired by the Global Workspace Theory that integrates specialized modules to perform a sequential reasoning task. A controller selectively routes information between modules through the workspace using a gating…

Machine Learning · Computer Science 2025-03-10 Hugo Chateau-Laurent , Rufin VanRullen

Automatic data extraction from charts is challenging for two reasons: there exist many relations among objects in a chart, which is not a common consideration in general computer vision problems; and different types of charts may not be…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Xiaoyi Liu , Diego Klabjan , Patrick NBless

Chart-based visual acuity measurements are used by billions of people to diagnose and guide treatment of vision impairment. However, the ubiquitous eye exam has no mechanism for reasoning about uncertainty and as such, suffers from a…

Artificial Intelligence · Computer Science 2019-11-25 Chris Piech , Ali Malik , Laura M Scott , Robert T Chang , Charles Lin

Cognitive training for sustained attention and working memory is vital across domains relying on robust mental capacity such as education or rehabilitation. Adaptive systems are essential, dynamically matching difficulty to user ability to…

Human-Computer Interaction · Computer Science 2026-02-19 Dominik Szczepaniak , Monika Harvey , Fani Deligianni

Modern web interfaces are unnecessarily complex to use as they overwhelm users with excessive text and visuals unrelated to their current goals. This problem particularly impacts screen reader users (SRUs), who navigate content sequentially…

Human-Computer Interaction · Computer Science 2025-07-22 Ananya Gubbi Mohanbabu , Yotam Sechayk , Amy Pavel

Achieving human-level intelligence requires refining cognitive distinctions between System 1 and System 2 thinking. While contemporary AI, driven by large language models, demonstrates human-like traits, it falls short of genuine cognition.…

Machine Learning · Computer Science 2025-02-11 Guangyan Sun , Mingyu Jin , Zhenting Wang , Cheng-Long Wang , Siqi Ma , Qifan Wang , Tong Geng , Ying Nian Wu , Yongfeng Zhang , Dongfang Liu

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

Human-Computer Interaction · Computer Science 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

Real-world scenarios demand reasoning about process, more than final outcome prediction, to discover latent causal chains and better understand complex systems. It requires the learning algorithms to offer both accurate predictions and…

Artificial Intelligence · Computer Science 2019-01-09 Xiaoran Xu , Songpeng Zu , Chengliang Gao , Yuan Zhang , Wei Feng

The work presented in this report introduces a framework aimed towards learning to imitate human gaits. Humans exhibit movements like walking, running, and jumping in the most efficient manner, which served as the source of motivation for…

Robotics · Computer Science 2021-06-30 Utkarsh A. Mishra

Humans excel in continuously learning with small data without forgetting how to solve old problems. However, neural networks require large datasets to compute latent representations across different tasks while minimizing a loss function.…

Machine Learning · Computer Science 2019-11-21 Omar U. Florez , Erik Mueller

Chart visualizations are essential for data interpretation and communication; however, most charts are only accessible in image format and lack the corresponding data tables and supplementary information, making it difficult to alter their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Pengyu Yan , Mahesh Bhosale , Jay Lal , Bikhyat Adhikari , David Doermann

We propose an image-classification method to predict the perceived-relevance of text documents from eye-movements. An eye-tracking study was conducted where participants read short news articles, and rated them as relevant or irrelevant for…

Human-Computer Interaction · Computer Science 2020-01-16 Nilavra Bhattacharya , Somnath Rakshit , Jacek Gwizdka , Paul Kogut

Shared control improves Human-Robot Interaction by reducing the user's workload and increasing the robot's autonomy. It allows robots to perform tasks under the user's supervision. Current eye-tracking-driven approaches face several…

Robotics · Computer Science 2026-01-27 Anke Fischer-Janzen , Thomas M. Wendt , Kristof Van Laerhoven

Recent advances in visual analytics have enabled us to learn from user interactions and uncover analytic goals. These innovations set the foundation for actively guiding users during data exploration. Providing such guidance will become…

Human-Computer Interaction · Computer Science 2022-07-19 Shayan Monadjemi , Sunwoo Ha , Quan Nguyen , Henry Chai , Roman Garnett , Alvitta Ottley

While theories postulating a dual cognitive system take hold, quantitative confirmations are still needed to understand and identify interactions between the two systems or conflict events. Eye movements are among the most direct markers of…

Neurons and Cognition · Quantitative Biology 2020-02-27 Alessandro Rossi , Sara Ermini , Dario Bernabini , Dario Zanca , Marino Todisco , Alessandro Genovese , Antonio Rizzo