English
Related papers

Related papers: Characterizing Multimodal Interaction in Visualiza…

200 papers

Designing responsive visualizations for various screen types can be tedious as authors must manage multiple chart~versions across design iterations. Automated approaches for responsive visualization must take into account the user's need…

Human-Computer Interaction · Computer Science 2023-08-11 Hyeok Kim , Ryan Rossi , Jessica Hullman , Jane Hoffswell

A widespread adoption of Virtual, Augmented, and Mixed Reality (VR/AR/MR), collectively referred to as Extended Reality (XR), has become a tangible possibility to revolutionize educational and training scenarios by offering immersive,…

Human-Computer Interaction · Computer Science 2024-07-10 Rama Krishnan Gopal Ramasamy Thandapani , Benjamin Capel , Antoine Lasnier , Ioannis Chatzigiannakis

We explore the integration of large language models (LLMs) into visual analytics (VA) systems to transform their capabilities through intuitive natural language interactions. We survey current research directions in this emerging field,…

Human-Computer Interaction · Computer Science 2025-07-01 Maeve Hutchinson , Radu Jianu , Aidan Slingsby , Pranava Madhyastha

Recent research in the field of multimodal machine translation (MMT) has indicated that the visual modality is either dispensable or offers only marginal advantages. However, most of these conclusions are drawn from the analysis of…

Computation and Language · Computer Science 2024-04-10 Zi Long , Zhenhao Tang , Xianghua Fu , Jian Chen , Shilong Hou , Jinze Lyu

We, as a society, need artists to help us interpret and explain science, but what does an artist's studio look like when today's science is built upon the language of large, increasingly complex data? This paper presents a data…

Human-Computer Interaction · Computer Science 2020-10-20 Bridger Herman , Francesca Samsel , Annie Bares , Seth Johnson , Greg Abram , Daniel F. Keefe

Improving object manipulation skills through hand-object interaction exercises is crucial for rehabilitation. Despite limited healthcare resources, physical therapists propose remote exercise routines followed up by remote monitoring.…

Human-Computer Interaction · Computer Science 2023-12-13 Trudi Di Qi , LouAnne Boyd , Scott Fitzpatrick , Meghna Raswan , Farnceli Cibrian

Multimodal interfaces that combine direct manipulation and natural language have shown great promise for data visualization. Such multimodal interfaces allow people to stay in the flow of their visual exploration by leveraging the strengths…

Human-Computer Interaction · Computer Science 2020-04-23 Arjun Srinivasan , Bongshin Lee , John Stasko

Mobile Learning Games (MLGs) show great potential for increasing engagement, creativity and authentic learning. Yet, despite their great potential for education, the use of MLGs by teachers, remains limited. This is partly due to the fact…

Human-Computer Interaction · Computer Science 2018-12-04 Aous Karoui , Iza Marfisi-Schottman , Sébastien George

This paper is a call to action for research and discussion on data visualization education. As visualization evolves and spreads through our professional and personal lives, we need to understand how to support and empower a broad and…

We are perceiving and communicating with the world in a multisensory manner, where different information sources are sophisticatedly processed and interpreted by separate parts of the human brain to constitute a complex, yet harmonious and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Ye Zhu , Yu Wu , Nicu Sebe , Yan Yan

This paper provides a comprehensive review of the integration of Large Language Models (LLMs) with visual analytics, addressing their foundational concepts, capabilities, and wide-ranging applications. It begins by outlining the theoretical…

Human-Computer Interaction · Computer Science 2025-03-20 Navya Sonal Agarwal , Sanjay Kumar Sonbhadra

This paper defines, analyzes, and discusses the emerging genre of visualization atlases. We currently witness an increase in web-based, data-driven initiatives that call themselves "atlases" while explaining complex, contemporary issues…

Human-Computer Interaction · Computer Science 2024-08-15 Jinrui Wang , Xinhuan Shu , Benjamin Bach , Uta Hinrichs

Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing,…

Computation and Language · Computer Science 2018-07-24 Stephanie M. Lukin , Reginald Hobbs , Clare R. Voss

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

This paper draws together nine strategies for creative visualization activities. Teaching visualization often involves running learning activities where students perform tasks that directly support one or more topics that the teacher wishes…

The evaluation of interactive machine learning systems remains a difficult task. These systems learn from and adapt to the human, but at the same time, the human receives feedback and adapts to the system. Getting a clear understanding of…

Artificial Intelligence · Computer Science 2018-01-25 Nadia Boukhelifa , Anastasia Bezerianos , Evelyne Lutton

This paper examines how different types of large language model (LLM) agents perform on scientific visualization (SciVis) tasks, where users generate visualization workflows from natural-language instructions. We compare three primary…

Artificial Intelligence · Computer Science 2026-05-14 Jackson Vonderhorst , Kuangshi Ai , Haichao Miao , Shusen Liu , Chaoli Wang

Online writers and journalism media are increasingly combining visualization (and other multimedia content) with narrative text to create narrative visualizations. Often, however, the two elements are presented independently of one another.…

Human-Computer Interaction · Computer Science 2018-01-09 Ronald Metoyer , Qiyu Zhi , Bart Janczuk , Walter Scheirer

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

Interactions are patterns between several attributes in data that cannot be inferred from any subset of these attributes. While mutual information is a well-established approach to evaluating the interactions between two attributes, we…

Artificial Intelligence · Computer Science 2007-05-23 Aleks Jakulin , Ivan Bratko