English
Related papers

Related papers: Visualization Biases MLLM's Decision Making in Net…

200 papers

Trust is an essential aspect of data visualization, as it plays a crucial role in the interpretation and decision-making processes of users. While research in social sciences outlines the multi-dimensional factors that can play a role in…

Human-Computer Interaction · Computer Science 2023-10-02 Hamza Elhamdadi , Adam Stefkovics , Johanna Beyer , Eric Moerth , Cindy Xiong Bearfield , Carolina Nobre

Recent research has shown that hallucinations, omissions, and biases are prevalent in everyday use-cases of LLMs. However, chatbots used in medical contexts must provide consistent advice in situations where non-medical factors are…

Computation and Language · Computer Science 2025-11-05 Jonathan Liu , Haoling Qiu , Jonathan Lasko , Damianos Karakos , Mahsa Yarmohammadi , Mark Dredze

Interaction enables users to navigate large amounts of data effectively, supports cognitive processing, and increases data representation methods. However, there have been few attempts to empirically demonstrate whether adding interaction…

Human-Computer Interaction · Computer Science 2021-03-08 Ab Mosca , Alvitta Ottley , Remco Chang

Recent advancements in large vision-language models (LVLMs) have demonstrated impressive capability in visual information understanding with human language. Despite these advances, LVLMs still face challenges with multimodal hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Zongbo Han , Zechen Bai , Haiyang Mei , Qianli Xu , Changqing Zhang , Mike Zheng Shou

Large language models (LLMs) have exhibited impressive performance in language comprehension and various reasoning tasks. However, their abilities in spatial reasoning, a crucial aspect of human cognition, remain relatively unexplored.…

Computation and Language · Computer Science 2024-10-24 Wenshan Wu , Shaoguang Mao , Yadong Zhang , Yan Xia , Li Dong , Lei Cui , Furu Wei

The automatic generation of visualizations is an old task that, through the years, has shown more and more interest from the research and practitioner communities. Recently, large language models (LLM) have become an interesting option for…

Human-Computer Interaction · Computer Science 2024-02-06 Luca Podo , Muhammad Ishmal , Marco Angelini

Recent developments in multimodal large language models (MLLM) have equipped language models to reason about vision and language jointly. This permits MLLMs to both perceive and answer questions about data visualization across a variety of…

Human-Computer Interaction · Computer Science 2025-04-23 Zhimin Li , Haichao Miao , Xinyuan Yan , Valerio Pascucci , Matthew Berger , Shusen Liu

This study emphasizes how crucial it is to visualize machine learning models, especially for the banking industry, in order to improve interpretability and support predictions in high stakes financial settings. Visual tools enable…

Machine Learning · Computer Science 2025-02-24 Priyam Ganguly , Ramakrishna Garine , Isha Mukherjee

Most research on the interpretability of machine learning systems focuses on the development of a more rigorous notion of interpretability. I suggest that a better understanding of the deficiencies of the intuitive notion of…

Machine Learning · Statistics 2017-12-08 Fabian Offert

Artificial Intelligence (AI) and indoor sensing increasingly support decision-making in spatial environments. However, traditional visualization methods impose a substantial mental workload when viewers translate this digital information…

Human-Computer Interaction · Computer Science 2026-02-10 Xianhao Carton Liu , Difan Jia , Tongyu Nie , Evan Suma Rosenberg , Victoria Interrante , Chen Zhu-Tian

Data visualizations are increasingly seen as socially constructed, with several recent studies positing that perceptions and interpretations of visualization artifacts are shaped through complex sets of interactions between members of a…

Human-Computer Interaction · Computer Science 2025-02-17 Priya Dhawka , Sayamindu Dasgupta

Multimodal large language models (MLLMs) extend the success of language models to visual understanding, and recent efforts have sought to build unified MLLMs that support both understanding and generation. However, constructing such models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Hanyu Wang , Jiaming Han , Ziyan Yang , Qi Zhao , Shanchuan Lin , Xiangyu Yue , Abhinav Shrivastava , Zhenheng Yang , Hao Chen

Graph and network visualization supports exploration, analysis and communication of relational data arising in many domains: from biological and social networks, to transportation and powergrid systems. With the arrival of AI-based…

The ability of to explain neural network decisions goes hand in hand with their safe deployment. Several methods have been proposed to highlight features important for a given network decision. However, there is no consensus on how to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Agnieszka Grabska-Barwińska

With the growing deployment of Vision-Language Models (VLMs), pre-trained on large image-text and video-text datasets, it is critical to equip users with the tools to discern when to trust these systems. However, examining how user trust in…

Human-Computer Interaction · Computer Science 2025-11-18 Agnese Chiatti , Lara Piccolo , Sara Bernardini , Matteo Matteucci , Viola Schiaffonati

This paper investigates false positive constructions: grammatical structures which an LLM hallucinates as distinct constructions but which human introspection does not support. Both a behavioural probing task using contextual embeddings and…

Computation and Language · Computer Science 2025-08-26 Jonathan Dunn , Mai Mohamed Eida

Establishing trust with readers is an important first step in visual data communication. But what makes a visualization trustworthy? Psychology and behavioral economics research has found processing fluency (i.e., speed and accuracy of…

Human-Computer Interaction · Computer Science 2022-09-30 Hamza Elhamdadi , Lace Padilla , Cindy Xiong

This paper revisits the role of quantitative and qualitative methods in visualization research in the context of advancements in artificial intelligence (AI). The focus is on how we can bridge between the different methods in an integrated…

Human-Computer Interaction · Computer Science 2024-09-12 Daniel Weiskopf

Machine learning (ML) models are nowadays used in complex applications in various domains, such as medicine, bioinformatics, and other sciences. Due to their black box nature, however, it may sometimes be hard to understand and trust the…

Machine Learning · Computer Science 2024-04-19 A. Chatzimparmpas , R. Martins , I. Jusufi , K. Kucher , Fabrice Rossi , A. Kerren

Rule sets are often used in Machine Learning (ML) as a way to communicate the model logic in settings where transparency and intelligibility are necessary. Rule sets are typically presented as a text-based list of logical statements…

Human-Computer Interaction · Computer Science 2021-09-21 Jun Yuan , Oded Nov , Enrico Bertini