English
Related papers

Related papers: Toward a Machine Bertin: Why Visualization Needs D…

200 papers

Diagrams are widely used to visualize data in publications. The research field of data visualization deals with defining principles and guidelines for the creation and use of these diagrams, which are often not known or adhered to by…

Artificial Intelligence · Computer Science 2025-09-30 Johannes Rückert , Louise Bloch , Christoph M. Friedrich

Vision language models (VLMs) have shown promising reasoning capabilities across various benchmarks; however, our understanding of their visual perception remains limited. In this work, we propose an eye examination process to investigate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Nam Hyeon-Woo , Moon Ye-Bin , Wonseok Choi , Lee Hyun , Tae-Hyun Oh

Neural networks are widely adopted to solve complex and challenging tasks. Especially in high-stakes decision-making, understanding their reasoning process is crucial, yet proves challenging for modern deep networks. Feature visualization…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Ada Gorgun , Bernt Schiele , Jonas Fischer

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Spatial reasoning is a fundamental aspect of human cognition, enabling intuitive understanding and manipulation of objects in three-dimensional space. While foundation models demonstrate remarkable performance on some benchmarks, they still…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Fan-Yun Sun , Weiyu Liu , Siyi Gu , Dylan Lim , Goutam Bhat , Federico Tombari , Manling Li , Nick Haber , Jiajun Wu

Selecting appropriate visual encodings is critical to designing effective visualization recommendation systems, yet few findings from graphical perception are typically applied within these systems. We observe two significant limitations in…

Human-Computer Interaction · Computer Science 2023-02-13 Zehua Zeng , Leilani Battle

Recent research suggests that Vision Language Models (VLMs) often rely on inherent biases learned during training when responding to queries about visual properties of images. These biases are exacerbated when VLMs are asked highly specific…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Recent large-scale vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and generating textual descriptions for visual content. However, these models lack an understanding of user-specific concepts. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yuval Alaluf , Elad Richardson , Sergey Tulyakov , Kfir Aberman , Daniel Cohen-Or

Engineering design operates through hierarchical abstraction from system specifications to component implementations, requiring visual understanding coupled with mathematical reasoning at each level. While Multi-modal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Arman Akbari , Jian Gao , Yifei Zou , Mei Yang , Jinru Duan , Dmitrii Torbunov , Yanzhi Wang , Yihui Ren , Xuan Zhang

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Human-Computer Interaction · Computer Science 2025-08-01 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

We revisit the design space of visualizations aiming at identifying and relating its components. In this sense, we establish a model to examine the process through which visualizations become expressive for users. This model has leaded us…

Graphics · Computer Science 2015-05-29 Jose F. Rodrigues , Agma J. M. Traina , Maria C. F. Oliveira , Caetano Traina

Significant research has provided robust task and evaluation languages for the analysis of exploratory visualizations. Unfortunately, these taxonomies fail when applied to communicative visualizations. Instead, designers often resort to…

Human-Computer Interaction · Computer Science 2020-09-16 Eytan Adar , Elsie Lee

Understanding visual degradations is a critical yet challenging problem in computer vision. While recent Vision-Language Models (VLMs) excel at qualitative description, they often fall short in understanding the parametric physics…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Guanzhou Lan , Chenyi Liao , Yuqi Yang , Qianli Ma , Zhigang Wang , Dong Wang , Bin Zhao , Xuelong Li

CAPTCHA, originally designed to distinguish humans from robots, has evolved into a real-world benchmark for assessing the spatial reasoning capabilities of vision-language models. In this work, we first show that step-by-step reasoning is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Python Song , Luke Tenyi Chang , Yun-Yun Tsai , Penghui Li , Junfeng Yang

Puzzles have long served as compact and revealing probes of human cognition, isolating abstraction, rule discovery, and systematic reasoning with minimal reliance on prior knowledge. Leveraging these properties, visual puzzles have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Maria Lymperaiou , Vasileios Karampinis , Giorgos Filandrianos , Angelos Vlachos , Chrysoula Zerva , Athanasios Voulodimos

Advances in deep learning have greatly widened the scope of automatic computer vision algorithms and enable users to ask questions directly about the content in images and video. This paper explores the necessary steps towards a future…

Databases · Computer Science 2018-12-20 Sanjay Krishnan , Adam Dziedzic , Aaron J. Elmore

Vision-language models (VLMs) have advanced rapidly in processing multimodal information, but their ability to reconcile conflicting signals across modalities remains underexplored. This work investigates how VLMs process ASCII art, a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zhaochen Wang , Bryan Hooi , Yiwei Wang , Ming-Hsuan Yang , Zi Huang , Yujun Cai

Increasingly, visual signals such as images, videos and point clouds are being captured solely for the purpose of automated analysis by computer vision models. Applications include traffic monitoring, robotics, autonomous driving, smart…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Ivan V. Bajić

Visual understanding goes well beyond object recognition. With one glance at an image, we can effortlessly imagine the world beyond the pixels: for instance, we can infer people's actions, goals, and mental states. While this task is easy…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Rowan Zellers , Yonatan Bisk , Ali Farhadi , Yejin Choi

Achieving deep alignment between vision and language remains a central challenge for Multimodal Large Language Models (MLLMs). These models often fail to fully leverage visual input, defaulting to strong language priors. Our approach first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Aarti Ghatkesar , Ganesh Venkatesh