English
Related papers

Related papers: Visualization of Machine Learning Models through T…

200 papers

Eye-tracking data reveals valuable insights into users' cognitive states but is difficult to analyze due to its structured, non-linguistic nature. While large language models (LLMs) excel at reasoning over text, they struggle with temporal…

Human-Computer Interaction · Computer Science 2025-07-25 Dongyang Guo , Yasmeen Abdrabou , Enkeleda Thaqi , Enkelejda Kasneci

Visual analytics for machine learning has recently evolved as one of the most exciting areas in the field of visualization. To better identify which research topics are promising and to learn how to apply relevant techniques in visual…

Human-Computer Interaction · Computer Science 2020-08-25 Jun Yuan , Changjian Chen , Weikai Yang , Mengchen Liu , Jiazhi Xia , Shixia Liu

Modern neural language models (LMs) are powerful tools for modeling human sentence production and comprehension, and their internal representations are remarkably well-aligned with representations of language in the human brain. But to…

Computation and Language · Computer Science 2024-03-27 Chengxu Zhuang , Evelina Fedorenko , Jacob Andreas

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

Vision-language models (VLMs) extend the conventional large language models by integrating visual data, enabling richer multimodal reasoning and significantly broadens the practical applications of AI. However, including visual inputs also…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Daulet Toibazar , Kesen Wang , Sherif Mohamed , Abdulaziz Al-Badawi , Abdulrahman Alfulayt , Pedro J. Moreno

Software Visualization encompasses the development and evaluation of methods for graphically representing different aspects of methods of software, including its structure, execution and evolution. Creating visualizations helps the user to…

Software Engineering · Computer Science 2010-02-08 Akepogu Anand Rao , Karanam Madhavi

Vision Language Models (VLMs) are designed to extend Large Language Models (LLMs) with visual capabilities, yet in this work we observe a surprising phenomenon: VLMs can outperform their underlying LLMs on purely text-only tasks,…

Machine Learning · Computer Science 2026-02-18 Nicolas Buzeta , Felipe del Rio , Cristian Hinostroza , Denis Parra , Hans Lobel , Rodrigo Toro Icarte

The spatial reasoning task aims to reason about the spatial relationships in 2D and 3D space, which is a fundamental capability for Visual Question Answering (VQA) and robotics. Although vision language models (VLMs) have developed rapidly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Xun Liang , Xin Guo , Zhongming Jin , Weihang Pan , Penghui Shang , Deng Cai , Binbin Lin , Jieping Ye

Web service administrators must ensure the stability of multiple systems by promptly detecting anomalies in Key Performance Indicators (KPIs). Achieving the goal of "train once, infer across scenarios" remains a fundamental challenge for…

Machine Learning · Computer Science 2025-10-07 Zexin Wang , Changhua Pei , Yang Liu , Hengyue Jiang , Quan Zhou , Haotian Si , Hang Cui , Jianhui Li , Gaogang Xie , Jingjing Li , Dan Pei

Automated data visualization plays a crucial role in simplifying data interpretation, enhancing decision-making, and improving efficiency. While large language models (LLMs) have shown promise in generating visualizations from natural…

Computation and Language · Computer Science 2025-07-29 Mizanur Rahman , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Integration of diverse data will be a pivotal step towards improving scientific explorations in many disciplines. This work establishes a vision-language model (VLM) that encodes videos with text input in order to classify various behaviors…

Machine Learning · Computer Science 2025-10-23 Paimon Goulart , Jordan Steinhauser , Kylene Shuler , Edward Korzus , Jia Chen , Evangelos E. Papalexakis

Large Vision Language Models (VLMs) have long struggled with spatial reasoning tasks. Surprisingly, even simple spatial reasoning tasks, such as recognizing "under" or "behind" relationships between only two objects, pose significant…

Computation and Language · Computer Science 2025-10-14 Shiqi Chen , Tongyao Zhu , Ruochen Zhou , Jinghan Zhang , Siyang Gao , Juan Carlos Niebles , Mor Geva , Junxian He , Jiajun Wu , Manling Li

Vision Large Language Models (VLMs) combine visual understanding with natural language processing, enabling tasks like image captioning, visual question answering, and video analysis. While VLMs show impressive capabilities across domains…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ahmed Sharshar , Latif U. Khan , Waseem Ullah , Mohsen Guizani

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Tables, typically two-dimensional and structured to store large amounts of data, are essential in daily activities like database queries, spreadsheet manipulations, web table question answering, and image table information extraction.…

Artificial Intelligence · Computer Science 2024-11-05 Weizheng Lu , Jing Zhang , Ju Fan , Zihao Fu , Yueguo Chen , Xiaoyong Du

Pre-trained Vision-Language Models (VLMs) are becoming increasingly popular across various visual tasks, and several open-sourced VLM variants have been released. However, selecting the best-performing pre-trained VLM for a specific…

Machine Learning · Computer Science 2025-05-08 Hao-Zhe Tan , Zhi Zhou , Yu-Feng Li , Lan-Zhe Guo

Visualization for explainable and trustworthy machine learning remains one of the most important and heavily researched fields within information visualization and visual analytics with various application domains, such as medicine,…

Human-Computer Interaction · Computer Science 2024-04-19 Angelos Chatzimparmpas , Kostiantyn Kucher , Andreas Kerren

In this paper, we present Language Model as Visual Explainer LVX, a systematic approach for interpreting the internal workings of vision models using a tree-structured linguistic explanation, without the need for model training. Central to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Xingyi Yang , Xinchao Wang

Top-view perspective denotes a typical way in which humans read and reason over different types of maps, and it is vital for localization and navigation of humans as well as of `non-human' agents, such as the ones backed by large…

Computation and Language · Computer Science 2024-06-05 Chengzu Li , Caiqi Zhang , Han Zhou , Nigel Collier , Anna Korhonen , Ivan Vulić

We present a transparent, reproducible measurement of research trends across 26,104 accepted papers from CVPR, ICLR, and NeurIPS spanning 2023-2025. Titles and abstracts are normalized, phrase-protected, and matched against a hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Fengming Lin