English
Related papers

Related papers: Automated Visualization Makeovers with LLMs

200 papers

The rise of Large Language Models (LLMs) and generative visual analytics systems has transformed data-driven insights, yet significant challenges persist in accurately interpreting users' analytical and interaction intents. While language…

Human-Computer Interaction · Computer Science 2025-04-17 Juntong Chen , Jiang Wu , Jiajing Guo , Vikram Mohanty , Xueming Li , Jorge Piazentin Ono , Wenbin He , Liu Ren , Dongyu Liu

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Enabling robots to learn long-horizon manipulation tasks from a handful of demonstrations remains a central challenge in robotics. Existing neuro-symbolic approaches often rely on hand-crafted symbolic abstractions, semantically labeled…

Robotics · Computer Science 2026-04-07 Pierrick Lorang , Johannes Huemer , Timothy Duggan , Kai Goebel , Patrik Zips , Matthias Scheutz

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

Many-to-many summarization (M2MS) aims to process documents in any language and generate the corresponding summaries also in any language. Recently, large language models (LLMs) have shown strong multi-lingual abilities, giving them the…

Computation and Language · Computer Science 2025-05-20 Jiaan Wang , Fandong Meng , Zengkui Sun , Yunlong Liang , Yuxuan Cao , Jiarong Xu , Haoxiang Shi , Jie Zhou

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

Robotics · Computer Science 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes

Large Language Models (LLMs) have emerged as powerful support tools across various natural language tasks and a range of application domains. Recent studies focus on exploring their capabilities for data annotation. This paper provides a…

Computation and Language · Computer Science 2025-07-01 Maja Pavlovic , Massimo Poesio

Large Language Models (LLMs) are capable of successfully performing many language processing tasks zero-shot (without training data). If zero-shot LLMs can also reliably classify and explain social phenomena like persuasiveness and…

Computation and Language · Computer Science 2024-02-27 Caleb Ziems , William Held , Omar Shaikh , Jiaao Chen , Zhehao Zhang , Diyi Yang

Professionals working in technical domain typically hand-draw (on whiteboard, paper, etc.) technical diagrams (e.g., flowcharts, block diagrams, etc.) during discussions; however, if they want to edit these later, it needs to be drawn from…

Computation and Language · Computer Science 2026-01-27 Tafazzul Nadeem , Bhavik Shangari , Manish Rai , Gagan Raj Gupta , Ashutosh Modi

Misleading visualizations, which manipulate chart representations to support specific claims, can distort perception and lead to incorrect conclusions. Despite decades of research, they remain a widespread issue, posing risks to public…

Computation and Language · Computer Science 2025-09-23 Zixin Chen , Sicheng Song , Kashun Shum , Yanna Lin , Rui Sheng , Weiqi Wang , Huamin Qu

Machine learning (ML) is believed to be an effective and efficient tool to build reliable prediction model or extract useful structure from an avalanche of data. However, ML is also criticized by its difficulty in interpretation and…

Human-Computer Interaction · Computer Science 2016-10-19 Teng Lee , James Johnson , Steve Cheng

The explosion of data in recent years is driving individuals to leverage technology to generate insights. Traditional tools bring heavy learning overheads and the requirement for understanding complex charting techniques. Such barriers can…

Human-Computer Interaction · Computer Science 2023-03-28 Paula Maddigan , Teo Susnjak

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Current multimodal large language models (MLLMs), while effective in natural image understanding, struggle with visualization understanding due to their inability to decode the data-to-visual mapping and extract structured information. To…

Human-Computer Interaction · Computer Science 2025-07-03 Can Liu , Chunlin Da , Xiaoxiao Long , Yuxiao Yang , Yu Zhang , Yong Wang

Data augmentation is a critical component of deep learning pipelines, enhancing model generalization by increasing dataset diversity. Traditional augmentation strategies rely on manually designed transformations, stochastic sampling, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Ant Duru , Alptekin Temizel

Significant efforts have been dedicated to integrating the powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of language, vision and audio data. However, the graph-structured data, which is…

Computation and Language · Computer Science 2024-12-31 Zipeng Liu , Likang Wu , Ming He , Zhong Guan , Hongke Zhao , Nan Feng

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on…

Computation and Language · Computer Science 2024-04-30 Yichuan Li , Kaize Ding , Jianling Wang , Kyumin Lee

Large Language Models (LLMs) have achieved impressive performance in text understanding and have become an essential tool for building smart assistants. Originally focusing on text, they have been enhanced with multimodal capabilities in…

Software Engineering · Computer Science 2024-10-24 Aaron Haag , Vlad Argatu , Oliver Lohse