English
Related papers

Related papers: NL4DV: A Toolkit for Generating Analytic Specifica…

200 papers

Data visualization (DV) is the fundamental and premise tool to improve the efficiency in conveying the insights behind the big data, which has been widely accepted in existing data-driven world. Task automation in DV, such as converting…

Computation and Language · Computer Science 2025-05-28 Zhuoyue Wan , Yuanfeng Song , Shuaimin Li , Chen Jason Zhang , Raymond Chi-Wing Wong

We develop NL2INTERFACE to explore the potential of generating usable interactive multi-visualization interfaces from natural language queries. With NL2INTERFACE, users can directly write natural language queries to automatically generate a…

Human-Computer Interaction · Computer Science 2023-01-02 Yiru Chen , Ryan Li , Austin Mac , Tianbao Xie , Tao Yu , Eugene Wu

Domain-specific languages (DSLs) for visualization aim to facilitate visualization creation by providing abstractions that offload implementation and execution details from users to the system layer. Therefore, DSLs often execute…

Human-Computer Interaction · Computer Science 2023-09-20 Junran Yang , Alex Bäuerle , Dominik Moritz , Çağatay Demiralp

Large vision-language models (LVLMs) have shown premise in a broad range of vision-language tasks with their strong reasoning and generalization capabilities. However, they require considerable computational resources for training and…

Computation and Language · Computer Science 2024-06-18 Guiming Hardy Chen , Shunian Chen , Ruifei Zhang , Junying Chen , Xiangbo Wu , Zhiyi Zhang , Zhihong Chen , Jianquan Li , Xiang Wan , Benyou Wang

While many visualization specification languages are user-friendly, they tend to have one critical drawback: they are designed for small data on the client-side and, as a result, perform poorly at scale. We propose a system that takes…

Databases · Computer Science 2022-03-10 Junran Yang , Hyekang Kevin Joo , Sai S. Yerramreddy , Siyao Li , Dominik Moritz , Leilani Battle

Natural Language Video Description (NLVD) has recently received strong interest in the Computer Vision, Natural Language Processing (NLP), Multimedia, and Autonomous Robotics communities. The State-of-the-Art (SotA) approaches obtained…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Silvia Cascianelli , Gabriele Costante , Alessandro Devo , Thomas A. Ciarfuglia , Paolo Valigi , Mario L. Fravolini

The use of natural language interfaces (NLIs) to create charts is becoming increasingly popular due to the intuitiveness of natural language interactions. One key challenge in this approach is to accurately capture user intents and…

Human-Computer Interaction · Computer Science 2025-01-22 Yuan Tian , Weiwei Cui , Dazhen Deng , Xinjing Yi , Yurun Yang , Haidong Zhang , Yingcai Wu

Users often rely on GUIs to edit and interact with visualizations - a daunting task due to the large space of editing options. As a result, users are either overwhelmed by a complex UI or constrained by a custom UI with a tailored, fixed…

Human-Computer Interaction · Computer Science 2024-01-22 Priyan Vaithilingam , Elena L. Glassman , Jeevana Priya Inala , Chenglong Wang

NL2VIS (natural language to visualization) is a promising and recent research area that involves interpreting natural language queries and translating them into visualizations that accurately represent the underlying data. As we navigate…

Human-Computer Interaction · Computer Science 2024-08-01 Luca Podo , Marco Angelini , Paola Velardi

We propose a new technique based on program synthesis for automatically generating visualizations from natural language queries. Our method parses the natural language query into a refinement type specification using the intents-and-slots…

Programming Languages · Computer Science 2022-09-05 Qiaochu Chen , Shankara Pailoor , Celeste Barnaby , Abby Criswell , Chenglong Wang , Greg Durrett , Isil Dillig

Natural language is a powerful complementary modality of communication for data visualizations, such as bar and line charts. To facilitate chart-based reasoning using natural language, various downstream tasks have been introduced recently…

Computation and Language · Computer Science 2024-10-07 Mohammed Saidul Islam , Raian Rahman , Ahmed Masry , Md Tahmid Rahman Laskar , Mir Tafseer Nayeem , Enamul Hoque

The identification of analytic tasks from free text is critical for visualization-oriented natural language interfaces (V-NLIs) to suggest effective visualizations. However, it is challenging due to the ambiguity and complexity nature of…

Computation and Language · Computer Science 2020-12-04 Siwei Fu , Kai Xiong , Xiaodong Ge , Siliang Tang , Wei Chen , Yingcai Wu

Automatically generating data visualizations in response to human utterances on datasets necessitates a deep semantic understanding of the data utterance, including implicit and explicit references to data attributes, visualization tasks,…

Artificial Intelligence · Computer Science 2024-07-10 Hannah K. Bako , Arshnoor Bhutani , Xinyi Liu , Kwesi A. Cobbina , Zhicheng Liu

This paper introduces the Text-to-TrajVis task, which aims to transform natural language questions into trajectory data visualizations, facilitating the development of natural language interfaces for trajectory visualization systems. As…

Computation and Language · Computer Science 2025-04-24 Tian Bai , Huiyan Ying , Kailong Suo , Junqiu Wei , Tao Fan , Yuanfeng Song

Automated data visualization plays a crucial role in simplifying data interpretation, enhancing decision-making, and improving efficiency. While large language models (LLMs) have shown promise in generating visualizations from natural…

Computation and Language · Computer Science 2025-07-29 Mizanur Rahman , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Manual creation of IT monitoring dashboard widgets is slow, error-prone, and a barrier for both novice and expert users. We present NOVAID, an interactive chatbot that leverages Large Language Models (LLMs) to generate IT monitoring widgets…

Human-Computer Interaction · Computer Science 2026-01-21 Pratik Mishra , Caner Gözübüyük , Seema Nagar , Prateeti Mohapatra , Raya Wittich , Arthur de Magalhaes

Natural language interfaces (NLIs) have become a prevalent medium for conducting visual data analysis, enabling people with varying levels of analytic experience to ask questions of and interact with their data. While there have been…

Human-Computer Interaction · Computer Science 2021-10-12 Arjun Srinivasan , Vidya Setlur

Existing data visualization formalisms are restricted to single-table inputs, which makes existing visualization grammars like Vega-lite or ggplot2 tedious to use, have overly complex APIs, and unsound when visualization multi-table data.…

Databases · Computer Science 2025-04-15 Eugene Wu , Xiang Yu Tuang , Antonio Li , Vareesh Bainwala

Data visualization is essential for interpreting complex datasets, yet traditional tools often require technical expertise, limiting accessibility. VizGen is an AI-assisted graph generation system that empowers users to create meaningful…

Rapidly creating effective visualizations using expressive grammars is challenging for users who have limited time and limited skills in statistics and data visualization. Even high-level, dedicated visualization tools often require users…

Human-Computer Interaction · Computer Science 2018-11-06 Victor Dibia , Çağatay Demiralp