English
Related papers

Related papers: NL2INTERFACE: Interactive Visualization Interface …

200 papers

Natural Language to Visualization (NL2Vis) seeks to convert natural-language descriptions into visual representations of given tables, empowering users to derive insights from large-scale data. Recent advancements in Large Language Models…

Computation and Language · Computer Science 2025-02-10 Geliang Ouyang , Jingyao Chen , Zhihe Nie , Yi Gui , Yao Wan , Hongyu Zhang , Dongping Chen

Traditional approaches to building natural language (NL) interfaces typically use a semantic parser to parse the user command and convert it to a logical form, which is then translated to an executable action in an application. However, it…

Computation and Language · Computer Science 2021-11-29 Sahisnu Mazumder , Bing Liu , Shuai Wang , Sepideh Esmaeilpour

Natural language interfaces (NLIs) enable users to flexibly specify analytical intentions in data visualization. However, diagnosing the visualization results without understanding the underlying generation process is challenging. Our…

Human-Computer Interaction · Computer Science 2023-01-30 Yingchaojie Feng , Xingbo Wang , Bo Pan , Kam Kwai Wong , Yi Ren , Shi Liu , Zihan Yan , Yuxin Ma , Huamin Qu , Wei Chen

Knowledge graphs are often visualized using node-link diagrams that reveal relationships and structure. In many applications using graphs, it is desirable to allow users to edit graphs to ensure data accuracy or provides updates. Commonly…

Human-Computer Interaction · Computer Science 2025-12-15 Reza Shahriari , Eric D. Ragan , Jaime Ruiz

We propose a new technique based on program synthesis for automatically generating visualizations from natural language queries. Our method parses the natural language query into a refinement type specification using the intents-and-slots…

Programming Languages · Computer Science 2022-09-05 Qiaochu Chen , Shankara Pailoor , Celeste Barnaby , Abby Criswell , Chenglong Wang , Greg Durrett , Isil Dillig

Recent advances in Generative AI have transformed how users interact with data analysis through natural language interfaces. However, many systems rely too heavily on LLMs, creating risks of hallucination, opaque reasoning, and reduced user…

Human-Computer Interaction · Computer Science 2025-09-04 Ratanond Koonchanok , Alex Kale , Khairi Reda

The field of data visualisation has long aimed to devise solutions for generating visualisations directly from natural language text. Research in Natural Language Interfaces (NLIs) has contributed towards the development of such techniques.…

Human-Computer Interaction · Computer Science 2023-02-14 Paula Maddigan , Teo Susnjak

The growing reliance on data-driven decision-making highlights the need for more intuitive ways to access and analyze information stored in relational databases. However, the requirement of SQL knowledge has long been a significant barrier…

Databases · Computer Science 2024-10-10 Steve Tueno Fotso

The use of natural language interfaces (NLIs) to create charts is becoming increasingly popular due to the intuitiveness of natural language interactions. One key challenge in this approach is to accurately capture user intents and…

Human-Computer Interaction · Computer Science 2025-01-22 Yuan Tian , Weiwei Cui , Dazhen Deng , Xinjing Yi , Yurun Yang , Haidong Zhang , Yingcai Wu

Natural language and visualization are two complementary modalities of human communication that play a crucial role in conveying information effectively. While visualizations help people discover trends, patterns, and anomalies in data,…

Computation and Language · Computer Science 2024-10-01 Enamul Hoque , Mohammed Saidul Islam

We advocate the idea of the natural-language-driven(NLD) simulation to efficiently produce the object interactions between multiple objects in the virtual road scenes, for teaching and testing the autonomous driving systems that should take…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Kairui Yang , Zihao Guo , Gengjie Lin , Haotian Dong , Die Zuo , Jibin Peng , Zhao Huang , Zhecheng Xu , Fupeng Li , Ziyun Bai , Di Lin

A lot of sensor network applications are data-driven. We believe that query is the most preferred way to discover sensor services. Normally users are unaware of available sensors. Thus users need to pose different types of query over the…

Information Retrieval · Computer Science 2012-08-21 A. F. M. Sultanul Kabir , Mohammad Saiful Islam Mamun

Large Language Models (LLMs) have revolutionized natural language processing by generating human-like text and images from textual input. However, their potential to generate complex 2D/3D visualizations has been largely unexplored. We…

Software Engineering · Computer Science 2023-05-12 Hans-Georg Fill , Fabian Muff

Users often rely on GUIs to edit and interact with visualizations - a daunting task due to the large space of editing options. As a result, users are either overwhelmed by a complex UI or constrained by a custom UI with a tailored, fixed…

Human-Computer Interaction · Computer Science 2024-01-22 Priyan Vaithilingam , Elena L. Glassman , Jeevana Priya Inala , Chenglong Wang

The rise of Large Language Models (LLMs) and generative visual analytics systems has transformed data-driven insights, yet significant challenges persist in accurately interpreting users' analytical and interaction intents. While language…

Human-Computer Interaction · Computer Science 2025-04-17 Juntong Chen , Jiang Wu , Jiajing Guo , Vikram Mohanty , Xueming Li , Jorge Piazentin Ono , Wenbin He , Liu Ren , Dongyu Liu

We propose leveraging Large Language Models (LLMs) as an interaction layer for medical visualization systems. In domains like healthcare, where users must navigate high-dimensional, coded, and heterogeneous datasets, LLM-generated queries…

Human-Computer Interaction · Computer Science 2025-09-12 Ambre Assor , Hyeon Jeon , Sungbok Shin , Jean-Daniel Fekete

The evolution of Large Language Models (LLMs) has showcased remarkable capacities for logical reasoning and natural language comprehension. These capabilities can be leveraged in solutions that semantically and textually model complex…

Human-Computer Interaction · Computer Science 2024-04-17 Syed Mekael Wasti , Ken Q. Pu , Ali Neshati

Interactive tools make data analysis both more efficient and more accessible to a broad population. Simple interfaces such as Google Finance as well as complex visual exploration interfaces such as Tableau are effective because they are…

Databases · Computer Science 2017-12-04 Haoci Zhang , Thibault Sellam , Eugene Wu

Natural language generation (NLG) models have emerged as a focal point of research within natural language processing (NLP), exhibiting remarkable performance in tasks such as text composition and dialogue generation. However, their…

Human-Computer Interaction · Computer Science 2025-07-04 Yunchao Wang , Guodao Sun , Zihang Fu , Ronghua Liang

We highlight the connections between data provenance and interactive visualizations. To do so, we first incrementally add interactions to a visualization and show how these interactions are readily expressible in terms of provenance. We…

Databases · Computer Science 2018-05-08 Fotis Psallidas , Eugene Wu