English
Related papers

Related papers: NL2INTERFACE: Interactive Visualization Interface …

200 papers

Natural Language Processing (NLP) systems often make use of machine learning techniques that are unfamiliar to end-users who are interested in analyzing clinical records. Although NLP has been widely used in extracting information from…

Human-Computer Interaction · Computer Science 2017-07-10 Gaurav Trivedi , Phuong Pham , Wendy Chapman , Rebecca Hwa , Janyce Wiebe , Harry Hochheiser

"Natural Language," whether spoken and attended to by humans, or processed and generated by computers, requires networked structures that reflect creative processes in semantic, syntactic, phonetic, linguistic, social, emotional, and…

Computation and Language · Computer Science 2016-06-29 Joseph Corneli , Miriam Corneli

Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these…

Computation and Language · Computer Science 2021-10-22 Hendrik Strobelt , Jambay Kinley , Robert Krueger , Johanna Beyer , Hanspeter Pfister , Alexander M. Rush

A large part of the use of knowledge base systems is the interpretation of the output by the end-users and the interaction with these users. Even during the development process visualisations can be a great help to the developer. We created…

Programming Languages · Computer Science 2015-11-04 Ruben Lapauw , Ingmar Dasseville , Marc Denecker

Natural language database interfaces broaden data access, yet they remain brittle under input ambiguity. Standard approaches often collapse uncertainty into a single query, offering little support for mismatches between user intent and…

Human-Computer Interaction · Computer Science 2026-03-03 Robin Shing Moon Chan , Rita Sevastjanova , Mennatallah El-Assady

Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users.…

Human-Computer Interaction · Computer Science 2019-04-10 Forrest Huang , John F. Canny

While Large Language Models (LLMs) have demonstrated remarkable proficiency in generating standalone charts, synthesizing comprehensive dashboards remains a formidable challenge. Existing end-to-end paradigms, which typically treat…

Artificial Intelligence · Computer Science 2026-01-13 Boshen Shi , Kexin Yang , Yuanbo Yang , Guanguang Chang , Ce Chi , Zhendong Wang , Xing Wang , Junlan Feng

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

The applications of generative AI have become extremely impressive, and the interplay between users and AI is even more so. Current human-AI interaction literature has taken a broad look at how humans interact with generative AI, but it…

Text-to-Visualization (Text2VIS) enables users to create visualizations from natural language queries, making data insights more accessible. However, Text2VIS faces challenges in interpreting ambiguous queries, as users often express their…

Computation and Language · Computer Science 2026-01-06 Tianqi Luo , Chuhan Huang , Leixian Shen , Boyan Li , Shuyu Shen , Wei Zeng , Nan Tang , Yuyu Luo

One of the developers' biggest challenges in low-code platforms is retrieving data from a database using SQL queries. Here, we propose a pipeline allowing developers to write natural language (NL) to retrieve data. In this study, we…

Traditional standardized network interfaces face significant limitations, including vendor-specific incompatibilities, rigid design assumptions, and lack of adaptability for new functionalities. We propose a multi-agent framework leveraging…

Networking and Internet Architecture · Computer Science 2025-08-22 Abhishek Dandekar , Prashiddha D. Thapa , Ashrafur Rahman , Julius Schulz-Zander

Conversational user interfaces powered by large language models (LLMs) have significantly lowered the technical barriers to database querying. However, existing tools still encounter several challenges, such as misinterpretation of user…

Human-Computer Interaction · Computer Science 2025-08-22 Longfei Chen , Shenghan Gao , Shiwei Wang , Ken Lin , Yun Wang , Quan Li

APIs are everywhere; they provide access to automation solutions that could help businesses automate some of their tasks. Unfortunately, they may not be accessible to the business users who need them but are not equipped with the necessary…

Computation and Language · Computer Science 2022-06-15 Siyu Huo , Kushal Mukherjee , Jayachandu Bandlamudi , Vatche Isahagian , Vinod Muthusamy , Yara Rizk

Increasingly, keyword, natural language and NoSQL queries are being used for information retrieval from traditional as well as non-traditional databases such as web, document, image, GIS, legal, and health databases. While their popularity…

Databases · Computer Science 2017-04-03 Hasan M. Jamil

An engaging and provocative question can open up a great conversation. In this work, we explore a novel scenario: a conversation agent views a set of the user's photos (for example, from social media platforms) and asks an engaging question…

Artificial Intelligence · Computer Science 2022-05-20 Shih-Han Chan , Tsai-Lun Yang , Yun-Wei Chu , Chi-Yang Hsu , Ting-Hao Huang , Yu-Shian Chiu , Lun-Wei Ku

Querying knowledge bases using ontologies is usually performed using dedicated query languages, question-answering systems, or visual query editors for Knowledge Graphs. We propose a novel approach that enables users to query the knowledge…

Human-Computer Interaction · Computer Science 2025-12-02 Benedikt Kantz , Kevin Innerebner , Peter Waldert , Stefan Lengauer , Elisabeth Lex , Tobias Schreck

Traditional visualisation designers often start with sketches before implementation. With generative AI, these sketches can be turned into AI-generated visualisations using specific prompts. However, guiding AI to create compelling visuals…

Human-Computer Interaction · Computer Science 2024-09-04 Aron E. Owen , Jonathan C. Roberts

Deep Web databases contain more than 90% of pertinent information of the Web. Despite their importance, users don't profit of this treasury. Many deep web services are offering competitive services in term of prices, quality of service, and…

Information Retrieval · Computer Science 2012-05-07 Radhouane Boughamoura , Lobna Hlaoua , Mohamed Nazih Omri

In this paper we provide a first analysis of the research questions that arise when dealing with the problem of communicating pieces of formal argumentation through natural language interfaces. It is a generally held opinion that formal…

Artificial Intelligence · Computer Science 2017-06-14 Federico Cerutti , Alice Toniolo , Timothy J. Norman