English
Related papers

Related papers: Macro-Queries: An Exploration into Guided Chart Ge…

200 papers

Recently, large language models (LLMs) have shown great promise in translating natural language (NL) queries into visualizations, but their "black-box" nature often limits explainability and debuggability. In response, we present a…

Human-Computer Interaction · Computer Science 2024-08-28 Subham Sah , Rishab Mitra , Arpit Narechania , Alex Endert , John Stasko , Wenwen Dou

A number of tasks have been proposed recently to facilitate easy access to charts such as chart QA and summarization. The dominant paradigm to solve these tasks has been to fine-tune a pretrained model on the task data. However, this…

Computation and Language · Computer Science 2023-12-19 Xuan Long Do , Mohammad Hassanpour , Ahmed Masry , Parsa Kavehzadeh , Enamul Hoque , Shafiq Joty

In the era of data-driven decision-making, accurate table-level representations and efficient table recommendation systems are becoming increasingly crucial for improving table management, discovery, and analysis. However, existing…

Machine Learning · Computer Science 2024-11-07 Dayu Yang , Natawut Monaikul , Amanda Ding , Bozhao Tan , Kishore Mosaliganti , Giri Iyengar

Schemas play a vital role in ensuring data quality and supporting usability in the Semantic Web and natural language processing. Traditionally, their creation demands substantial involvement from knowledge engineers and domain experts.…

Artificial Intelligence · Computer Science 2025-10-03 Bohui Zhang , Yuan He , Lydia Pintscher , Albert Meroño Peñuela , Elena Simperl

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Vision Language Models (VLMs) often struggle with chart understanding tasks, particularly in accurate chart description and complex reasoning. Synthetic data generation is a promising solution, while usually facing the challenge of noise…

Artificial Intelligence · Computer Science 2025-08-19 Gongyao Jiang , Qiong Luo

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

Tables, typically two-dimensional and structured to store large amounts of data, are essential in daily activities like database queries, spreadsheet manipulations, web table question answering, and image table information extraction.…

Artificial Intelligence · Computer Science 2024-11-05 Weizheng Lu , Jing Zhang , Ju Fan , Zihao Fu , Yueguo Chen , Xiaoyong Du

A critical question about Large Language Models (LLMs) is whether their apparent deficiency in mathematical reasoning is inherent, or merely a result of insufficient exposure to high-quality mathematical data. To explore this, we developed…

Artificial Intelligence · Computer Science 2024-12-09 Zenan Li , Zhi Zhou , Yuan Yao , Yu-Feng Li , Chun Cao , Fan Yang , Xian Zhang , Xiaoxing Ma

Charts are the dominant medium for visualizing data, discovering patterns and trends, and communicating data driven insights, yet designing them still requires expensive human effort and expertise, such as selecting appropriate chart types,…

Human-Computer Interaction · Computer Science 2026-05-19 Mohammed Afaan Ansari , Aniruddh Bansal , Tianyi Zhou

Tables have gained significant attention in large language models (LLMs) and multimodal large language models (MLLMs) due to their complex and flexible structure. Unlike linear text inputs, tables are two-dimensional, encompassing formats…

Computation and Language · Computer Science 2025-08-04 Xiaofeng Wu , Alan Ritter , Wei Xu

Large Language Models (LLMs) have revolutionized natural language processing by generating human-like text and images from textual input. However, their potential to generate complex 2D/3D visualizations has been largely unexplored. We…

Software Engineering · Computer Science 2023-05-12 Hans-Georg Fill , Fabian Muff

The Natural Language to Visualization (NL2Vis) task aims to transform natural-language descriptions into visual representations for a grounded table, enabling users to gain insights from vast amounts of data. Recently, many deep…

Databases · Computer Science 2024-04-29 Yang Wu , Yao Wan , Hongyu Zhang , Yulei Sui , Wucai Wei , Wei Zhao , Guandong Xu , Hai Jin

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Kohei Uehara , Nabarun Goswami , Hanqin Wang , Toshiaki Baba , Kohtaro Tanaka , Tomohiro Hashimoto , Kai Wang , Rei Ito , Takagi Naoya , Ryo Umagami , Yingyi Wen , Tanachai Anakewat , Tatsuya Harada

Recommender systems have become integral to our digital experiences, from online shopping to streaming platforms. Still, the rationale behind their suggestions often remains opaque to users. While some systems employ a graph-based approach,…

This article analyzes the use of Large Language Models (LLMs) as support for the conceptual modeling of relational databases through the automatic generation of Entity-Relationship (ER) diagrams from natural language requirements. The…

Artificial Intelligence · Computer Science 2026-05-13 Arthur F. Siqueira , Carlos D. S. Nogueira , Eduarda Farias , Claudio E. C. Campelo , Júlia Menezes

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

Computation and Language · Computer Science 2024-06-12 Sylvio Barbon Junior , Paolo Ceravolo , Sven Groppe , Mustafa Jarrar , Samira Maghool , Florence Sèdes , Soror Sahri , Maurice Van Keulen

Recent advancements in large language models have revolutionized information access, as these models harness data available on the web to address complex queries, becoming the preferred information source for many users. In certain cases,…

Computation and Language · Computer Science 2024-06-27 Darius Coelho , Harshit Barot , Naitik Rathod , Klaus Mueller

Large Language models (LLMs) usually rely on extensive training datasets. In the financial domain, creating numerical reasoning datasets that include a mix of tables and long text often involves substantial manual annotation expenses. To…

Artificial Intelligence · Computer Science 2024-01-22 Ziqiang Yuan , Kaiyuan Wang , Shoutai Zhu , Ye Yuan , Jingya Zhou , Yanlin Zhu , Wenqi Wei

In software engineering processes, systems are first specified using a modeling language such as UML. These initial designs are often collaboratively created, many times in meetings where different domain experts use whiteboards, paper or…

Software Engineering · Computer Science 2024-12-10 Aaron Conrardy , Jordi Cabot