English
Related papers

Related papers: Text-to-TrajVis: Enabling Trajectory Data Visualiz…

200 papers

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Human-Computer Interaction · Computer Science 2025-08-01 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

This paper introduces BEV-VLM, a novel approach for trajectory planning in autonomous driving that leverages Vision-Language Models (VLMs) with Bird's-Eye View (BEV) feature maps as visual input. Unlike conventional trajectory planning…

Robotics · Computer Science 2026-03-02 Guancheng Chen , Sheng Yang , Tong Zhan , Jian Wang

Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jingyi Zhang , Jiaxing Huang , Sheng Jin , Shijian Lu

Unified vision large language models (VLLMs) have recently achieved impressive advancements in both multimodal understanding and generation, powering applications such as visual question answering and text-guided image synthesis. However,…

Computation and Language · Computer Science 2025-09-19 Pengyu Wang , Shaojun Zhou , Chenkun Tan , Xinghao Wang , Wei Huang , Zhen Ye , Zhaowei Li , Botian Jiang , Dong Zhang , Xipeng Qiu

NL2VIS (natural language to visualization) is a promising and recent research area that involves interpreting natural language queries and translating them into visualizations that accurately represent the underlying data. As we navigate…

Human-Computer Interaction · Computer Science 2024-08-01 Luca Podo , Marco Angelini , Paola Velardi

Large-scale vision-language models (VLMs) pre-trained on billion-level data have learned general visual representations and broad visual concepts. In principle, the well-learned knowledge structure of the VLMs should be inherited…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Tao Yu , Zhihe Lu , Xin Jin , Zhibo Chen , Xinchao Wang

We present VisionLLM v2, an end-to-end generalist multimodal large model (MLLM) that unifies visual perception, understanding, and generation within a single framework. Unlike traditional MLLMs limited to text output, VisionLLM v2…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jiannan Wu , Muyan Zhong , Sen Xing , Zeqiang Lai , Zhaoyang Liu , Zhe Chen , Wenhai Wang , Xizhou Zhu , Lewei Lu , Tong Lu , Ping Luo , Yu Qiao , Jifeng Dai

Automatically captioning visualizations is not new, but recent advances in large language models(LLMs) open exciting new possibilities. In this tutorial, after providing a brief review of Information Visualization (InfoVis) principles and…

Computation and Language · Computer Science 2024-07-01 Giuseppe Carenini , Jordon Johnson , Ali Salamatian

Text data mining is the process of deriving essential information from language text. Typical text mining tasks include text categorization, text clustering, topic modeling, information extraction, and text summarization. Various data sets…

Databases · Computer Science 2022-12-21 Meng Jiang

Rapidly creating effective visualizations using expressive grammars is challenging for users who have limited time and limited skills in statistics and data visualization. Even high-level, dedicated visualization tools often require users…

Human-Computer Interaction · Computer Science 2018-11-06 Victor Dibia , Çağatay Demiralp

As Large Language Models (LLMs) continue to revolutionize Natural Language Processing (NLP) applications, critical concerns about their trustworthiness persist, particularly in safety and robustness. To address these challenges, we…

Software Engineering · Computer Science 2025-10-16 Ruoyu Sun , Da Song , Jiayang Song , Yuheng Huang , Lei Ma

The text-to-SQL task aims to convert natural language into Structured Query Language (SQL) without bias. Recently, text-to-SQL methods based on large language models (LLMs) have garnered significant attention. The core of mainstream…

Databases · Computer Science 2025-02-25 Zeshun You , Jiebin Yao , Dong Cheng , Zhiwei Wen , Zhiliang Lu , Xianyi Shen

Visual analytics (VA) workflows are inherently complex, involving data transformation, feature engineering, visual representation, and human interpretation. They are typically described in unstructured prose, hindering systematic…

Artificial Intelligence · Computer Science 2026-05-26 Natalia Andrienko , Gennady Andrienko , Jürgen Bernard , Michael Sedlmair

Visual text evokes an image in a person's mind, while non-visual text fails to do so. A method to automatically detect visualness in text will enable text-to-image retrieval and generation models to augment text with relevant images. This…

Computation and Language · Computer Science 2023-10-24 Gaurav Verma , Ryan A. Rossi , Christopher Tensmeyer , Jiuxiang Gu , Ani Nenkova

We build upon time-series classification by leveraging the capabilities of Vision Language Models (VLMs). We find that VLMs produce competitive results after two or less epochs of fine-tuning. We develop a novel approach that incorporates…

Artificial Intelligence · Computer Science 2025-01-22 Vinay Prithyani , Mohsin Mohammed , Richa Gadgil , Ricardo Buitrago , Vinija Jain , Aman Chadha

Multimodal LLMs (MLLMs) are the natural extension of large language models to handle multimodal inputs, combining text and image data. They have recently garnered attention due to their capability to address complex tasks involving both…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Federico Cocchi , Nicholas Moratelli , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Current video analytics approaches face a fundamental trade-off between flexibility and efficiency. End-to-end Vision Language Models (VLMs) often struggle with long-context processing and incur high computational costs, while…

Databases · Computer Science 2025-05-28 Xiangru Jian , Wei Pang , Zhengyuan Dong , Chao Zhang , M. Tamer Özsu

The text-to-SQL problem aims to translate natural language questions into SQL statements to ease the interaction between database systems and end users. Recently, Large Language Models (LLMs) have exhibited impressive capabilities in a…

Databases · Computer Science 2025-04-04 Chen Shen , Jin Wang , Sajjadur Rahman , Eser Kandogan

The automatic generation of visualizations is an old task that, through the years, has shown more and more interest from the research and practitioner communities. Recently, large language models (LLM) have become an interesting option for…

Human-Computer Interaction · Computer Science 2024-02-06 Luca Podo , Muhammad Ishmal , Marco Angelini