English
Related papers

Related papers: ChatVis: Automating Scientific Visualization with …

200 papers

Research scientists increasingly rely on implementing software to support their research. While previous research has examined the impact of identifier names on program comprehension in traditional programming environments, limited work has…

Software Engineering · Computer Science 2025-07-23 Gunnar Larsen , Carol Wong , Anthony Peruma

Evaluating outputs of large language models (LLMs) is challenging, requiring making -- and making sense of -- many responses. Yet tools that go beyond basic prompting tend to require knowledge of programming APIs, focus on narrow domains,…

Human-Computer Interaction · Computer Science 2024-05-07 Ian Arawjo , Chelse Swoopes , Priyan Vaithilingam , Martin Wattenberg , Elena Glassman

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Kohei Uehara , Nabarun Goswami , Hanqin Wang , Toshiaki Baba , Kohtaro Tanaka , Tomohiro Hashimoto , Kai Wang , Rei Ito , Takagi Naoya , Ryo Umagami , Yingyi Wen , Tanachai Anakewat , Tatsuya Harada

With ChatGPT-like large language models (LLM) prevailing in the community, how to evaluate the ability of LLMs is an open question. Existing evaluation methods suffer from following shortcomings: (1) constrained evaluation abilities, (2)…

Artificial Intelligence · Computer Science 2023-08-09 Jiaju Lin , Haoran Zhao , Aochi Zhang , Yiting Wu , Huqiuyue Ping , Qin Chen

Architects adopt visual scripting and parametric design tools to explore more expansive design spaces (Coates, 2010), refine their thinking about the geometric logic of their design (Woodbury, 2010), and overcome conventional software…

Computation and Language · Computer Science 2024-12-05 Moritz Rietschel , Fang Guo , Kyle Steinfeld

Scientific visualization pipelines encode domain-specific procedural knowledge with strict execution dependencies, making their construction sensitive to missing stages, incorrect operator usage, or improper ordering. Thus, generating…

Graphics · Computer Science 2026-03-30 Guanghui Zhao , Zhe Wang , Yu Dong , Guan Li , GuiHua Shan

Large vision-language models (LVLMs) have shown premise in a broad range of vision-language tasks with their strong reasoning and generalization capabilities. However, they require considerable computational resources for training and…

Computation and Language · Computer Science 2024-06-18 Guiming Hardy Chen , Shunian Chen , Ruifei Zhang , Junying Chen , Xiangbo Wu , Zhiyi Zhang , Zhihong Chen , Jianquan Li , Xiang Wan , Benyou Wang

Using large language models (LLMs) to generate source code from natural language prompts is a popular and promising idea with a wide range of applications. One of its limitations is that the generated code can be faulty at times, often in a…

Software Engineering · Computer Science 2025-01-14 Yue Chen Li , Stefan Zetzsche , Siva Somayyajula

Large language models (LLMs) have attracted considerable attention as they are capable of showcasing impressive capabilities generating comparable high-quality responses to human inputs. LLMs, can not only compose textual scripts such as…

Computational Engineering, Finance, and Science · Computer Science 2024-05-31 Denish Omondi Otieno , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin

While intelligent virtual assistants like Siri, Alexa, and Google Assistant have become ubiquitous in modern life, they still face limitations in their ability to follow multi-step instructions and accomplish complex goals articulated in…

Machine Learning · Computer Science 2023-12-13 Yanchu Guan , Dong Wang , Zhixuan Chu , Shiyu Wang , Feiyue Ni , Ruihua Song , Longfei Li , Jinjie Gu , Chenyi Zhuang

We present our vision for developing an automated tool capable of translating visual properties observed in Machine Learning (ML) visualisations into Python assertions. The tool aims to streamline the process of manually verifying these…

Software Engineering · Computer Science 2024-01-17 Arumoy Shome , Luis Cruz , Arie van Deursen

The advent of Large Language Models (LLM) provides new insights to validate Automated Driving Systems (ADS). In the herein-introduced work, a novel approach to extracting scenarios from naturalistic driving datasets is presented. A…

Robotics · Computer Science 2024-07-19 Yongqi Zhao , Wenbo Xiao , Tomislav Mihalj , Jia Hu , Arno Eichberger

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Computation and Language · Computer Science 2025-02-14 Lena Schmidt , Kaitlyn Hair , Sergio Graziosi , Fiona Campbell , Claudia Kapp , Alireza Khanteymoori , Dawn Craig , Mark Engelbert , James Thomas

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

Computation and Language · Computer Science 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

Visual object tracking aims to locate a targeted object in a video sequence based on an initial bounding box. Recently, Vision-Language~(VL) trackers have proposed to utilize additional natural language descriptions to enhance versatility…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yiming Sun , Fan Yu , Shaoxiang Chen , Yu Zhang , Junwei Huang , Chenhui Li , Yang Li , Changbo Wang

Scene simulation in autonomous driving has gained significant attention because of its huge potential for generating customized data. However, existing editable scene simulation approaches face limitations in terms of user interaction…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Yuxi Wei , Zi Wang , Yifan Lu , Chenxin Xu , Changxing Liu , Hao Zhao , Siheng Chen , Yanfeng Wang

Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have…

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

Computation and Language · Computer Science 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

In visual analytics, applying filters to drill-down and extract higher-value insights is a common and important data analysis method. When the drill-down space becomes excessively large, analysts may lose orientation, leading to decreased…

Human-Computer Interaction · Computer Science 2026-04-21 Zhijun Zheng , Tian Qiu , Yuheng Zhao , Siming Chen

Code review is one of the key processes in the software development lifecycle and is essential to maintain code quality. However, manual code review is subjective and time consuming. Given its rule-based nature, code review is well suited…

Software Engineering · Computer Science 2025-07-25 Busra Icoz , Goksel Biricik