English
Related papers

Related papers: Improved Iterative Refinement for Chart-to-Code Ge…

200 papers

Motivated by the substantial achievements observed in Large Language Models (LLMs) in the field of natural language processing, recent research has commenced investigations into the application of LLMs for complex, long-horizon sequential…

Robotics · Computer Science 2023-08-29 Zhehua Zhou , Jiayang Song , Kunpeng Yao , Zhan Shu , Lei Ma

Charts are the dominant medium for visualizing data, discovering patterns and trends, and communicating data driven insights, yet designing them still requires expensive human effort and expertise, such as selecting appropriate chart types,…

Human-Computer Interaction · Computer Science 2026-05-19 Mohammed Afaan Ansari , Aniruddh Bansal , Tianyi Zhou

Large language models (LLMs) have advanced general-purpose reasoning, showing strong performance across diverse tasks. However, existing methods often rely on implicit exploration, where the model follows stochastic and unguided reasoning…

Artificial Intelligence · Computer Science 2025-09-09 Jiaxiang Chen , Zhuo Wang , Mingxi Zou , Zhucong Li , Zhijian Zhou , Song Wang , Zenglin Xu

Screenshot-to-code generation aims to translate user interface screenshots into executable frontend code that faithfully reproduces the target layout and style. Existing multimodal large language models perform this mapping directly from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jie Deng , Kaichun Yao , Libo Zhang

Employing LLMs for visual generation has recently become a research focus. However, the existing methods primarily transfer the LLM architecture to visual generation but rarely investigate the fundamental differences between language and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Teng Hu , Jiangning Zhang , Ran Yi , Jieyu Weng , Yabiao Wang , Xianfang Zeng , Zhucun Xue , Lizhuang Ma

Multimodal large language models (MLLM) have achieved satisfactory results in many tasks. However, their performance in the task of ReID (ReID) has not been explored to date. This paper will investigate how to adapt them for the task of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Shan Yang , Yongfei Zhang

Vision Language Models (VLMs) often struggle with chart understanding tasks, particularly in accurate chart description and complex reasoning. Synthetic data generation is a promising solution, while usually facing the challenge of noise…

Artificial Intelligence · Computer Science 2025-08-19 Gongyao Jiang , Qiong Luo

Text-to-Visualization (Text2Vis) systems translate natural language queries over tabular data into concise answers and executable visualizations. While closed-source LLMs generate functional code, the resulting charts often lack semantic…

Computation and Language · Computer Science 2026-01-09 Mizanur Rahman , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Large Language Models (LLMs) have demonstrated strong capabilities in transforming text descriptions or tables to data visualizations via instruction-tuning methods. However, it is not straightforward to apply these methods directly for a…

Computation and Language · Computer Science 2025-08-28 Akriti Jain , Pritika Ramu , Aparna Garimella , Apoorv Saxena

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

This paper introduces MM-Instruct, a large-scale dataset of diverse and high-quality visual instruction data designed to enhance the instruction-following capabilities of large multimodal models (LMMs). While existing visual instruction…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jihao Liu , Xin Huang , Jinliang Zheng , Boxiao Liu , Jia Wang , Osamu Yoshie , Yu Liu , Hongsheng Li

Most existing low-light image enhancement (LLIE) methods rely on pre-trained model priors, low-light inputs, or both, while neglecting the semantic guidance available from normal-light images. This limitation hinders their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xiaoran Sun , Liyan Wang , Yeying Jin , Kin-man Lam , Zhixun Su , Yang Yang , Jinshan Pan , Cong Wang

Providing access to information across languages has been a goal of Information Retrieval (IR) for decades. While progress has been made on Cross Language IR (CLIR) where queries are expressed in one language and documents in another, the…

Information Retrieval · Computer Science 2023-02-10 Dawn Lawrie , Eugene Yang , Douglas W. Oard , James Mayfield

Iterative self-refinement is a simple inference-time strategy for machine translation: an LLM revises its own translation over multiple inference-time passes. Yet document-scale refinement remains poorly understood: 1) which pipelines work…

Computation and Language · Computer Science 2026-05-14 Shaomu Tan , Dawei Zhu , Ke Tran , Michael Denkowski , Sony Trenous , Bill Byrne , Leonardo Ribeiro , Felix Hieber

Composed Image Retrieval (CIR) aims to retrieve target images from candidate set using a hybrid-modality query consisting of a reference image and a relative caption that describes the user intent. Recent studies attempt to utilize…

Information Retrieval · Computer Science 2024-12-17 Zelong Sun , Dong Jing , Guoxing Yang , Nanyi Fei , Zhiwu Lu

Despite the success of Large Vision--Language Models (LVLMs), most existing architectures suffer from a representation bottleneck: they rely on static, instruction-agnostic vision encoders whose visual representations are utilized in an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hanpeng Liu , Yaqian Li , Zidan Wang , Shuoxi Zhang , Zihao Bo , Rinyoichi Takezoe , Kaiwen Long , Kun He

This paper introduces Code-Vision, a benchmark designed to evaluate the logical understanding and code generation capabilities of Multimodal Large Language Models (MLLMs). It challenges MLLMs to generate a correct program that fulfills…

Computation and Language · Computer Science 2025-02-18 Hanbin Wang , Xiaoxuan Zhou , Zhipeng Xu , Keyuan Cheng , Yuxin Zuo , Kai Tian , Jingwei Song , Junting Lu , Wenhui Hu , Xueyang Liu

Chart understanding presents a critical test to the reasoning capabilities of Vision-Language Models (VLMs). Prior approaches face critical limitations: some rely on external tools, making them brittle and constrained by a predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Bohao Tang , Yan Ma , Fei Zhang , Jiadi Su , Ethan Chern , Zhulin Hu , Zhixin Wang , Pengfei Liu , Ya Zhang

Automating the transformation of user interface (UI) designs into front-end code holds significant promise for accelerating software development and democratizing design workflows. While multimodal large language models (MLLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yilei Jiang , Yaozhi Zheng , Yuxuan Wan , Jiaming Han , Qunzhong Wang , Michael R. Lyu , Xiangyu Yue

Despite the ubiquity of visualization examples published on the web, retargeting existing custom chart implementations to new datasets remains difficult, time-intensive, and tedious. The adaptation process assumes author familiarity with…

Human-Computer Interaction · Computer Science 2026-01-21 Luke S. Snyder , Chenglong Wang , Steven M. Drucker