English
Related papers

Related papers: VCode: a Multimodal Coding Benchmark with SVG as S…

200 papers

While Large Language Models (LLMs) have excelled in textual reasoning, they struggle with mathematical domains like geometry that intrinsically rely on visual aids. Existing approaches to Visual Chain-of-Thought (VCoT) are often limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Weikang Shi , Aldrich Yu , Rongyao Fang , Houxing Ren , Ke Wang , Aojun Zhou , Changyao Tian , Xinyu Fu , Yuxuan Hu , Zimu Lu , Linjiang Huang , Si Liu , Rui Liu , Hongsheng Li

Node-based programming languages are increasingly popular in media arts coding domains. These languages are designed to be accessible to users with limited coding experience, allowing them to achieve creative output without an extensive…

Large language models (LLMs) excel at program synthesis, yet their ability to produce symbolic graphics programs (SGPs) that render into precise visual content remains underexplored. We study symbolic graphics programming, where the goal is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Yamei Chen , Haoquan Zhang , Yangyi Huang , Zeju Qiu , Kaipeng Zhang , Yandong Wen , Weiyang Liu

When thinking with images, humans rarely rely on a single glance: they revisit visual evidence while reasoning. In contrast, most Multimodal Language Models encode an image once to key-value cache and then reason purely in text, making it…

Computation and Language · Computer Science 2026-05-08 Jiwan Chung , Junhyeok Kim , Siyeol Kim , Jaeyoung Lee , Min Soo Kim , Youngjae Yu

Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground intermediate concepts, and perform multi-step logical inference.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fucai Ke , Joy Hsu , Zhixi Cai , Zixian Ma , Xin Zheng , Xindi Wu , Sukai Huang , Weiqing Wang , Pari Delir Haghighi , Gholamreza Haffari , Ranjay Krishna , Jiajun Wu , Hamid Rezatofighi

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu

Mathematical reasoning is a hallmark of human intelligence, requiring logical deduction, symbolic manipulation, and abstract thinking. Recent multimodal large language models (MLLMs) have demonstrated strong performance on geometry problems…

Computation and Language · Computer Science 2026-05-26 Yingji Zhang , Yong Dai , André Freitas

Vision Language Models (VLMs) have demonstrated remarkable potential in multimodal reasoning, yet they inherently suffer from spatial blindness and logical hallucinations when interpreting densely structured engineering content, such as…

Multiagent Systems · Computer Science 2026-03-25 Guanyuan Pan , Shuai Wang , Yugui Lin , Tiansheng Zhou , Pietro Liò , Zhenxin Zhao , Yaqi Wang

We present CV4Code, a compact and effective computer vision method for sourcecode understanding. Our method leverages the contextual and the structural information available from the code snippet by treating each snippet as a…

Software Engineering · Computer Science 2022-05-19 Ruibo Shi , Lili Tao , Rohan Saphal , Fran Silavong , Sean J. Moran

Multimodal large language models (MLLMs) that think with images can interactively use tools to reason about visual inputs, but current approaches often rely on a narrow set of tools with limited real-world necessity and scalability. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zirun Guo , Minjie Hong , Feng Zhang , Kai Jia , Tao Jin

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal…

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

Computation and Language · Computer Science 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Large Language Models (LLMs) have shown impressive potential in generating Verilog codes, but ensuring functional correctness remains a challenge. Existing approaches often rely on self-consistency or simulation feedback to select the best…

Hardware Architecture · Computer Science 2025-11-05 Zhuorui Zhao , Bing Li , Grace Li Zhang , Ulf Schlichtmann

Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs). Yet, its potential in multimodal large language models (MLLMs) remains largely untapped, hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Lingxiao Li , Yifan Wang , Xinyan Gao , Chen Tang , Xiangyu Yue , Chenyu You

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

A hallmark of advanced artificial intelligence is the capacity to progress from passive visual perception to the strategic modification of visual information to facilitate complex reasoning. This advanced capability, however, remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jingkun Ma , Runzhe Zhan , Yang Li , Di Sun , Hou Pong Chan , Lidia S. Chao , Derek F. Wong

While "Intent-oriented programming" (or "Vibe Coding") redefines software engineering, existing code agents remain tethered to static code snapshots. Consequently, they struggle to model the critical information embedded in the temporal…

Machine Learning · Computer Science 2026-03-17 Yi-Xuan Deng , Xiaoqin Liu , Yi Zhang , Guo-Wei Yang , Shuojin Yang

Large vision-language models (LVLMs) have demonstrated remarkable capabilities by integrating pre-trained vision encoders with large language models (LLMs). Similar to single-modal LLMs, chain-of-thought (CoT) prompting has been adapted for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa

Visual programs are executable code generated by large language models to address visual reasoning problems. They decompose complex questions into multiple reasoning steps and invoke specialized models for each step to solve the problems.…

Computation and Language · Computer Science 2024-10-07 Xueqing Wu , Zongyu Lin , Songyan Zhao , Te-Lin Wu , Pan Lu , Nanyun Peng , Kai-Wei Chang