English
Related papers

Related papers: GeoCoder: Solving Geometry Problems by Generating …

200 papers

Geometric Algebra (GA) presents challenges to learners due to its highly abstract mathematical structure and complex operational rules, as translating algebraic manipulations into concrete geometric interpretations is a non-intuitive…

Machine Learning · Computer Science 2026-05-05 Wang Jian , Zhou Jianbo , Xiong Yuhao , Liu Zhenxia , Luo Wen , Yuan LinWang , Yu ZhaoYuan

Geometric spatial reasoning forms the foundation of many applications in artificial intelligence, yet the ability of large language models (LLMs) to operate over geometric spatial information expressed in procedural code remains…

Artificial Intelligence · Computer Science 2026-02-11 Shixian Luo , Zezhou Zhu , Yu Yuan , Yuncheng Yang , Lianlei Shan , Yong Wu

Geometric understanding - including depth and height perception - is fundamental to intelligence and crucial for navigating our environment. Despite the impressive capabilities of large Vision Language Models (VLMs), it remains unclear how…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shehreen Azad , Yash Jain , Rishit Garg , Yogesh S Rawat , Vibhav Vineet

Multimodal large language models (MLLMs) have significantly advanced the integration of visual and textual understanding. However, their ability to generate code from multimodal inputs remains limited. In this work, we introduce VisCodex, a…

Computation and Language · Computer Science 2025-08-14 Lingjie Jiang , Shaohan Huang , Xun Wu , Yixia Li , Dongdong Zhang , Furu Wei

Geometry problem-solving (GPS), a challenging task requiring both visual comprehension and symbolic reasoning, effectively measures the reasoning capabilities of multimodal large language models (MLLMs). Humans exhibit strong reasoning…

Computation and Language · Computer Science 2025-04-25 Liangyu Xu , Yingxiu Zhao , Jingyun Wang , Yingyao Wang , Bu Pi , Chen Wang , Mingliang Zhang , Jihao Gu , Xiang Li , Xiaoyong Zhu , Jun Song , Bo Zheng

Multi-modal Large Language Models (MLLMs) have advanced greatly in general tasks. However, they still face challenges in geometric reasoning, a task that requires synergistic integration of visual recognition proficiency and complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhihao Li , Yao Du , Yang Liu , Yan Zhang , Yufang Liu , Mengdi Zhang , Xunliang Cai , Charles Ling , Boyu Wang

The increasing demand for spatiotemporal data and modeling tasks in geosciences has made geospatial code generation technology a critical factor in enhancing productivity. Although large language models (LLMs) have demonstrated potential in…

Software Engineering · Computer Science 2025-03-11 Shuyang Hou , Zhangxiao Shen , Anqi Zhao , Jianyuan Liang , Zhipeng Gui , Xuefeng Guan , Rui Li , Huayi Wu

Vision-Language Models (VLMs) have shown remarkable capabilities in spatial reasoning, yet they remain fundamentally limited to qualitative precision and lack the computational precision required for real-world robotics. Current approaches…

Robotics · Computer Science 2026-03-05 Yi Han , Enshen Zhou , Shanyu Rong , Jingkun An , Pengwei Wang , Zhongyuan Wang , Cheng Chi , Lu Sheng , Shanghang Zhang

Mathematical geometric reasoning is essential for scientific discovery and educational development, requiring precise logic and rigorous formal verification. While recent advances in Multimodal Large Language Models (MLLMs) have improved…

Artificial Intelligence · Computer Science 2025-08-06 Jingxuan Wei , Caijun Jia , Qi Chen , Honghao He , Linzhuang Sun , Conghui He , Lijun Wu , Bihui Yu , Cheng Tan

The rapid advancement of Large Language Models (LLMs) has significantly improved code generation, yet most models remain text-only, neglecting crucial visual aids like diagrams and flowcharts used in real-world software development. To…

Computation and Language · Computer Science 2025-07-14 Linzheng Chai , Jian Yang , Shukai Liu , Wei Zhang , Liran Wang , Ke Jin , Tao Sun , Congnan Liu , Chenchen Zhang , Hualei Zhu , Jiaheng Liu , Xianjie Wu , Ge Zhang , Tianyu Liu , Zhoujun Li

Code has emerged as a precise and executable medium for reasoning and action in the agent era. Yet, progress has largely focused on language-centric tasks such as program synthesis and debugging, leaving visual-centric coding underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Kevin Qinghong Lin , Yuhao Zheng , Hangyu Ran , Dantong Zhu , Dongxing Mao , Linjie Li , Philip Torr , Alex Jinpeng Wang

Manual slide creation is labor-intensive and requires expert prior knowledge. Existing natural language-based LLM generation methods struggle to capture the visual and structural nuances of slide designs. To address this, we formalize the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Wenxin Tang , Jingyu Xiao , Wenxuan Jiang , Xi Xiao , Yuhang Wang , Xuxin Tang , Qing Li , Yuehe Ma , Junliang Liu , Shisong Tang , Michael R. Lyu

Modern vision-language models (VLMs) develop patch embedding and convolution backbone within vector space, especially Euclidean ones, at the very founding. When expanding VLMs to a galaxy scale for understanding astronomical phenomena, the…

Machine Learning · Computer Science 2025-05-27 Tianyu Chen , Xingcheng Fu , Yisen Gao , Haodong Qian , Yuecen Wei , Kun Yan , Haoyi Zhou , Jianxin Li

Vision-Language Models (VLMs) have shown strong performance in tasks like visual question answering and multimodal text generation, but their effectiveness in scientific domains such as materials science remains limited. While some machine…

Machine Learning · Computer Science 2025-11-11 An Vuong , Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Code search, framed as information retrieval (IR), underpins modern software engineering and increasingly powers retrieval-augmented generation (RAG), improving code discovery, reuse, and the reliability of LLM-based coding. Yet existing…

Software Engineering · Computer Science 2026-04-20 Jiahui Geng , Qing Li , Fengyu Cai , Fakhri Karray

Large language models (LLMs) have shown promising results for software engineering applications, but still struggle with code reasoning tasks such as vulnerability detection (VD). We introduce ConceptCoder, a fine-tuning method that…

Software Engineering · Computer Science 2026-03-25 Md Mahbubur Rahman , Hengbo Tong , Wei Le

Most existing works solving Room-to-Room VLN problem only utilize RGB images and do not consider local context around candidate views, which lack sufficient visual cues about surrounding environment. Moreover, natural language contains…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyang Huo , Qiang Sun , Boyan Jiang , Haitao Lin , Yanwei Fu

Multimodal large language models (MLLMs) have achieved significant progress in image and language tasks due to the strong reasoning capability of large language models (LLMs). Nevertheless, most MLLMs suffer from limited spatial reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiajie Guo , Qingpeng Zhu , Jin Zeng , Xiaolong Wu , Changyong He , Weida Wang

Geometric ability is a significant challenge for large language models (LLMs) due to the need for advanced spatial comprehension and abstract thinking. Existing datasets primarily evaluate LLMs on their final answers, but they cannot truly…

Computation and Language · Computer Science 2025-02-24 Xiaofeng Wang , Yiming Wang , Wenhong Zhu , Rui Wang

This paper introduces Code-Vision, a benchmark designed to evaluate the logical understanding and code generation capabilities of Multimodal Large Language Models (MLLMs). It challenges MLLMs to generate a correct program that fulfills…

Computation and Language · Computer Science 2025-02-18 Hanbin Wang , Xiaoxuan Zhou , Zhipeng Xu , Keyuan Cheng , Yuxin Zuo , Kai Tian , Jingwei Song , Junting Lu , Wenhui Hu , Xueyang Liu