English
Related papers

Related papers: GeoCoder: Solving Geometry Problems by Generating …

200 papers

Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between. One cause of this failure arises before language reasoning begins: the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Renjie Gu , Kaichen Zhou , Yan Luo , Mengyu Wang

Geometry mathematics problems pose significant challenges for large language models (LLMs) because they involve visual elements and spatial reasoning. Current methods primarily rely on symbolic character awareness to address these problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Shihao Xu , Yiyang Luo , Wei Shi

Efficient creation of accurate and editable 3D CAD models is critical in engineering design, significantly impacting cost and time-to-market in product innovation. Current manual workflows remain highly time-consuming and demand extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Anna C. Doris , Md Ferdous Alam , Amin Heyrani Nobari , Faez Ahmed

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but continue to struggle with geometric reasoning, primarily due to the perception bottleneck regarding fine-grained visual elements. While formal languages have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Peijie Wang , Ming-Liang Zhang , Jun Cao , Chao Deng , Dekang Ran , Hongda Sun , Pi Bu , Xuan Zhang , Yingyao Wang , Jun Song , Bo Zheng , Fei Yin , Cheng-Lin Liu

Evaluating the symbolic reasoning of large language models (LLMs) calls for geometry benchmarks that require multi-step proofs grounded in both text and diagrams. However, existing benchmarks are often limited in scale and rarely provide…

Computation and Language · Computer Science 2026-03-23 Yushun Zhang , Weiping Fu , Zesheng Yang , Bo Zhao , Lingling Zhang , Jian Zhang , Yumeng Fu , Jiaxing Huang , Jun Liu

Geometric problem solving constitutes a critical branch of mathematical reasoning, requiring precise analysis of shapes and spatial relationships. Current evaluations of geometric reasoning in vision-language models (VLMs) face limitations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yuan Feng , Yue Yang , Xiaohan He , Jiatong Zhao , Jianlong Chen , Zijun Chen , Daocheng Fu , Qi Liu , Renqiu Xia , Bo Zhang , Junchi Yan

Vision Language Models (VLMs) have achieved remarkable progress in multimodal tasks, yet they often struggle with visual arithmetic, seemingly simple capabilities like object counting or length comparison, which are essential for relevant…

Artificial Intelligence · Computer Science 2025-05-27 Kung-Hsiang Huang , Can Qin , Haoyi Qiu , Philippe Laban , Shafiq Joty , Caiming Xiong , Chien-Sheng Wu

Vision-Language Models (VLMs) still lack robustness in spatial intelligence, demonstrating poor performance on spatial understanding and reasoning tasks. We attribute this gap to the absence of a visual geometry learning process capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Wenbo Hu , Jingli Lin , Yilin Long , Yunlong Ran , Lihan Jiang , Yifan Wang , Chenming Zhu , Runsen Xu , Tai Wang , Jiangmiao Pang

The recently released GPT-4 Code Interpreter has demonstrated remarkable proficiency in solving challenging math problems, primarily attributed to its ability to seamlessly reason with natural language, generate code, execute code, and…

Computation and Language · Computer Science 2023-10-06 Ke Wang , Houxing Ren , Aojun Zhou , Zimu Lu , Sichun Luo , Weikang Shi , Renrui Zhang , Linqi Song , Mingjie Zhan , Hongsheng Li

Large language models (LLMs) have demonstrated significant capabilities in mathematical reasoning, particularly with text-based mathematical problems. However, current multi-modal large language models (MLLMs), especially those specialized…

Computation and Language · Computer Science 2024-12-03 Zhen Yang , Jinhao Chen , Zhengxiao Du , Wenmeng Yu , Weihan Wang , Wenyi Hong , Zhihuan Jiang , Bin Xu , Jie Tang

The rapid advancement of Large Multimodal Models (LMMs) for 2D images and videos has motivated extending these models to understand 3D scenes, aiming for human-like visual-spatial intelligence. Nevertheless, achieving deep spatial…

Automating the transformation of user interface (UI) designs into front-end code holds significant promise for accelerating software development and democratizing design workflows. While multimodal large language models (MLLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yilei Jiang , Yaozhi Zheng , Yuxuan Wan , Jiaming Han , Qunzhong Wang , Michael R. Lyu , Xiangyu Yue

Multimodal Large Language Models (MLLMs) have recently demonstrated remarkable perceptual and reasoning abilities. However, they struggle to perceive fine-grained geometric structures, constraining their ability of geometric understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiayin Sun , Caixia Sun , Boyu Yang , Hailin Li , Xiao Chen , Yi Zhang , Errui Ding , Liang Li , Chao Deng , Junlan Feng

Programming often involves converting detailed and complex specifications into code, a process during which developers typically utilize visual aids to more effectively convey concepts. While recent developments in Large Multimodal Models…

Computation and Language · Computer Science 2024-09-27 Kaixin Li , Yuchen Tian , Qisheng Hu , Ziyang Luo , Zhiyong Huang , Jing Ma

Multimodal Large Language Models (MLLMs) struggle with precise reasoning for structured visuals like charts and diagrams, as pixel-based perception lacks a mechanism for verification. To address this, we propose to leverage derendering --…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Junhong Shen , Mu Cai , Bo Hu , Ameet Talwalkar , David A Ross , Cordelia Schmid , Alireza Fathi

Geometric Problem Solving (GPS) poses a unique challenge for Multimodal Large Language Models (MLLMs), requiring not only the joint interpretation of text and diagrams but also iterative visuospatial reasoning. While existing approaches…

Artificial Intelligence · Computer Science 2026-03-26 Shichao Weng , Zhiqiang Wang , Yuhua Zhou , Rui Lu , Ting Liu , Zhiyang Teng , Xiaozhang Liu , Hanmeng Liu

Multimodal code generation has garnered significant interest within the research community. Despite the notable success of recent vision-language models (VLMs) on specialized tasks like chart-to-code generation, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xuanle Zhao , Deyang Jiang , Zhixiong Zeng , Lei Chen , Haibo Qiu , Jing Huang , Yufeng Zhong , Liming Zheng , Yilin Cao , Lin Ma

AI-driven geometric problem solving is a complex vision-language task that requires accurate diagram interpretation, mathematical reasoning, and robust cross-modal grounding. A foundational yet underexplored capability for this task is the…

Machine Learning · Computer Science 2025-09-26 Bing Liu , Wenqiang Yv , Xuzheng Yang , Shichang Wang , Junzhuo Liu , Peng Wang , Guoqing Wang , Yang Yang , Heng Tao Shen

With the growing demand for spatiotemporal data processing and geospatial modeling, automating geospatial code generation has become essential for productivity. Large language models (LLMs) show promise in code generation but face…

Software Engineering · Computer Science 2024-10-21 Shuyang Hou , Zhangxiao Shen , Jianyuan Liang , Anqi Zhao , Zhipeng Gui , Rui Li , Huayi Wu

Multimodal large language models (MLLMs) have exhibited remarkable performance in various visual tasks, yet still struggle with spatial reasoning. Recent efforts mitigate this by injecting geometric features from 3D foundation models, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zhaochen Liu , Limeng Qiao , Guanglu Wan , Tingting Jiang