English
Related papers

Related papers: Do Large Language Models Truly Understand Geometri…

200 papers

Large language models (LLMs) show remarkable capabilities across a variety of tasks. Despite the models only seeing text in training, several recent studies suggest that LLM representations implicitly capture aspects of the underlying…

Computation and Language · Computer Science 2024-04-16 Yutaro Yamada , Yihan Bao , Andrew K. Lampinen , Jungo Kasai , Ilker Yildirim

Geometry problem-solving (GPS), a challenging task requiring both visual comprehension and symbolic reasoning, effectively measures the reasoning capabilities of multimodal large language models (MLLMs). Humans exhibit strong reasoning…

Computation and Language · Computer Science 2025-04-25 Liangyu Xu , Yingxiu Zhao , Jingyun Wang , Yingyao Wang , Bu Pi , Chen Wang , Mingliang Zhang , Jihao Gu , Xiang Li , Xiaoyong Zhu , Jun Song , Bo Zheng

Geometry mathematics problems pose significant challenges for large language models (LLMs) because they involve visual elements and spatial reasoning. Current methods primarily rely on symbolic character awareness to address these problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Shihao Xu , Yiyang Luo , Wei Shi

Large Language Models (LLMs) have demonstrated unprecedented capabilities across various natural language processing tasks. Their ability to process and generate viable text and code has made them ubiquitous in many fields, while their…

Machine Learning · Computer Science 2025-05-13 Stef De Sabbata , Stefano Mizzaro , Kevin Roitero

While Multimodal Large Language Models (MLLMs) demonstrate proficiency in 2D scenes, extending their perceptual intelligence to 3D point cloud understanding remains a significant challenge. Current approaches focus primarily on aligning 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Dongxu Zhang , Yiding Sun , Pengcheng Li , Yumou Liu , Hongqiang Lin , Haoran Xu , Xiaoxuan Mu , Liang Lin , Wenbiao Yan , Ning Yang , Chaowei Fang , Juanjuan Zhao , Jihua Zhu , Conghui He , Cheng Tan

Predicting properties from coordinate-category data -- sets of vectors paired with categorical information -- is fundamental to computational science. In materials science, this challenge manifests as predicting properties like formation…

Materials Science · Physics 2025-07-10 Nawaf Alampara , Santiago Miret , Kevin Maik Jablonka

This paper presents GPSM4K, a comprehensive geometry multimodal dataset tailored to augment the problem-solving capabilities of Large Vision Language Models (LVLMs). GPSM4K encompasses 2157 multimodal question-answer pairs manually…

We present NoReGeo, a novel benchmark designed to evaluate the intrinsic geometric understanding of large language models (LLMs) without relying on reasoning or algebraic computation. Unlike existing benchmarks that primarily assess models'…

Understanding geometry relies heavily on vision. In this work, we evaluate whether state-of-the-art vision language models (VLMs) can understand simple geometric concepts. We use a paradigm from cognitive science that isolates visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Eliza Kosoy , Annya Dahmani , Andrew K. Lampinen , Iulia M. Comsa , Soojin Jeong , Ishita Dasgupta , Kelsey Allen

Multi-modal Large Language Models (MLLMs) have advanced greatly in general tasks. However, they still face challenges in geometric reasoning, a task that requires synergistic integration of visual recognition proficiency and complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhihao Li , Yao Du , Yang Liu , Yan Zhang , Yufang Liu , Mengdi Zhang , Xunliang Cai , Charles Ling , Boyu Wang

Large language models (LLMs) have shown remarkable capabilities across a broad range of tasks involving question answering and the generation of coherent text and code. Comprehensively understanding the strengths and weaknesses of LLMs is…

Computation and Language · Computer Science 2023-06-02 Jonathan Roberts , Timo Lüddecke , Sowmen Das , Kai Han , Samuel Albanie

Recent advancements in large language models (LLMs) and multi-modal models (MMs) have demonstrated their remarkable capabilities in problem-solving. Yet, their proficiency in tackling geometry math problems, which necessitates an integrated…

Artificial Intelligence · Computer Science 2024-05-20 Jiaxin Zhang , Zhongzhi Li , Mingliang Zhang , Fei Yin , Chenglin Liu , Yashar Moshfeghi

Recent advances in Multimodal Large Language Models (MLLMs) have achieved remarkable progress in general domains and demonstrated promise in multimodal mathematical reasoning. However, applying MLLMs to geometry problem solving (GPS)…

Computation and Language · Computer Science 2025-04-18 Yicheng Pan , Zhenrong Zhang , Pengfei Hu , Jiefeng Ma , Jun Du , Jianshu Zhang , Quan Liu , Jianqing Gao , Feng Ma

AI-driven geometric problem solving is a complex vision-language task that requires accurate diagram interpretation, mathematical reasoning, and robust cross-modal grounding. A foundational yet underexplored capability for this task is the…

Machine Learning · Computer Science 2025-09-26 Bing Liu , Wenqiang Yv , Xuzheng Yang , Shichang Wang , Junzhuo Liu , Peng Wang , Guoqing Wang , Yang Yang , Heng Tao Shen

Geometric problem solving constitutes a critical branch of mathematical reasoning, requiring precise analysis of shapes and spatial relationships. Current evaluations of geometric reasoning in vision-language models (VLMs) face limitations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yuan Feng , Yue Yang , Xiaohan He , Jiatong Zhao , Jianlong Chen , Zijun Chen , Daocheng Fu , Qi Liu , Renqiu Xia , Bo Zhang , Junchi Yan

Geometric analyses of large language model (LLM) representations reveal structured variation across depth but remain fundamentally correlational with respect to token prediction formation. Meanwhile, causal interventions expose…

Machine Learning · Computer Science 2026-05-27 Shahar Haim , Daniel C McNamee

This paper explores the spatial reasoning capability of large language models (LLMs) over textual input through a suite of five tasks aimed at probing their spatial understanding and computational abilities. The models were tested on both…

Computation and Language · Computer Science 2025-10-24 Maggie Bai , Ava Kim Cohen , Eleanor Koss , Charlie Lichtenbaum

Recent advancements in reinforcement learning (RL) have enhanced the reasoning abilities of large language models (LLMs), yet the impact on multimodal LLMs (MLLMs) is limited. Particularly in vision-intensive tasks like geometric reasoning,…

Computation and Language · Computer Science 2025-09-23 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Deli Zhao , Anh Tuan Luu , Yu Rong

This paper proposes MapGPT which is a novel approach that integrates the capabilities of language models, specifically large language models (LLMs), with spatial data processing techniques. This paper introduces MapGPT, which aims to bridge…

Artificial Intelligence · Computer Science 2023-10-19 Ashley Fernandez , Swaraj Dube

Large Language Models (LLMs) are increasingly applied in the fields of mechanical engineering and materials science. As models that establish connections through the interface of language, LLMs can be applied for step-wise reasoning through…

Applied Physics · Physics 2025-07-22 Adrian Ehrenhofer , Thomas Wallmersperger , Gianaurelio Cuniberti