English
Related papers

Related papers: Measuring Multimodal Mathematical Reasoning with M…

200 papers

While Large Language Models (LLMs) have excelled in textual reasoning, they struggle with mathematical domains like geometry that intrinsically rely on visual aids. Existing approaches to Visual Chain-of-Thought (VCoT) are often limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Weikang Shi , Aldrich Yu , Rongyao Fang , Houxing Ren , Ke Wang , Aojun Zhou , Changyao Tian , Xinyu Fu , Yuxuan Hu , Zimu Lu , Linjiang Huang , Si Liu , Rui Liu , Hongsheng Li

Recent progress in large-scale reinforcement learning (RL) has notably enhanced the reasoning capabilities of large language models (LLMs), especially in mathematical domains. However, current multimodal LLMs (MLLMs) for mathematical…

Computation and Language · Computer Science 2025-07-04 Wenhao Shi , Zhiqiang Hu , Yi Bin , Yang Yang , See-Kiong Ng , Heng Tao Shen

Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across various tasks, existing benchmarks lack comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Fengji Zhang , Linquan Wu , Huiyu Bai , Guancheng Lin , Xiao Li , Xiao Yu , Yue Wang , Bei Chen , Jacky Keung

Multi-modal large language models (MLLMs) have demonstrated promising capabilities across various tasks by integrating textual and visual information to achieve visual understanding in complex scenarios. Despite the availability of several…

Artificial Intelligence · Computer Science 2024-12-03 Zhihuan Jiang , Zhen Yang , Jinhao Chen , Zhengxiao Du , Weihan Wang , Bin Xu , Jie Tang

Medical large vision-language models (LVLMs) have demonstrated promising performance across various single-image question answering (QA) benchmarks, yet their capability in processing multi-image clinical scenarios remains underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xikai Yang , Juzheng Miao , Yuchen Yuan , Jiaze Wang , Qi Dou , Jinpeng Li , Pheng-Ann Heng

The advent of Multimodal Large Language Models (MLLMs) has expanded AI capabilities to visual modalities, yet existing evaluation benchmarks remain limited to single-video understanding, overlooking the critical need for multi-video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Tianhao Peng , Haochen Wang , Yuanxing Zhang , Zekun Wang , Zili Wang , Gavin Chang , Jian Yang , Shihao Li , Yanghai Wang , Xintao Wang , Houyi Li , Wei Ji , Pengfei Wan , Steven Huang , Zhaoxiang Zhang , Jiaheng Liu

We introduce EXAMS-V, a new challenging multi-discipline multimodal multilingual exam benchmark for evaluating vision language models. It consists of 20,932 multiple-choice questions across 20 school disciplines covering natural science,…

Computation and Language · Computer Science 2024-03-18 Rocktim Jyoti Das , Simeon Emilov Hristov , Haonan Li , Dimitar Iliyanov Dimitrov , Ivan Koychev , Preslav Nakov

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Mathematical reasoning, a core aspect of human cognition, is vital across many domains, from educational problem-solving to scientific advancements. As artificial general intelligence (AGI) progresses, integrating large language models…

Computation and Language · Computer Science 2025-05-21 Yibo Yan , Jiamin Su , Jianxiang He , Fangteng Fu , Xu Zheng , Yuanhuiyi Lyu , Kun Wang , Shen Wang , Qingsong Wen , Xuming Hu

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

Humans can imagine and manipulate visual images mentally, a capability known as spatial visualization. While many multi-modal benchmarks assess reasoning on visible visual information, the ability to infer unseen relationships through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siting Wang , Minnan Pei , Luoyang Sun , Cheng Deng , Yuchen Li , Kun Shao , Zheng Tian , Haifeng Zhang , Jun Wang

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

The evaluation of Large Language Models (LLMs) on mathematical reasoning has largely focused on elementary problems, competition-style questions, or formal theorem proving, leaving graduate-level and computational mathematics relatively…

Computation and Language · Computer Science 2026-03-05 Bianca Raimondi , Francesco Pivi , Davide Evangelista , Maurizio Gabbrielli

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Mathematical reasoning serves as a cornerstone for assessing the fundamental cognitive capabilities of human intelligence. In recent times, there has been a notable surge in the development of Large Language Models (LLMs) geared towards the…

Computation and Language · Computer Science 2024-09-18 Janice Ahn , Rishu Verma , Renze Lou , Di Liu , Rui Zhang , Wenpeng Yin

Multimodal large language models (MLLMs) have achieved impressive progress on vision language benchmarks, yet their capacity for visual cognitive and visuospatial reasoning remains less understood. We introduce "Mind's Eye", a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Rohit Sinha , Aditya Kanade , Sai Srinivas Kancheti , Vineeth N Balasubramanian , Tanuja Ganu

Large language models have shown impressive results for multi-hop mathematical reasoning when the input question is only textual. Many mathematical reasoning problems, however, contain both text and image. With the ever-increasing adoption…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Mehran Kazemi , Hamidreza Alvari , Ankit Anand , Jialin Wu , Xi Chen , Radu Soricut

Recent advances in large language models (LLMs) and vision-language models (LVLMs) have shown promise across many tasks, yet their scientific reasoning capabilities remain untested, particularly in multimodal settings. We present…

Machine Learning · Computer Science 2025-06-03 Xinwu Ye , Chengfan Li , Siming Chen , Wei Wei , Xiangru Tang

Recent multimodal large language models (MLLMs) achieve strong performance on visual reasoning benchmarks, yet it remains unclear to what extent such performance reflects reasoning directly grounded in visual evidence. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Longteng Guo , Yifan Wang , Pengkang Huo , Tailai Chen , Yuze Wu , Jing Liu , Xinxin Zhu