English
Related papers

Related papers: MaRVL-QA: A Benchmark for Mathematical Reasoning o…

200 papers

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Numerous theorems, such as those in geometry, are often presented in multimodal forms (e.g., diagrams). Humans benefit from visual reasoning in such settings, using diagrams to gain intuition and guide the proof process. Modern Multimodal…

Computation and Language · Computer Science 2025-06-09 Zhitao He , Zongwei Lyu , Dazhong Chen , Dadi Guo , Yi R. Fung

Current multimodal large language models (MLLMs) often underperform on mathematical problem-solving tasks that require fine-grained visual understanding. The limitation is largely attributable to inadequate perception of geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Shan Zhang , Aotian Chen , Yanpeng Sun , Jindong Gu , Yi-Yu Zheng , Piotr Koniusz , Kai Zou , Anton van den Hengel , Yuan Xue

While Multimodal Large Language Models (MLLMs) demonstrate proficiency in 2D scenes, extending their perceptual intelligence to 3D point cloud understanding remains a significant challenge. Current approaches focus primarily on aligning 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Dongxu Zhang , Yiding Sun , Pengcheng Li , Yumou Liu , Hongqiang Lin , Haoran Xu , Xiaoxuan Mu , Liang Lin , Wenbiao Yan , Ning Yang , Chaowei Fang , Juanjuan Zhao , Jihua Zhu , Conghui He , Cheng Tan

Large Language Models (LLMs) and Large Multimodal Models (LMMs) exhibit impressive problem-solving skills in many tasks and domains, but their ability in mathematical reasoning in visual contexts has not been systematically studied. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Pan Lu , Hritik Bansal , Tony Xia , Jiacheng Liu , Chunyuan Li , Hannaneh Hajishirzi , Hao Cheng , Kai-Wei Chang , Michel Galley , Jianfeng Gao

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Zeng , Wenxuan Huang , Zhen Fang , Shuang Chen , Yufan Shen , Yishuo Cai , Xiaoman Wang , Zhenfei Yin , Lin Chen , Zehui Chen , Shiting Huang , Yiming Zhao , Xu Tang , Yao Hu , Philip Torr , Wanli Ouyang , Shaosheng Cao

Large Language Models (LLMs) have undergone rapid progress, largely attributed to reinforcement learning on complex reasoning tasks. In contrast, while spatial intelligence is fundamental for Vision-Language Models (VLMs) in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zijian Song , Xiaoxin Lin , Qiuming Huang , Sihan Qin , Guangrun Wang , Liang Lin

Visual reasoning over structured data such as tables is a critical capability for modern vision-language models (VLMs), yet current benchmarks remain limited in scale, diversity, or reasoning depth, especially when it comes to rendered…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Boammani Aser Lompo , Marc Haraoui

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in visual recognition and semantic understanding. Nevertheless, their ability to perform precise compositional spatial reasoning remains largely unexplored. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Daixian Liu , Jiayi Kuang , Yinghui Li , Yangning Li , Di Yin , Haoyu Cao , Xing Sun , Ying Shen , Hai-Tao Zheng , Liang Lin , Philip S. Yu

The ability to organically reason over and with both text and images is a pillar of human intelligence, yet the ability of Multimodal Large Language Models (MLLMs) to perform such multimodal reasoning remains under-explored. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Yunzhuo Hao , Jiawei Gu , Huichen Will Wang , Linjie Li , Zhengyuan Yang , Lijuan Wang , Yu Cheng

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

Humans naturally possess the spatial reasoning ability to form and manipulate images and structures of objects in space. There is an increasing effort to endow Vision-Language Models (VLMs) with similar spatial reasoning capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jiahuan Zhang , Shunwen Bai , Tianheng Wang , Kaiwen Guo , Kai Han , Guozheng Rao , Kaicheng Yu

Multimodal reasoning, which integrates language and visual cues into problem solving and decision making, is a fundamental aspect of human intelligence and a crucial step toward artificial general intelligence. However, the evaluation of…

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

Computation and Language · Computer Science 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

Current Multimodal Large Language Models (MLLMs) excel in general visual reasoning but remain underexplored in Abstract Visual Reasoning (AVR), which demands higher-order reasoning to identify abstract rules beyond simple perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yanbei Jiang , Yihao Ding , Chao Lei , Jiayang Ao , Jey Han Lau , Krista A. Ehinger

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Structured tables are essential for conveying high-density information in professional domains such as finance, healthcare, and scientific research. Despite the progress in Multimodal Large Language Models (MLLMs), reasoning performance…

Artificial Intelligence · Computer Science 2026-04-07 Xiaoyu Chen , Lu Dai , Hanqing Wang , Zhuoyu Li , Wenbin Dai , Yanzong Zheng , Zhenggang Xia , Junyong Lin , Hui Xiong

Multi-view understanding, the ability to reconcile visual information across diverse viewpoints for effective navigation, manipulation, and 3D scene comprehension, is a fundamental challenge in Multi-Modal Large Language Models (MLLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chun-Hsiao Yeh , Chenyu Wang , Shengbang Tong , Ta-Ying Cheng , Ruoyu Wang , Tianzhe Chu , Yuexiang Zhai , Yubei Chen , Shenghua Gao , Yi Ma

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved 2D visual understanding, prompting interest in their application to complex 3D reasoning tasks. However, it remains unclear whether these models can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiaoyu Zhan , Wenxuan Huang , Hao Sun , Xinyu Fu , Changfeng Ma , Shaosheng Cao , Bohan Jia , Shaohui Lin , Zhenfei Yin , Lei Bai , Wanli Ouyang , Yuanqi Li , Jie Guo , Yanwen Guo