中文
相关论文

相关论文: MultiMath: Bridging Visual and Mathematical Reason…

200 篇论文

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Large Vision-Language Models (LVLMs) have recently demonstrated amazing success in multi-modal tasks, including advancements in Multi-modal Chain-of-Thought (MCoT) reasoning. Despite these successes, current benchmarks still follow a…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Zihui Cheng , Qiguang Chen , Jin Zhang , Hao Fei , Xiaocheng Feng , Wanxiang Che , Min Li , Libo Qin

Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently…

计算与语言 · 计算机科学 2023-11-29 Utsav Garg , Erhan Bas

Despite strong performance on vision-language tasks, Multimodal Large Language Models (MLLMs) struggle with mathematical problem-solving, with both open-source and state-of-the-art models falling short of human performance on visual-math…

计算机视觉与模式识别 · 计算机科学 2025-08-26 William Rudman , Michal Golovanevsky , Amir Bar , Vedant Palit , Yann LeCun , Carsten Eickhoff , Ritambhara Singh

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

计算与语言 · 计算机科学 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Mathematical reasoning has long represented one of the most fundamental and challenging frontiers in artificial intelligence research. In recent years, large language models (LLMs) have achieved significant advances in this area. This…

Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Nilay Yilmaz , Maitreya Patel , Yiran Lawrence Luo , Tejas Gokhale , Chitta Baral , Suren Jayasuriya , Yezhou Yang

Multimodal Mathematical Reasoning (MMR) has recently attracted increasing attention for its capability to solve mathematical problems involving both textual and visual modalities. However, current models still face significant challenges in…

人工智能 · 计算机科学 2026-04-15 Tianyu Yang , Sihong Wu , Yilun Zhao , Zhenwen Liang , Lisen Dai , Chen Zhao , Minhao Cheng , Arman Cohan , Xiangliang Zhang

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

The remarkable progress of Multi-modal Large Language Models (MLLMs) has garnered unparalleled attention, due to their superior performance in visual contexts. However, their capabilities in visual math problem-solving remain insufficiently…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Renrui Zhang , Dongzhi Jiang , Yichi Zhang , Haokun Lin , Ziyu Guo , Pengshuo Qiu , Aojun Zhou , Pan Lu , Kai-Wei Chang , Peng Gao , Hongsheng Li

The emergence of Multimodal Large Language Models (MLLMs) that integrate vision and language modalities has unlocked new potentials for scientific reasoning, outperforming prior benchmarks in both natural language and coding domains.…

计算工程、金融与科学 · 计算机科学 2025-05-27 Sifan Wu , Huan Zhang , Yizhan Li , Farshid Effaty , Amirreza Ataei , Bang Liu

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

计算与语言 · 计算机科学 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Large Language Models (LLMs), combined with program-based solving techniques, are increasingly demonstrating proficiency in mathematical reasoning. For example, closed-source models such as OpenAI GPT-4 and Claude show excellent results in…

计算与语言 · 计算机科学 2024-07-23 Vernon Toh Yan Han , Ratish Puduppully , Nancy F. Chen

Is vision good enough for language? Recent advancements in multimodal models primarily stem from the powerful reasoning abilities of large language models (LLMs). However, the visual component typically depends only on the instance-level…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Shengbang Tong , Zhuang Liu , Yuexiang Zhai , Yi Ma , Yann LeCun , Saining Xie

In this paper, we introduce PolyMath, a multilingual mathematical reasoning benchmark covering 18 languages and 4 easy-to-hard difficulty levels. Our benchmark ensures difficulty comprehensiveness, language diversity, and high-quality…

The current evaluation of mathematical skills in LLMs is limited, as existing benchmarks are either relatively small, primarily focus on elementary and high-school problems, or lack diversity in topics. Additionally, the inclusion of visual…

The mathematical capabilities of Multi-modal Large Language Models (MLLMs) remain under-explored with three areas to be improved: visual encoding of math diagrams, diagram-language alignment, and chain-of-thought (CoT) reasoning. This draws…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Renrui Zhang , Xinyu Wei , Dongzhi Jiang , Ziyu Guo , Shicheng Li , Yichi Zhang , Chengzhuo Tong , Jiaming Liu , Aojun Zhou , Bin Wei , Shanghang Zhang , Peng Gao , Chunyuan Li , Hongsheng Li

Mathematical reasoning poses a significant challenge for language models due to its complex and structured nature. In this paper, we introduce DeepSeekMath 7B, which continues pre-training DeepSeek-Coder-Base-v1.5 7B with 120B math-related…

计算与语言 · 计算机科学 2024-04-30 Zhihong Shao , Peiyi Wang , Qihao Zhu , Runxin Xu , Junxiao Song , Xiao Bi , Haowei Zhang , Mingchuan Zhang , Y. K. Li , Y. Wu , Daya Guo