English
Related papers

Related papers: MM-Eureka: Exploring the Frontiers of Multimodal R…

200 papers

A practical approach to activate long chain-of-thoughts reasoning ability in pre-trained large language models is to perform supervised fine-tuning on instruction datasets synthesized by strong Large Reasoning Models such as DeepSeek-R1,…

Computation and Language · Computer Science 2025-12-24 Cehao Yang , Xueyuan Lin , Xiaojun Wu , Chengjin Xu , Xuhui Jiang , Honghao Liu , Hui Xiong , Jian Guo

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

Aligning Multimodal Large Language Models (MLLMs) requires reliable reward models, yet existing single-step evaluators can suffer from lazy judging, exploiting language priors over fine-grained visual verification. While rubric-based…

Computation and Language · Computer Science 2026-05-12 Rui Liu , Dian Yu , Zhenwen Liang , Yucheng Shi , Tong Zheng , Runpeng Dai , Haitao Mi , Pratap Tokekar , Leoweiliang

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

Computation and Language · Computer Science 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

Multimodal Reward Models (MRMs) play a crucial role in enhancing the performance of Multimodal Large Language Models (MLLMs). While recent advancements have primarily focused on improving the model structure and training data of MRMs, there…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Yi-Fan Zhang , Xingyu Lu , Xiao Hu , Chaoyou Fu , Bin Wen , Tianke Zhang , Changyi Liu , Kaiyu Jiang , Kaibing Chen , Kaiyu Tang , Haojie Ding , Jiankang Chen , Fan Yang , Zhang Zhang , Tingting Gao , Liang Wang

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

Recent advances in general medical AI have made significant strides, but existing models often lack the reasoning capabilities needed for complex medical decision-making. This paper presents GMAI-VL-R1, a multimodal medical reasoning model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yanzhou Su , Tianbin Li , Jiyao Liu , Chenglong Ma , Junzhi Ning , Cheng Tang , Sibo Ju , Jin Ye , Pengcheng Chen , Ming Hu , Shixiang Tang , Lihao Liu , Bin Fu , Wenqi Shao , Xiaowei Hu , Xiangwen Liao , Yuanfeng Ji , Junjun He

Knowledge-Based Visual Question Answering (KB-VQA) requires models to answer questions about an image by integrating external knowledge, posing significant challenges due to noisy retrieval and the structured, encyclopedic nature of the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shan Ning , Longtian Qiu , Xuming He

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Current research on Multimodal Retrieval-Augmented Generation (MRAG) enables diverse multimodal inputs but remains limited to single-modality outputs, restricting expressive capacity and practical utility. In contrast, real-world…

Information Retrieval · Computer Science 2025-08-11 Zhiyou Xiao , Qinhan Yu , Binghui Li , Geng Chen , Chong Chen , Wentao Zhang

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,502 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared…

Information Retrieval · Computer Science 2026-02-17 Siyue Zhang , Yuan Gao , Xiao Zhou , Yilun Zhao , Tingyu Song , Arman Cohan , Anh Tuan Luu , Chen Zhao

Knowledge editing aims to adjust the knowledge within large language models (LLMs) to prevent their responses from becoming obsolete or inaccurate. However, existing works on knowledge editing are primarily conducted in a single language,…

Computation and Language · Computer Science 2024-06-18 Jiakuan Xie , Pengfei Cao , Yuheng Chen , Yubo Chen , Kang Liu , Jun Zhao

We study the source of uncertainty in DeepSeek R1-32B by analyzing its self-reported verbal confidence on question answering (QA) tasks. In the default answer-then-confidence setting, the model is regularly over-confident, whereas semantic…

Computation and Language · Computer Science 2025-11-06 Jakub Podolak , Rajeev Verma

In today's world, emotional support is increasingly essential, yet it remains challenging for both those seeking help and those offering it. Multimodal approaches to emotional support show great promise by integrating diverse data sources…

Group relative policy optimization (GRPO) has become a standard post-training paradigm for improving reasoning and preference alignment in large language models (LLMs), and has recently shown strong effectiveness in LLM-based recommender…

Information Retrieval · Computer Science 2026-03-09 Yu Wang , Yonghui Yang , Le Wu , Jiancan Wu , Hefei Xu , Hui Lin

Multi-modal Retrieval-Augmented Generation (MMRAG) enables highly credible generation by integrating external multi-modal knowledge, thus demonstrating impressive performance in complex multi-modal scenarios. However, existing MMRAG methods…

Artificial Intelligence · Computer Science 2025-12-22 Shengwei Zhao , Jingwen Yao , Sitong Wei , Linhai Xu , Yuying Liu , Dong Zhang , Zhiqiang Tian , Shaoyi Du

Large Reasoning Models (LRMs) like DeepSeek-R1 and OpenAI-o1 have demonstrated remarkable reasoning capabilities, raising important questions about their biases in LLM-as-a-judge settings. We present a comprehensive benchmark comparing…

Computers and Society · Computer Science 2025-04-21 Qian Wang , Zhanzhi Lou , Zhenheng Tang , Nuo Chen , Xuandong Zhao , Wenxuan Zhang , Dawn Song , Bingsheng He

Advanced Large Multimodal Models (LMMs) have demonstrated impressive performance in K-12 reasoning tasks, exhibiting great promise as intelligent tutors. Realizing this potential requires models to navigate real-world examinations…

Artificial Intelligence · Computer Science 2026-05-27 Xiaohan Wang , Mingze Yin , Yilin Zhao , Gang Liu , Dian Li

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

Recent advances in Reasoning LLMs (e.g., DeepSeek-R1 and OpenAI-o1) have showcased impressive reasoning capabilities via reinforcement learning. However, extending these capabilities to Multimodal LLMs (MLLMs) is hampered by the prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hongchen Wei , Zhenzhong Chen