中文
相关论文

相关论文: VL-Cogito: Progressive Curriculum Reinforcement Le…

200 篇论文

Accurate chart comprehension represents a critical challenge in advancing multimodal learning systems, as extensive information is compressed into structured visual representations. However, existing vision-language models (VLMs) frequently…

机器学习 · 计算机科学 2026-03-10 Xin Zhang , Xingyu Li , Rongguang Wang , Ruizhong Miao , Zheng Wang , Dan Roth , Chenyang Li

Visual reasoning is crucial for understanding complex multimodal data and advancing Artificial General Intelligence. Existing methods enhance the reasoning capability of Multimodal Large Language Models (MLLMs) through Reinforcement…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Chaoyang Wang , Zeyu Zhang , Meng Meng , Xu Zhou , Haiyun Jiang

Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-driven, relying…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Dongyang Chen , Chaoyang Wang , Dezhao Su , Xi Xiao , Zeyu Zhang , Jing Xiong , Qing Li , Yuzhang Shang , Shichao Kan

Multi-step multimodal reasoning tasks pose significant challenges for multimodal large language models (MLLMs), and finding effective ways to enhance their performance in such scenarios remains an unresolved issue. In this paper, we propose…

计算与语言 · 计算机科学 2024-12-20 Guanting Dong , Chenghao Zhang , Mengjie Deng , Yutao Zhu , Zhicheng Dou , Ji-Rong Wen

The growing integration of vision-language models (VLMs) in medical applications offers promising support for diagnostic reasoning. However, current medical VLMs often face limitations in generalization, transparency, and computational…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Tan-Hanh Pham , Chris Ngo

Large language models (LLMs) are designed to perform a wide range of tasks. To improve their ability to solve complex problems requiring multi-step reasoning, recent research leverages process reward modeling to provide fine-grained…

计算与语言 · 计算机科学 2025-09-29 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

Multimodal Reward Models (MRMs) play a crucial role in enhancing the performance of Multimodal Large Language Models (MLLMs). While recent advancements have primarily focused on improving the model structure and training data of MRMs, there…

Reinforcement learning (RL) has proven effective for fine-tuning large language models (LLMs), significantly enhancing their reasoning abilities in domains such as mathematics and code generation. A crucial factor influencing RL fine-tuning…

In this work, we investigate how explicitly modeling problem's difficulty prior information shapes the effectiveness of reinforcement learning based fine-tuning for multimodal reasoning. Our exploration mainly comprises of following three…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Mingrui Chen , Haogeng Liu , Hao Liang , Huaibo Huang , Wentao Zhang , Ran He

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

机器学习 · 计算机科学 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Reinforcement learning (RL) has shown strong promise for LLM-based machine translation, with recent methods such as GRPO demonstrating notable gains; nevertheless, translation-oriented RL remains challenged by noisy learning signals arising…

计算与语言 · 计算机科学 2026-05-19 Yunzhi Shen , Hao Zhou , Xin Huang , Xue Han , Junlan Feng , Shujian Huang

Multi-modal Large Language Models (MLLMs) show promise in video understanding. However, their reasoning often suffers from thinking drift and weak temporal comprehension, even when enhanced by Reinforcement Learning (RL) techniques like…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Peiyao Wang , Haotian Xu , Noranart Vesdapunt , Rui Hou , Jingyi Zhang , Haibin Ling , Oleksandr Obiednikov , Ning Zhou , Kah Kuen Fu

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

Reinforcement learning with verifiable rewards (RLVR) has emerged as a scalable paradigm for improving the reasoning capabilities of large language models. However, its effectiveness is fundamentally limited by exploration: the policy can…

人工智能 · 计算机科学 2026-05-18 Chanuk Lee , Sangwoo Park , Minki Kang , Sung Ju Hwang

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

Recent advances in general medical AI have made significant strides, but existing models often lack the reasoning capabilities needed for complex medical decision-making. This paper presents GMAI-VL-R1, a multimodal medical reasoning model…

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Protein analysis tasks arising in healthcare settings often require accurate reasoning under protein sequence constraints, involving tasks such as functional interpretation of disease-related variants, protein-level analysis for clinical…

人工智能 · 计算机科学 2026-03-03 Congying Liu , Taihao Li , Ming Huang , Xingyuan Wei , Peipei Liu , Yiqing Shen , Yanxu Mao , Tiehan Cui

Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yongchang Zhang , Oliver Ma , Tianyi Liu , Guangquan Zhou , Yang Chen

Recent advancements in multimodal large language models (MLLMs) have demonstrated exceptional performance in multimodal perception and understanding. However, leading open-source MLLMs exhibit significant limitations in complex and…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Jingjing Jiang , Chao Ma , Xurui Song , Hanwang Zhang , Jun Luo