中文
相关论文

相关论文: Dr. Seg: Revisiting GRPO Training for Visual Large…

200 篇论文

What does it take to build a visual reasoner that works across charts, science, spatial understanding, and open-ended tasks? The strongest vision-language models (VLMs) show such broad visual reasoning is within reach, but the recipe behind…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Gabriel Sarch , Linrong Cai , Qunzhong Wang , Haoyang Wu , Danqi Chen , Zhuang Liu

Recent advances of reasoning models, exemplified by OpenAI's o1 and DeepSeek's R1, highlight the significant potential of Reinforcement Learning (RL) to enhance the reasoning capabilities of Large Language Models (LLMs). However,…

While chain-of-thought (CoT) reasoning has substantially improved multimodal large language models (MLLMs) on complex reasoning tasks, existing approaches largely rely on long textual reasoning trajectories and provide limited mechanisms…

人工智能 · 计算机科学 2026-02-10 Siqu Ou , Tianrui Wan , Zhiyuan Zhao , Junyu Gao , Xuelong Li

While Large Language Models (LLMs) excel at generating human-like text, aligning their outputs with complex, qualitative goals like pedagogical soundness remains a significant challenge. Standard reinforcement learning techniques often rely…

计算与语言 · 计算机科学 2025-09-17 Francesco Pappone , Ruggero Marino Lazzaroni , Federico Califano , Niccolò Gentile , Roberto Marras

Large language models (LLMs) have recently shown strong potential in vulnerability detection (VD). However, accurately detecting vulnerabilities in real-world repositories requires reasoning over complex contextual interactions. Existing…

密码学与安全 · 计算机科学 2026-05-28 Youpeng Li , Fuxun Yu , Weiliang Qi , Xinda Wang

Inspired by the impressive reasoning capabilities demonstrated by reinforcement learning approaches like DeepSeek-R1, recent emerging research has begun exploring the use of reinforcement learning (RL) to enhance vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Yizhen Zhang , Yang Ding , Shuoshuo Zhang , Xinchen Zhang , Haoling Li , Zhong-zhi Li , Peijie Wang , Jie Wu , Lei Ji , Yelong Shen , Yujiu Yang , Yeyun Gong

Reinforcement learning algorithms such as GRPO have driven recent advances in large language model (LLM) reasoning. While scaling the number of rollouts stabilizes training, existing approaches suffer from limited exploration on challenging…

机器学习 · 计算机科学 2026-05-26 Udbhav Bamba , Minghao Fang , Yifan Yu , Haizhong Zheng , Fan Lai

Reinforcement learning (RL) has proven effective in strengthening the reasoning capabilities of large language models (LLMs). A widely adopted method, Group Relative Policy Optimization (GRPO), has shown strong empirical results in training…

机器学习 · 计算机科学 2026-03-11 Peter Chen , Xiaopeng Li , Ziniu Li , Xi Chen , Tianyi Lin

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

Inspired by the success of reinforcement learning (RL) in refining large language models (LLMs), we propose AR-GRPO, an approach to integrate online RL training into autoregressive (AR) image generation models. We adapt the Group Relative…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Shihao Yuan , Yahui Liu , Yang Yue , Jingyuan Zhang , Wangmeng Zuo , Qi Wang , Fuzheng Zhang , Guorui Zhou

Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is still constrained, especially when employing Chain-of-Thought prompting techniques. In this…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Congzhi Zhang , Jiawei Peng , Zhenglin Wang , Yilong Lai , Haowen Sun , Heng Chang , Fei Ma , Weijiang Yu

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

Diffusion large language models (dLLMs) are emerging as promising alternatives to autoregressive (AR) LLMs. Recently, this paradigm has been extended to multimodal tasks, leading to the development of diffusion multimodal large language…

人工智能 · 计算机科学 2026-04-08 Keuntae Kim , Mingyu Kang , Yong Suk Choi

Recent progress in Large Language Model (LLM) reasoning is increasingly driven by the refinement of post-training loss functions and alignment strategies. However, standard Reinforcement Learning (RL) paradigms like Group Relative Policy…

机器学习 · 计算机科学 2026-01-28 Kishan Panaganti , Zhenwen Liang , Wenhao Yu , Haitao Mi , Dong Yu

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

计算与语言 · 计算机科学 2025-06-26 Yubo Dong , Hehe Fan

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

计算与语言 · 计算机科学 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria

Recent advancements in reasoning-focused language models such as OpenAI's O1 and DeepSeek-R1 have shown that scaling test-time computation-through chain-of-thought reasoning and iterative exploration-can yield substantial improvements on…

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

While large language models (LLMs) demonstrate strong reasoning capabilities utilizing reinforcement learning (RL) with verifiable reward, whether large vision-language models (VLMs) can directly inherit such capabilities through similar…

人工智能 · 计算机科学 2025-05-27 Tianle Li , Jihai Zhang , Yongming Rao , Yu Cheng