中文
相关论文

相关论文: Can GRPO Boost Complex Multimodal Table Understand…

200 篇论文

As language models become increasingly capable, users expect them to provide not only accurate responses but also behaviors aligned with diverse human preferences across a variety of scenarios. To achieve this, Reinforcement learning (RL)…

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

人工智能 · 计算机科学 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Language Models (LLMs) by leveraging direct outcome verification instead of learned reward models. Building on this paradigm, Group…

Reinforcement learning (RL) has proven effective in strengthening the reasoning capabilities of large language models (LLMs). A widely adopted method, Group Relative Policy Optimization (GRPO), has shown strong empirical results in training…

机器学习 · 计算机科学 2026-03-11 Peter Chen , Xiaopeng Li , Ziniu Li , Xi Chen , Tianyi Lin

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for enhancing the reasoning capabilities of large language models (LLMs). In this context, models explore reasoning trajectories and exploit rollouts…

机器学习 · 计算机科学 2026-03-02 Yuyang Ding , Chi Zhang , Juntao Li , Haibin Lin , Min Zhang

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

人工智能 · 计算机科学 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Traditional recommendation systems often grapple with "filter bubbles", underutilization of external knowledge, and a disconnect between model optimization and business policy iteration. To address these limitations, this paper introduces…

人工智能 · 计算机科学 2025-06-25 Yu Xie , Xingkai Ren , Ying Qi , Yao Hu , Lianlei Shan

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

机器学习 · 计算机科学 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

Recent advances in large language models (LLMs) have shown that reasoning ability can be significantly enhanced through Reinforcement Learning with Verifiable Rewards (RLVR). Group Relative Policy Optimization (GRPO) has emerged as the de…

计算与语言 · 计算机科学 2025-10-13 Jingyu Zhou , Lu Ma , Hao Liang , Chengyu Shen , Bin Cui , Wentao Zhang

Recent advancements in post-training methodologies for large language models (LLMs) have highlighted reinforcement learning (RL) as a critical component for enhancing reasoning. However, the substantial computational costs associated with…

计算与语言 · 计算机科学 2025-07-29 Songjun Tu , Jiahao Lin , Xiangyu Tian , Qichao Zhang , Linjing Li , Yuqian Fu , Nan Xu , Wei He , Xiangyuan Lan , Dongmei Jiang , Dongbin Zhao

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Ziqi Ni , Yuanzhi Liang , Rui Li , Yi Zhou , Haibin Huang , Chi Zhang , Xuelong Li

Multi-turn tool-integrated reasoning enables Large Language Models (LLMs) to solve complex tasks through iterative information retrieval. However, current reinforcement learning (RL) frameworks for search-augmented reasoning predominantly…

人工智能 · 计算机科学 2026-04-07 Shichao Ma , Zhiyuan Ma , Ming Yang , Xiaofan Li , Xing Wu , Jintao Du , Yu Cheng , Weiqiang Wang , Qiliang Liu , Zhengyang Zhou , Yang Wang

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates significant potential in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing RLVR methods are often constrained by issues such as…

人工智能 · 计算机科学 2026-01-14 Jinpeng Wang , Chao Li , Ting Ye , Mengyuan Zhang , Wei Liu , Jian Luan

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit…

计算与语言 · 计算机科学 2025-10-24 Zhenrui Yue , Bowen Jin , Huimin Zeng , Honglei Zhuang , Zhen Qin , Jinsung Yoon , Lanyu Shang , Jiawei Han , Dong Wang

Tabular prediction traditionally relies on gradient-boosted decision trees and deep learning models, which excel in specific tasks but lack interpretability and transferability. Reasoning large language models (LLMs) promise cross-task…

机器学习 · 计算机科学 2026-03-11 Pengxiang Cai , Zihao Gao , Wanchen Lian , Jintai Chen

While Reinforcement Learning (RL) has advanced LLM reasoning, applying it to long-context scenarios is hindered by sparsity of outcome rewards. This limitation fails to penalize ungrounded "lucky guesses," leaving the critical process of…

人工智能 · 计算机科学 2026-04-21 Xin Guan , Zijian Li , Shen Huang , Pengjun Xie , Jingren Zhou , Jiuxin Cao

Reinforcement learning (RL) has become a prevailing approach for fine-tuning large language models (LLMs) on complex reasoning tasks. Among recent methods, GRPO stands out for its empirical success in training models such as DeepSeek-R1,…

机器学习 · 计算机科学 2025-06-13 Wei Xiong , Jiarui Yao , Yuhui Xu , Bo Pang , Lei Wang , Doyen Sahoo , Junnan Li , Nan Jiang , Tong Zhang , Caiming Xiong , Hanze Dong

Fine-grained visual reasoning remains a core challenge for multimodal large language models (MLLMs). The recently introduced ReasonMap highlights this gap by showing that even advanced MLLMs struggle with spatial reasoning in structured and…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Sicheng Feng , Kaiwen Tuo , Song Wang , Lingdong Kong , Jianke Zhu , Huan Wang

Enhancing reasoning in Large Multimodal Models (LMMs) faces unique challenges from the complex interplay between visual perception and logical reasoning, particularly in compact 3B-parameter architectures where architectural constraints…

计算与语言 · 计算机科学 2025-03-12 Yingzhe Peng , Gongrui Zhang , Miaosen Zhang , Zhiyuan You , Jie Liu , Qipeng Zhu , Kai Yang , Xingzhong Xu , Xin Geng , Xu Yang

Group Relative Policy Optimization (GRPO) assigns a single scalar advantage to all tokens in a completion. For structured generations with explicit segments and objectives, this couples unrelated reward signals across segments, leading to…

机器学习 · 计算机科学 2026-02-12 Kirill Pavlenko , Alexander Golubev , Simon Karasik , Boris Yangel