中文
相关论文

相关论文: Boosting MLLM Reasoning with Text-Debiased Hint-GR…

200 篇论文

Bias in Large Language Models (LLMs) poses significant risks to trustworthiness, manifesting primarily as stereotypical biases (e.g., gender or racial stereotypes) and structural biases (e.g., lexical overlap or position preferences).…

计算与语言 · 计算机科学 2025-12-30 Xuan Feng , Bo An , Tianlong Gu , Liang Chang , Fengrui Hao , Peipeng Yu , Shuai Zhao

Multimodal Large Language Models (MLLMs) have empowered embodied agents with remarkable capabilities in planning and reasoning. However, when facing ambiguous natural language instructions (e.g., "fetch the tool" in a cluttered room),…

Existing table understanding methods face challenges due to complex table structures and intricate logical reasoning. While supervised finetuning (SFT) dominates existing research, reinforcement learning (RL), such as Group Relative Policy…

计算与语言 · 计算机科学 2026-03-27 Xiaoqiang Kang , Shengen Wu , Zimu Wang , Yilin Liu , Xiaobo Jin , Kaizhu Huang , Wei Wang , Yutao Yue , Xiaowei Huang , Qiufeng Wang

Vision-Language Models (VLMs) frequently suffer from visual perception errors and hallucinations that compromise answer accuracy in complex reasoning tasks. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising solution…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Yin Zhang , Jiaxuan Zhao , Zonghan Wu , Zengxiang Li , Junfeng Fang , Kun Wang , Qingsong Wen , Yilei Shao

Mathematical reasoning is a fundamental capability for large language models (LLMs), yet achieving high performance in this domain remains a significant challenge. The auto-regressive generation process often makes LLMs susceptible to…

人工智能 · 计算机科学 2024-12-02 Xiaoxuan Lou , Chaojie Wang , Bo An

Recent works on large language models (LLMs) have successfully demonstrated the emergence of reasoning capabilities via reinforcement learning (RL). Although recent efforts leverage group relative policy optimization (GRPO) for MLLMs…

计算与语言 · 计算机科学 2025-06-18 Shilin Xu , Yanwei Li , Rui Yang , Tao Zhang , Yueyi Sun , Wei Chow , Linfeng Li , Hang Song , Qi Xu , Yunhai Tong , Xiangtai Li , Hao Fei

Recent applications of Reinforcement Learning with Verifiable Rewards (RLVR) to Large Language Models (LLMs) and Vision-Language Models (VLMs) have demonstrated significant success in enhancing reasoning capabilities for complex tasks.…

计算与语言 · 计算机科学 2026-02-06 Fanfan Liu , Youyang Yin , Peng Shi , Siqi Yang , Zhixiong Zeng , Haibo Qiu

Large Language Models (LLMs) have shown remarkable reasoning capabilities through Reinforcement Learning with Verifiable Rewards (RLVR) methods. However, a key limitation of existing approaches is that rewards defined at the full trajectory…

机器学习 · 计算机科学 2025-09-30 Zhicheng Yang , Zhijiang Guo , Yinya Huang , Xiaodan Liang , Yiwei Wang , Jing Tang

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

计算与语言 · 计算机科学 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

Vision Language Models exhibit impressive performance for various tasks, yet they often lack the sophisticated situational reasoning required for complex decision-making. This paper shows that VLMs can achieve surprisingly strong…

计算与语言 · 计算机科学 2025-10-07 Zhe Hu , Jing Li , Zhongzhu Pu , Hou Pong Chan , Yu Yin

We reveal a critical yet underexplored flaw in Large Vision-Language Models (LVLMs): even when these models know the correct answer, they frequently arrive there through incorrect reasoning paths. The core issue is not a lack of knowledge,…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Chaoyang Wang , Yangfan He , Yiyang Zhou , Yixuan Wang , Jiaqi Liu , Peng Xia , Zhengzhong Tu , Mohit Bansal , Huaxiu Yao

"Thinking with images" has emerged as an effective paradigm for advancing visual reasoning, extending beyond text-only chains of thought by injecting visual evidence into intermediate reasoning steps. However, existing methods fall short of…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Qixun Wang , Yang Shi , Yifei Wang , Yuanxing Zhang , Pengfei Wan , Kun Gai , Xianghua Ying , Yisen Wang

Recent advancements in Large Language Models (LLMs) have shown that it is promising to utilize Process Reward Models (PRMs) as verifiers to enhance the performance of LLMs. However, current PRMs face three key challenges: (1) limited…

计算与语言 · 计算机科学 2025-04-08 Jian Zhao , Runze Liu , Kaiyan Zhang , Zhimu Zhou , Junqi Gao , Dong Li , Jiafei Lyu , Zhouyi Qian , Biqing Qi , Xiu Li , Bowen Zhou

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily…

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, we propose…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Long Li , Shuichen Ji , Ziyang Luo , Zhihui Li , Dingwen Zhang , Junwei Han , Nian Liu

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

There emerges a promising trend of using large language models (LLMs) to generate code-like plans for complex inference tasks such as visual reasoning. This paradigm, known as LLM-based planning, provides flexibility in problem solving and…

计算与语言 · 计算机科学 2023-08-22 Pengbo Hu , Ji Qi , Xingyu Li , Hong Li , Xinqi Wang , Bing Quan , Ruiyu Wang , Yi Zhou

Complex multi-step reasoning tasks, such as solving mathematical problems or generating code, remain a significant hurdle for even the most advanced large language models (LLMs). Verifying LLM outputs with an Outcome Reward Model (ORM) is a…

Large language models (LLMs) are reshaping the recommender system paradigm by enabling users to express preferences and receive recommendations through conversations. Yet, aligning LLMs to the recommendation task remains challenging:…

信息检索 · 计算机科学 2026-02-17 Yaochen Zhu , Harald Steck , Dawen Liang , Yinhan He , Vito Ostuni , Jundong Li , Nathan Kallus

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

计算与语言 · 计算机科学 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang