English
Related papers

Related papers: Agent Explorative Policy Optimization for Multimod…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capability of large language models (LLMs), enabling autonomous agents that can conduct effective multi-turn and tool-integrated reasoning. While instructions…

Machine Learning · Computer Science 2026-02-03 Han Zhou , Xingchen Wan , Ivan Vulić , Anna Korhonen

We introduce rStar2-Agent, a 14B math reasoning model trained with agentic reinforcement learning to achieve frontier-level performance. Beyond current long CoT, the model demonstrates advanced cognitive behaviors, such as thinking…

Balancing exploration and exploitation during reinforcement learning fine-tuning of generative models presents a critical challenge, as existing approaches rely on fixed divergence regularization that creates an inherent dilemma: strong…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Tong Wei , Chaoran Cheng , Yuxin Chen , Ge Liu

Critic-free reinforcement learning methods, particularly group policies, have attracted considerable attention for their efficiency in complex tasks. However, these methods rely heavily on multiple sampling and comparisons within the policy…

Machine Learning · Computer Science 2025-09-22 Wenfeng Feng , Penghong Zhao , Guochao Jiang , Chuzhan Hao , Yuewei Zhang , Guohua Liu , Hao Wang

Reinforcement learning from verifiable rewards (RLVR) is an emerging paradigm for improving the reasoning ability of large language models. However, standard on-policy training discards rollout experiences after a single update, leading to…

Machine Learning · Computer Science 2026-03-03 Runzhe Zhan , Yafu Li , Zhi Wang , Xiaoye Qu , Dongrui Liu , Jing Shao , Derek F. Wong , Yu Cheng

Offline reinforcement learning endeavors to leverage offline datasets to craft effective agent policy without online interaction, which imposes proper conservative constraints with the support of behavior policies to tackle the…

Machine Learning · Computer Science 2024-11-12 Yunpeng Qing , Shunyu liu , Jingyuan Cong , Kaixuan Chen , Yihe Zhou , Mingli Song

Recent advances in reinforcement learning (RL) have significantly enhanced the agentic capabilities of large language models (LLMs). In long-term and multi-turn agent tasks, existing approaches driven solely by outcome rewards often suffer…

Machine Learning · Computer Science 2026-03-19 Yuxiang Ji , Ziyu Ma , Yong Wang , Guanhua Chen , Xiangxiang Chu , Liaoni Wu

Using effective generalization capabilities of vision language models (VLMs) in context-specific dynamic tasks for embodied artificial intelligence remains a significant challenge. Although supervised fine-tuned models can better align with…

Artificial Intelligence · Computer Science 2025-09-11 Kechen Jiao , Zhirui Fang , Jiahao Liu , Bei Li , Qifan Wang , Xinyu Liu , Junhao Ruan , Zhongjian Qiao , Yifan Zhu , Yaxin Xu , Jingang Wang , Xiu Li

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit…

Computation and Language · Computer Science 2025-10-24 Zhenrui Yue , Bowen Jin , Huimin Zeng , Honglei Zhuang , Zhen Qin , Jinsung Yoon , Lanyu Shang , Jiawei Han , Dong Wang

Specialized visual tools can augment large language models or vision language models with expert knowledge (e.g., grounding, spatial reasoning, medical knowledge, etc.), but knowing which tools to call (and when to call them) can be…

Computation and Language · Computer Science 2025-12-09 Nithin Sivakumaran , Justin Chih-Yao Chen , David Wan , Yue Zhang , Jaehong Yoon , Elias Stengel-Eskin , Mohit Bansal

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning ability of large language models (LLMs), but it often suffers from \textit{restricted exploration}, where the policy rapidly concentrates on a…

Computation and Language · Computer Science 2026-05-13 Hengrui Gu , Xiaotian Han , Yujing Bian , Feiyi Wang , Kaixiong Zhou

Despite tremendous recent advances in large model reasoning ability, vision-language models (VLMs) still struggle with detailed visual reasoning, especially when compute resources are limited. To address this challenge, we draw inspiration…

Machine Learning · Computer Science 2025-08-06 Sunil Kumar , Bowen Zhao , Leo Dirac , Paulina Varshavskaya

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

Large language models trained with reinforcement learning with verifiable rewards tend to trade accuracy for length--inflating response lengths to achieve gains in accuracy. While longer answers may be warranted for harder problems, many…

Computation and Language · Computer Science 2025-08-14 Vaishnavi Shrivastava , Ahmed Awadallah , Vidhisha Balachandran , Shivam Garg , Harkirat Behl , Dimitris Papailiopoulos

Recent advances in agentic frameworks have enabled AI agents to perform complex reasoning and decision-making. However, evidence comparing their reasoning performance, efficiency, and practical suitability remains limited. To address this…

Artificial Intelligence · Computer Science 2026-04-21 Zeeshan Rasheed , Abdul Malik Sami , Muhammad Waseem , Kai-Kristian Kemell , Mika Saari , Pekka Abrahamsson

Test-time scaling has proven effective in further enhancing the performance of pretrained Large Language Models (LLMs). However, mainstream post-training methods (i.e., reinforcement learning (RL) with chain-of-thought (CoT) reasoning)…

Machine Learning · Computer Science 2025-08-19 Yuyang Xu , Yi Cheng , Haochao Ying , Zhuoyun Du , Renjun Hu , Xing Shi , Wei Lin , Jian Wu

Recent advances in group-based reinforcement learning (RL) have driven frontier large language models (LLMs) in single-turn tasks like mathematical reasoning. However, their scalability to multi-turn LLM agent training remains limited.…

Machine Learning · Computer Science 2025-10-29 Lang Feng , Zhenghai Xue , Tingcong Liu , Bo An

Sequential reasoning in agent systems has been significantly advanced by large language models (LLMs), yet existing approaches face limitations. Reflection-driven reasoning relies solely on knowledge in pretrained models, limiting…

Machine Learning · Computer Science 2024-10-23 Chen Yang , Chenyang Zhao , Quanquan Gu , Dongruo Zhou

Group-based reinforcement learning (RL), such as GRPO, has advanced the capabilities of large language models on long-horizon agentic tasks. To enable more fine-grained policy updates, recent research has increasingly shifted toward…

Machine Learning · Computer Science 2026-02-27 Shuo He , Lang Feng , Qi Wei , Xin Cheng , Lei Feng , Bo An