English
Related papers

Related papers: R-Diverse: Mitigating Diversity Illusion in Self-P…

200 papers

Reasoning-augmented search agents such as Search-R1, trained via reinforcement learning with verifiable rewards (RLVR), demonstrate remarkable capabilities in multi-step information retrieval from external knowledge sources. These agents…

Computation and Language · Computer Science 2025-08-14 Shu Zhao , Tan Yu , Anbang Xu , Japinder Singh , Aaditya Shukla , Rama Akkiraju

Recent advances in large language model (LLM) reasoning, led by reinforcement learning with verifiable rewards (RLVR), have inspired self-play post-training, where models improve by generating and solving their own problems. While self-play…

Machine Learning · Computer Science 2025-11-03 Justin Yang Chae , Md Tanvirul Alam , Nidhi Rastogi

AI self-evolution has long been envisioned as a path toward superintelligence, where models autonomously acquire, refine, and internalize knowledge from their own learning experiences. Yet in practice, unguided self-evolving systems often…

Artificial Intelligence · Computer Science 2025-12-03 Wenhao Yu , Zhenwen Liang , Chengsong Huang , Kishan Panaganti , Tianqing Fang , Haitao Mi , Dong Yu

We present Seir\^enes, a self-play RL framework that transforms contextual interference from a failure mode of LLM reasoning into an internal training signal for co-evolving more resilient reasoners. While RL with verifiable rewards has…

Artificial Intelligence · Computer Science 2026-05-13 Chi Zhang , Haibo Qiu , Qiming Zhang , Yufei Xu , Xinbo Gao , Jing Zhang

Reinforcement learning (RL) provides a principled framework for improving Vision-Language Models (VLMs) on complex reasoning tasks. However, existing RL approaches often rely on human-annotated labels or task-specific heuristics to define…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yicheng He , Chengsong Huang , Zongxia Li , Jiaxin Huang , Yonghui Yang

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Reinforcement Learning with Verifiable Rewards (RLVR) enhances reasoning of Large Language Models (LLMs) but usually exhibits limited generation diversity due to the over-incentivization of positive rewards. Although methods like Negative…

Machine Learning · Computer Science 2026-05-11 Zihan Lin , Xiaohan Wang , Jie Cao , Jiajun Chai , Li Wang , Xiaodong Lu , Wei Lin , Ran He , Guojun Yin

While Reinforcement Learning for Verifiable Rewards (RLVR) is powerful for training large reasoning models, its training dynamics harbor a critical challenge: RL overfitting, where models gain training rewards but lose generalization. Our…

Artificial Intelligence · Computer Science 2025-11-07 Zeng Zhiyuan , Jiashuo Liu , Zhangyue Yin , Ge Zhang , Wenhao Huang , Xipeng Qiu

Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capabilities of Large Language Models. When applied to RLVR, Multiple-Choice Questions (MCQs) offer a scalable source of verifiable data but risk…

Computation and Language · Computer Science 2026-03-16 Xu Guo , Qiming Ge , Jian Tong , Kedi Chen , Jin Zhang , Xiaogui Yang , Xuan Gao , Haijun Lv , Zhihui Lu , Yicheng Zou , Qipeng Guo

Recent AI advancements, such as OpenAI's new models, are transforming LLMs into LRMs (Large Reasoning Models) that perform reasoning during inference, taking extra time and compute for higher-quality outputs. We aim to uncover the…

Artificial Intelligence · Computer Science 2025-02-11 Guanghao Ye , Khiem Duc Pham , Xinzhi Zhang , Sivakanth Gopi , Baolin Peng , Beibin Li , Janardhan Kulkarni , Huseyin A. Inan

Reinforcement learning (RL) has emerged as a powerful method for improving the reasoning abilities of large language models (LLMs). Outcome-based RL, which rewards policies solely for the correctness of the final answer, yields substantial…

Machine Learning · Computer Science 2025-09-09 Yuda Song , Julia Kempe , Remi Munos

Exploration poses a fundamental challenge in Reinforcement Learning (RL) with sparse rewards, limiting an agent's ability to learn optimal decision-making due to a lack of informative feedback signals. Self-Imitation Learning (self-IL) has…

Machine Learning · Computer Science 2023-11-02 Alain Andres , Daochen Zha , Javier Del Ser

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

Artificial Intelligence · Computer Science 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

Reinforcement learning with verifiable rewards (RLVR) scales the reasoning ability of large language models (LLMs) but remains bottlenecked by limited labeled samples for continued data scaling. Reinforcement learning with intrinsic rewards…

Machine Learning · Computer Science 2025-10-13 Chuyi Tan , Peiwen Yuan , Xinglin Wang , Yiwei Li , Shaoxiong Feng , Yueqi Zhang , Jiayi Shi , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Learning identity-discriminative representations with multi-scene generality has become a critical objective in person re-identification (ReID). However, mainstream perception-driven paradigms tend to identify fitting from massive annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Quan Zhang , Jingze Wu , Jialong Wang , Xiaohua Xie , Jianhuang Lai , Hongbo Chen

Reinforcement learning (RL) has become a central paradigm for post-training large language models (LLMs), particularly for complex reasoning tasks, yet it often suffers from exploration collapse: policies prematurely concentrate on a small…

Machine Learning · Computer Science 2026-01-16 Zhiyuan Hu , Yucheng Wang , Yufei He , Jiaying Wu , Yilun Zhao , See-Kiong Ng , Cynthia Breazeal , Anh Tuan Luu , Hae Won Park , Bryan Hooi

This paper introduces rStar, a self-play mutual reasoning approach that significantly improves reasoning capabilities of small language models (SLMs) without fine-tuning or superior models. rStar decouples reasoning into a self-play mutual…

Computation and Language · Computer Science 2024-08-13 Zhenting Qi , Mingyuan Ma , Jiahang Xu , Li Lyna Zhang , Fan Yang , Mao Yang

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning large-scale generative models, such as diffusion and flow models, to align with complex human preferences and user-specified tasks. A fundamental limitation…

Machine Learning · Computer Science 2026-01-21 Jinmei Liu , Haoru Li , Zhenhong Sun , Chaofeng Chen , Yatao Bian , Bo Wang , Daoyi Dong , Chunlin Chen , Zhi Wang

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in logical reasoning tasks, yet whether large language model (LLM) alignment requires fundamentally different approaches remains unclear. Given the…

Artificial Intelligence · Computer Science 2026-03-12 Zhaowei Zhang , Xiaohan Liu , Xuekai Zhu , Junchao Huang , Ceyao Zhang , Zhiyuan Feng , Yaodong Yang , Xiaoyuan Yi , Xing Xie