English
Related papers

Related papers: rlpyt: A Research Code Base for Deep Reinforcement…

200 papers

Large language models (LLMs) have exhibited remarkable performance on complex reasoning tasks, with reinforcement learning under verifiable rewards (RLVR) emerging as a principled framework for aligning model behavior with reasoning chains.…

Artificial Intelligence · Computer Science 2026-05-05 Yunjian Zhang , Sudong Wang , Yang Li , Peiran Xu , Conghao Zhou , Xiaoyue Ma , Jianing Li , Yao Zhu

In this work, we propose Reinforced Functional Token Tuning (RFTT), a novel reinforced fine-tuning framework that empowers Large Language Models (LLMs) with self-play learn-to-reason capabilities. Unlike prior prompt-driven reasoning…

Artificial Intelligence · Computer Science 2025-02-20 Kongcheng Zhang , Qi Yao , Baisheng Lai , Jiaxing Huang , Wenkai Fang , Dacheng Tao , Mingli Song , Shunyu Liu

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

Machine Learning · Computer Science 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Reinforcement learning with verifiable rewards (RLVR) typically optimizes for outcome rewards without imposing constraints on intermediate reasoning. This leaves training susceptible to reward hacking, where models exploit loopholes (e.g.,…

Machine Learning · Computer Science 2026-04-20 Songtao Wang , Quang Hieu Pham , Fangcong Yin , Xinpeng Wang , Jocelyn Qiaochu Chen , Greg Durrett , Xi Ye

Deep learning (DL) has been a revolutionary technique in various domains. To facilitate the model development and deployment, many deep learning frameworks are proposed, among which PyTorch is one of the most popular solutions. The…

Machine Learning · Computer Science 2023-06-27 Yueming Hao , Xu Zhao , Bin Bao , David Berard , Will Constable , Adnan Aziz , Xu Liu

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

RSL-RL is an open-source Reinforcement Learning library tailored to the specific needs of the robotics community. Unlike broad general-purpose frameworks, its design philosophy prioritizes a compact and easily modifiable codebase, allowing…

Robotics · Computer Science 2025-09-16 Clemens Schwarke , Mayank Mittal , Nikita Rudin , David Hoeller , Marco Hutter

As reinforcement learning (RL) achieves more success in solving complex tasks, more care is needed to ensure that RL research is reproducible and that algorithms herein can be compared easily and fairly with minimal bias. RL results are,…

Machine Learning · Computer Science 2019-09-12 Nicolai A. Lynnerup , Laura Nolling , Rasmus Hasle , John Hallam

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

Computation and Language · Computer Science 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

We introduce SafeRL-Lite, an open-source Python library for building reinforcement learning (RL) agents that are both constrained and explainable. Existing RL toolkits often lack native mechanisms for enforcing hard safety constraints or…

Machine Learning · Computer Science 2025-06-24 Satyam Mishra , Phung Thao Vi , Shivam Mishra , Vishwanath Bijalwan , Vijay Bhaskar Semwal , Abdul Manan Khan

Current Large Language Models (LLMs) exhibit significant limitations, notably in structured, interpretable, and verifiable medical reasoning, alongside practical deployment challenges related to computational resources and data privacy.…

Computation and Language · Computer Science 2025-06-06 Boqin Zhuang , Chenxiao Song , Huitong Lu , Jiacheng Qiao , Mingqian Liu , Mingxing Yu , Ping Hong , Rui Li , Xiaoxia Song , Xiangjun Xu , Xu Chen , Yaoyao Ma , Yujie Gao

Large Language Models (LLMs) have shown strong capabilities through two complementary paradigms: Retrieval-Augmented Generation (RAG) for knowledge grounding and Reinforcement Learning from Verifiable Rewards (RLVR) for complex reasoning.…

Computation and Language · Computer Science 2026-04-27 Weitao Li , Boran Xiang , Xiaolong Wang , Zhinan Gou , Weizhi Ma , Yang Liu

Data processing and analytics are fundamental and pervasive. Algorithms play a vital role in data processing and analytics where many algorithm designs have incorporated heuristics and general rules from human knowledge and experience to…

Machine Learning · Computer Science 2022-02-07 Qingpeng Cai , Can Cui , Yiyuan Xiong , Wei Wang , Zhongle Xie , Meihui Zhang

We discuss deep reinforcement learning in an overview style. We draw a big picture, filled with details. We discuss six core elements, six important mechanisms, and twelve applications, focusing on contemporary work, and in historical…

Machine Learning · Computer Science 2018-10-16 Yuxi Li

Multi-turn reasoning agents solve complex questions by decomposing them into intermediate retrieval or tool-use steps, for accumulating supporting evidence across turns. Meanwhile, with reinforcement learning (RL), training these agents…

Computation and Language · Computer Science 2026-05-12 Hojae Han , Heeyun Jung , Jongyoon Kim , Seung-won Hwang

Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs). Particularly, the "Zero" reinforcement learning introduced by Deepseek-R1-Zero, enables direct…

Computation and Language · Computer Science 2025-06-10 Xueguang Ma , Qian Liu , Dongfu Jiang , Ge Zhang , Zejun Ma , Wenhu Chen

Reinforcement learning (RL) has become essential for unlocking advanced reasoning capabilities in large language models (LLMs). RL workflows involve interleaving rollout and training stages with fundamentally different resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Yongji Wu , Xueshen Liu , Haizhong Zheng , Juncheng Gu , Beidi Chen , Z. Morley Mao , Arvind Krishnamurthy , Ion Stoica

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth…

Computation and Language · Computer Science 2026-05-27 Yihua Zhu , Qianying Liu , Fei Cheng , Jiaxin Wang , Akiko Aizawa , Sadao Kurohashi , Hidetoshi Shimodaira