English
Related papers

Related papers: How to Allocate, How to Learn? Dynamic Rollout All…

200 papers

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

A key challenge in applying reinforcement learning (RL) to diffusion large language models (dLLMs) lies in the intractability of their likelihood functions, which are essential for the RL objective, necessitating corresponding approximation…

Machine Learning · Computer Science 2025-10-15 Nianyi Lin , Jiajie Zhang , Lei Hou , Juanzi Li

Reinforcement Learning with Verifiable Rewards (RLVR), particularly with algorithms like Group Relative Policy Optimization (GRPO), has proven highly effective in enhancing the reasoning capabilities of large language models. However, a…

Computation and Language · Computer Science 2026-03-03 Shangyu Xing , Siyuan Wang , Chenyuan Yang , Xinyu Dai , Xiang Ren

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Inference scaling further accelerates Large Language Models (LLMs) toward Artificial General Intelligence (AGI), with large-scale Reinforcement Learning (RL) to unleash long Chain-of-Thought reasoning. Most contemporary reasoning approaches…

Machine Learning · Computer Science 2025-05-20 Xuerui Su , Liya Guo , Yue Wang , Yi Zhu , Zhiming Ma , Zun Wang , Yuting Liu

Reinforcement learning with verifiable rewards (RLVR) has proven effective in training large reasoning models (LRMs) by leveraging answer-verifiable signals to guide policy optimization, which, however, suffers from high annotation costs.…

Machine Learning · Computer Science 2025-12-16 Shenzhi Yang , Guangcheng Zhu , Xing Zheng , Yingfan MA , Zhongqi Chen , Bowen Song , Weiqiang Wang , Junbo Zhao , Gang Chen , Haobo Wang

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a promising framework for enhancing the reasoning capabilities of large language models. However, existing approaches such as GRPO often suffer from zero gradients. This…

Computation and Language · Computer Science 2025-09-09 Shihui Yang , Chengfeng Dou , Peidong Guo , Kai Lu , Qiang Ju , Fei Deng , Rihui Xin

Deep Reinforcement Learning (RL) is remarkably effective in addressing sequential resource allocation problems in domains such as healthcare, public policy, and resource management. However, deep RL policies often lack transparency and…

Machine Learning · Computer Science 2025-02-18 Mauricio Tec , Guojun Xiong , Haichuan Wang , Francesca Dominici , Milind Tambe

Reinforcement learning from human feedback (RLHF) or verifiable rewards (RLVR), the standard paradigm for aligning LLMs or building recent SOTA reasoning models, is highly sensitive to noise from inconsistent or erroneous rewards. Yet, the…

Machine Learning · Computer Science 2026-05-20 Omar El Mansouri , Fathinah Asma Izzati , Mohamed El Amine Seddik , Salem Lahlou

This study proposes a regime-aware reinforcement learning framework for long-horizon portfolio optimization. Moving beyond traditional feedforward and GARCH-based models, we design realistic environments where agents dynamically reallocate…

Portfolio Management · Quantitative Finance 2025-09-19 Gabriel Nixon Raj

Generative models, particularly diffusion models, have achieved remarkable success in density estimation for multimodal data, drawing significant interest from the reinforcement learning (RL) community, especially in policy modeling in…

Machine Learning · Computer Science 2024-12-03 Jinouwen Zhang , Rongkun Xue , Yazhe Niu , Yun Chen , Jing Yang , Hongsheng Li , Yu Liu

Visual generation is dominated by three paradigms: AutoRegressive (AR), diffusion, and Visual AutoRegressive (VAR) models. Unlike AR and diffusion, VARs operate on heterogeneous input structures across their generation steps, which creates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Shikun Sun , Liao Qu , Huichao Zhang , Yiheng Liu , Yangyang Song , Xian Li , Xu Wang , Yi Jiang , Daniel K. Du , Xinglong Wu , Jia Jia

Alignment of large language models (LLMs) typically involves training a reward model on preference data, followed by policy optimization with respect to the reward model. However, optimizing policies with respect to a single reward model…

Machine Learning · Computer Science 2025-07-23 Debangshu Banerjee , Kintan Saha , Aditya Gopalan

The evolution of Large Language Models (LLMs) has catalyzed a paradigm shift from superficial instruction following to rigorous long-horizon reasoning. While Group Relative Policy Optimization (GRPO) has emerged as a pivotal mechanism for…

Artificial Intelligence · Computer Science 2026-01-01 Xuan Xie , Xuan Wang , Wenjie Wang , Shuai Chen , Wei Lin

The dynamic allocation of spectrum in 5G / 6G networks is critical to efficient resource utilization. However, applying traditional deep reinforcement learning (DRL) is often infeasible due to its immense sample complexity and the safety…

Machine Learning · Computer Science 2026-03-02 Oluwaseyi Giwa , Tobi Awodunmila , Muhammad Ahmed Mohsin , Ahsan Bilal , Muhammad Ali Jamshed

While Reinforcement Learning (RL) shows promise in training tool-use Large Language Models (LLMs) using verifiable outcome rewards, existing methods largely overlook the potential of reasoning rewards based on chain-of-thought quality for…

Computation and Language · Computer Science 2026-01-16 Zihan Lin , Xiaohan Wang , Hexiong Yang , Jiajun Chai , Jie Cao , Guojun Yin , Wei Lin , Ran He

Large Reasoning Models (LRMs) have shown exceptional reasoning capabilities, but they also suffer from the issue of overthinking, often generating excessively long and redundant answers. For problems that exceed the model's capabilities,…

Machine Learning · Computer Science 2026-03-23 Yinan Xia , Haotian Zhang , Huiming Wang

The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the…

Networking and Internet Architecture · Computer Science 2025-04-23 Michael Doherty , Robin Matzner , Rasoul Sadeghi , Polina Bayvel , Alejandra Beghelli

Reinforcement learning from verifiable rewards has emerged as a powerful technique for enhancing the complex reasoning abilities of Large Language Models (LLMs). However, these methods are fundamentally constrained by the ''learning cliff''…

Computation and Language · Computer Science 2026-03-03 Xichen Zhang , Sitong Wu , Yinghao Zhu , Haoru Tan , Shaozuo Yu , Ziyi He , Jiaya Jia