English
Related papers

Related papers: Generalised Linear Models in Deep Bayesian RL with…

200 papers

Understanding generalization in reinforcement learning (RL) is a significant challenge, as many common assumptions of traditional supervised learning theory do not apply. We focus on the special class of reparameterizable RL problems, where…

Machine Learning · Computer Science 2019-05-31 Huan Wang , Stephan Zheng , Caiming Xiong , Richard Socher

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

Machine Learning · Computer Science 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

This work introduces Bilinear Classes, a new structural framework, which permit generalization in reinforcement learning in a wide variety of settings through the use of function approximation. The framework incorporates nearly all existing…

Machine Learning · Computer Science 2021-07-13 Simon S. Du , Sham M. Kakade , Jason D. Lee , Shachar Lovett , Gaurav Mahajan , Wen Sun , Ruosong Wang

Post-training has split large language model (LLM) alignment into two largely disconnected tracks. Online reinforcement learning (RL) with verifiable rewards drives emergent reasoning on math and code but depends on a programmatic verifier…

Model-based reinforcement learning (MBRL) aims to learn a dynamic model to reduce the number of interactions with real-world environments. However, due to estimation error, rollouts in the learned model, especially those of long horizons,…

Machine Learning · Computer Science 2020-03-17 Yueh-Hua Wu , Ting-Han Fan , Peter J. Ramadge , Hao Su

We introduce a deep reinforcement learning (DRL) approach for solving management problems including inventory management, dynamic pricing, and recommendation. This DRL approach has the potential to lead to a large management model based on…

Artificial Intelligence · Computer Science 2024-03-04 Jinyang Jiang , Xiaotian Liu , Tao Ren , Qinghao Wang , Yi Zheng , Yufu Du , Yijie Peng , Cheng Zhang

In classic Reinforcement Learning (RL), the agent maximizes an additive objective of the visited states, e.g., a value function. Unfortunately, objectives of this type cannot model many real-world applications such as experiment design,…

Machine Learning · Computer Science 2024-07-16 Riccardo De Santi , Manish Prajapat , Andreas Krause

Model information can be used to predict future trajectories, so it has huge potential to avoid dangerous region when implementing reinforcement learning (RL) on real-world tasks, like autonomous driving. However, existing studies mostly…

Robotics · Computer Science 2021-03-08 Haitong Ma , Jianyu Chen , Shengbo Eben Li , Ziyu Lin , Yang Guan , Yangang Ren , Sifa Zheng

Large Language Models (LLMs) trained via Reinforcement Learning (RL) have exhibited strong reasoning capabilities and emergent reflective behaviors, such as rethinking and error correction, as a form of in-context exploration. However, the…

Machine Learning · Computer Science 2025-12-09 Shenao Zhang , Yaqing Wang , Yinxiao Liu , Tianqi Liu , Peter Grabowski , Eugene Ie , Zhaoran Wang , Yunxuan Li

Reinforcement learning with verifiable rewards (RLVR) has been a main driver of recent breakthroughs in large reasoning models. Yet it remains a mystery how rewards based solely on final outcomes can help overcome the long-horizon barrier…

Machine Learning · Computer Science 2026-05-07 Yu Huang , Zixin Wen , Yuejie Chi , Yuting Wei , Aarti Singh , Yingbin Liang , Yuxin Chen

Learning to reach goal states and learning diverse skills through mutual information (MI) maximization have been proposed as principled frameworks for self-supervised reinforcement learning, allowing agents to acquire broadly applicable…

Machine Learning · Computer Science 2021-06-04 Jongwook Choi , Archit Sharma , Honglak Lee , Sergey Levine , Shixiang Shane Gu

Reinforcement learning with verifiable rewards (RLVR) has demonstrated significant success in enhancing mathematical reasoning and coding performance of large language models (LLMs), especially when structured reference answers are…

Computation and Language · Computer Science 2025-04-02 Yi Su , Dian Yu , Linfeng Song , Juntao Li , Haitao Mi , Zhaopeng Tu , Min Zhang , Dong Yu

One of the main challenges in imitation learning is determining what action an agent should take when outside the state distribution of the demonstrations. Inverse reinforcement learning (IRL) can enable generalization to new states by…

Machine Learning · Computer Science 2024-03-04 Daniel S. Brown , Scott Niekum , Marek Petrik

In the Bayesian Reinforcement Learning (BRL) setting, agents try to maximise the collected rewards while interacting with their environment while using some prior knowledge that is accessed beforehand. Many BRL algorithms have already been…

Artificial Intelligence · Computer Science 2016-09-28 Michael Castronovo , Damien Ernst , Adrien Couetoux , Raphael Fonteneau

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving…

Machine Learning · Computer Science 2019-03-18 Charles Packer , Katelyn Gao , Jernej Kos , Philipp Krähenbühl , Vladlen Koltun , Dawn Song

We present GoLongRL, a fully open-source, capability-oriented post-training recipe for long-context reinforcement learning with verifiable rewards (RLVR). Existing long-context RL methods often treat data construction as a matter of…

Computation and Language · Computer Science 2026-05-20 Minxuan Lv , Tiehua Mei , Tanlong Du , Junmin Chen , Zhenpeng Su , Ziyang Chen , Ziqi Wang , Zhennan Wu , Ruotong Pan , jian Liang , Ruiming Tang , Han Li

Optimization problems characterized by both discrete and continuous variables are common across various disciplines, presenting unique challenges due to their complex solution landscapes and the difficulty of navigating mixed-variable…

Optimization and Control · Mathematics 2024-06-03 Haoyan Zhai , Qianli Hu , Jiangning Chen

In recent years, meta-reinforcement learning (meta-RL) algorithm has been proposed to improve sample efficiency in the field of decision-making and control, enabling agents to learn new knowledge from a small number of samples. However,…

Machine Learning · Computer Science 2025-01-14 Chenyang Qi , Huiping Li , Panfeng Huang

In sequential decision-making (SDM) tasks, methods like reinforcement learning (RL) and heuristic search have made notable advances in specific cases. However, they often require extensive exploration and face challenges in generalizing…

Machine Learning · Computer Science 2024-10-11 Xue Yan , Yan Song , Xidong Feng , Mengyue Yang , Haifeng Zhang , Haitham Bou Ammar , Jun Wang

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim