English
Related papers

Related papers: PAC-Bayesian Reward-Certified Outcome Weighted Lea…

200 papers

Reinforcement learning with verifiable rewards (RLVR) for Large Reasoning Models hinges on baseline estimation for variance reduction, but existing approaches pay a heavy price: PPO requires a policy-model scale critic, while GRPO needs…

Machine Learning · Computer Science 2026-05-12 Yunho Choi , Jongwon Lim , Woojin Ahn , Minjae Oh , Jeonghoon Shim , Yohan Jo

Inverse reinforcement learning (IRL) methods infer an agent's reward function using demonstrations of expert behavior. A Bayesian IRL approach models a distribution over candidate reward functions, capturing a degree of uncertainty in the…

Machine Learning · Computer Science 2025-07-04 Aishwarya Mandyam , Didong Li , Jiayu Yao , Diana Cai , Andrew Jones , Barbara E. Engelhardt

Our goal is to learn control policies for robots that provably generalize well to novel environments given a dataset of example environments. The key technical idea behind our approach is to leverage tools from generalization theory in…

Robotics · Computer Science 2020-08-27 Anirudha Majumdar , Alec Farid , Anoopkumar Sonar

Preference-based Reinforcement Learning (PbRL) replaces reward values in traditional reinforcement learning by preferences to better elicit human opinion on the target objective, especially when numerical reward values are hard to design or…

Machine Learning · Computer Science 2020-10-27 Yichong Xu , Ruosong Wang , Lin F. Yang , Aarti Singh , Artur Dubrawski

Multi-tool-integrated reasoning enables LLM-empowered tool-use agents to solve complex tasks by interleaving natural-language reasoning with calls to external tools. However, training such agents from outcome-only rewards suffers from…

Computation and Language · Computer Science 2026-05-04 Feijie Wu , Weiwu Zhu , Yuxiang Zhang , Soumya Chatterjee , Jiarong Zhu , Fan Mo , Rong Luo , Jing Gao

In this paper, we investigate the problem of offline Preference-based Reinforcement Learning (PbRL) with human feedback where feedback is available in the form of preference between trajectory pairs rather than explicit rewards. Our…

Machine Learning · Computer Science 2023-10-03 Wenhao Zhan , Masatoshi Uehara , Nathan Kallus , Jason D. Lee , Wen Sun

Multi-objective reinforcement learning (MORL) is a structured approach for optimizing tasks with multiple objectives. However, it often relies on pre-defined reward functions, which can be hard to design for balancing conflicting goals and…

Machine Learning · Computer Science 2025-07-21 Ni Mu , Yao Luan , Qing-Shan Jia

Data-driven individualized decision making has recently received increasing research interests. Most existing methods rely on the assumption of no unmeasured confounding, which unfortunately cannot be ensured in practice especially in…

Methodology · Statistics 2022-12-26 Zhengling Qi , Rui Miao , Xiaoke Zhang

Constrained Reinforcement Learning (RL) aims to maximize the return while adhering to predefined constraint limits, which represent domain-specific safety requirements. In continuous control settings, where learning agents govern system…

Machine Learning · Computer Science 2025-09-12 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

Safe offline reinforcement learning aims to learn policies that maximize cumulative rewards while adhering to safety constraints, using only offline data for training. A key challenge is balancing safety and performance, particularly when…

Machine Learning · Computer Science 2024-12-13 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Individualized treatment rules (ITRs) are considered a promising recipe to deliver better policy interventions. One key ingredient in optimal ITR estimation problems is to estimate the average treatment effect conditional on a subject's…

Methodology · Statistics 2021-03-16 Hongming Pu , Bo Zhang

This paper presents an approach for learning vision-based planners that provably generalize to novel environments (i.e., environments unseen during training). We leverage the Probably Approximately Correct (PAC)-Bayes framework to obtain an…

Robotics · Computer Science 2020-11-11 Sushant Veer , Anirudha Majumdar

In this paper, we tackle the challenging problem of delayed rewards in reinforcement learning (RL). While Proximal Policy Optimization (PPO) has emerged as a leading Policy Gradient method, its performance can degrade under delayed rewards.…

Offline inverse reinforcement learning (IRL) aims to recover a reward function that explains expert behavior using only fixed demonstration data, without any additional online interaction. We propose BiCQL-ML, a policy-free offline IRL…

Machine Learning · Computer Science 2025-12-01 Junsung Park

To promote precision medicine, individualized treatment regimes (ITRs) are crucial for optimizing the expected clinical outcome based on patient-specific characteristics. However, existing ITR research has primarily focused on scenarios…

Methodology · Statistics 2024-02-20 Chang Wang , Lu Wang

Bayesian inference over the reward presents an ideal solution to the ill-posed nature of the inverse reinforcement learning problem. Unfortunately current methods generally do not scale well beyond the small tabular setting due to the need…

Machine Learning · Computer Science 2021-03-15 Alex J. Chan , Mihaela van der Schaar

Inverse reinforcement learning (IRL) aims to infer a reward from expert demonstrations, motivated by the idea that the reward, rather than the policy, is the most succinct and transferable description of a task [Ng et al., 2000]. However,…

Machine Learning · Computer Science 2025-02-05 Andreas Schlaginhaufen , Maryam Kamgarpour

Existing reinforcement learning (RL)-based post-training methods for large language models have advanced rapidly, yet their design has largely been guided by heuristics rather than systematic theoretical principles. This gap limits our…

Machine Learning · Statistics 2026-01-16 Zixun Huang , Jiayi Sheng , Zeyu Zheng

Preference-based reinforcement learning (PbRL) is an approach that enables RL agents to learn from preference, which is particularly useful when formulating a reward function is challenging. Existing PbRL methods generally involve a…

Machine Learning · Computer Science 2023-10-30 Gaon An , Junhyeok Lee , Xingdong Zuo , Norio Kosaka , Kyung-Min Kim , Hyun Oh Song

Preference-based reinforcement learning (PbRL) enables agents to learn control policies without requiring manually designed reward functions, making it well-suited for tasks where objectives are difficult to formalize or inherently…

Robotics · Computer Science 2026-03-04 Colin Merk , Ismail Geles , Jiaxu Xing , Angel Romero , Giorgia Ramponi , Davide Scaramuzza