English
Related papers

Related papers: Coordinate Ascent for Off-Policy RL with Global Co…

200 papers

Offline policy improvement faces an inherent conflict between maximizing value and fitting the data distribution. While in-sample weighted regression is stable, it suffers from over-conservatism that suppresses high-value actions in the…

Machine Learning · Computer Science 2026-05-28 Jiaxin Zhao , Weihang Pan , Xun Liang , Binbin Lin

In order to model risk aversion in reinforcement learning, an emerging line of research adapts familiar algorithms to optimize coherent risk functionals, a class that includes conditional value-at-risk (CVaR). Because optimizing the…

Machine Learning · Computer Science 2021-03-09 Audrey Huang , Liu Leqi , Zachary C. Lipton , Kamyar Azizzadenesheli

In batch reinforcement learning (RL), one often constrains a learned policy to be close to the behavior (data-generating) policy, e.g., by constraining the learned action distribution to differ from the behavior policy by some maximum…

Machine Learning · Computer Science 2020-03-31 Sungryull Sohn , Yinlam Chow , Jayden Ooi , Ofir Nachum , Honglak Lee , Ed Chi , Craig Boutilier

In recent years, trust region on-policy reinforcement learning has achieved impressive results in addressing complex control tasks and gaming scenarios. However, contemporary state-of-the-art algorithms within this category primarily…

Machine Learning · Computer Science 2024-05-31 Weiye Zhao , Feihan Li , Yifan Sun , Rui Chen , Tianhao Wei , Changliu Liu

We present a model-based offline reinforcement learning policy performance lower bound that explicitly captures dynamics model misspecification and distribution mismatch and we propose an empirical algorithm for optimal offline policy…

Machine Learning · Computer Science 2023-01-30 Kefan Dong , Yannis Flet-Berliac , Allen Nie , Emma Brunskill

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

We address the problem of Remote Electrical Tilt (RET) optimization using off-policy Contextual Multi-Armed-Bandit (CMAB) techniques. The goal in RET optimization is to control the orientation of the vertical tilt angle of the antenna to…

Machine Learning · Computer Science 2020-05-22 Filippo Vannella , Jaeseong Jeong , Alexandre Proutiere

Large language models are increasingly trained via reinforcement learning for personalized recommendation tasks, but standard methods like GRPO rely on sparse, sequence-level rewards. These obscure which tokens actually contribute to…

Artificial Intelligence · Computer Science 2026-05-08 Abhijnan Nath , Alireza Bagheri Garakani , Tianchen Zhou , Fan Yang , Yan Gao , Nikhil Krishnaswamy

While multimodal large language models excel at tasks that integrate visual perception with symbolic reasoning, their performance is often undermined by a critical vulnerability: perception-induced errors that propagate through the…

Multimedia · Computer Science 2025-09-29 Songjun Tu , Qichao Zhang , Jingbo Sun , Yuqian Fu , Linjing Li , Xiangyuan Lan , Dongmei Jiang , Yaowei Wang , Dongbin Zhao

Offline reinforcement learning (RL) aims to optimize a policy by using pre-collected datasets, to maximize cumulative rewards. However, offline reinforcement learning suffers challenges due to the distributional shift between the learned…

Machine Learning · Computer Science 2025-03-10 Yunkai Gao , Jiaming Guo , Fan Wu , Rui Zhang

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

Machine Learning · Computer Science 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy

Very recently proximal policy optimization (PPO) algorithms have been proposed as first-order optimization methods for effective reinforcement learning. While PPO is inspired by the same learning theory that justifies trust region policy…

Machine Learning · Computer Science 2018-04-20 Gang Chen , Yiming Peng , Mengjie Zhang

In this paper, we point out a fundamental property of the objective in reinforcement learning, with which we can reformulate the policy gradient objective into a perceptron-like loss function, removing the need to distinguish between on and…

Machine Learning · Computer Science 2019-04-25 Kai-Chun Hu , Chen-Huan Pi , Ting Han Wei , I-Chen Wu , Stone Cheng , Yi-Wei Dai , Wei-Yuan Ye

Reinforcement learning from human feedback (RLHF) is a promising solution to align large language models (LLMs) more closely with human values. Off-policy preference optimization, where the preference data is obtained from other models, is…

Computation and Language · Computer Science 2024-10-07 Wenxuan Zhou , Ravi Agrawal , Shujian Zhang , Sathish Reddy Indurthi , Sanqiang Zhao , Kaiqiang Song , Silei Xu , Chenguang Zhu

Supervised imitation-based approaches are often favored over off-policy reinforcement learning approaches for learning policies offline, since their straightforward optimization objective makes them computationally efficient and stable to…

Machine Learning · Computer Science 2025-12-30 Adam Jelley , Trevor McInroe , Sam Devlin , Amos Storkey

The off-policy paradigm casts recommendation as a counterfactual decision-making task, allowing practitioners to unbiasedly estimate online metrics using offline data. This leads to effective evaluation metrics, as well as learning…

Machine Learning · Computer Science 2024-09-17 Olivier Jeunen , Aleksei Ustimenko

On-policy reinforcement learning methods like GRPO suffer from mode collapse: they exhibit reduced solution diversity, concentrating probability mass on a single solution once discovered and ceasing exploration of alternative strategies. We…

Artificial Intelligence · Computer Science 2026-05-20 Xiaozhe Li , Yang Li , Xinyu Fang , Shengyuan Ding , Peiji Li , Yongkang Chen , Yichuan Ma , Tianyi Lyu , Linyang Li , Dahua Lin , Qipeng Guo , Qingwen Liu , Kai Chen

Soft Actor-Critic (SAC) is one of the state-of-the-art off-policy reinforcement learning (RL) algorithms that is within the maximum entropy based RL framework. SAC is demonstrated to perform very well in a list of continous control tasks…

Machine Learning · Computer Science 2021-12-22 Zhenyang Shi , Surya P. N. Singh

Learning adaptive visuomotor policies for embodied agents remains a formidable challenge, particularly when facing cross-embodiment variations such as diverse sensor configurations and dynamic properties. Conventional learning approaches…

Robotics · Computer Science 2026-02-03 Yuhang Zhang , Chao Yan , Jiaxi Yu , Jiaping Xiao , Mir Feroskhan

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy…

Machine Learning · Computer Science 2024-06-07 Yaozhong Gan , Renye Yan , Zhe Wu , Junliang Xing