English
Related papers

Related papers: Constrained Policy Optimization for Provably Fair …

200 papers

Constrained Markov Decision Process (CMDP) is a natural framework for reinforcement learning tasks with safety constraints, where agents learn a policy that maximizes the long-term reward while satisfying the constraints on the long-term…

Artificial Intelligence · Computer Science 2018-02-20 Qingkai Liang , Fanyu Que , Eytan Modiano

Central Force Optimization (CFO) is a new nature-inspired deterministic multi-dimensional search and optimization metaheuristic based on the metaphor of gravitational kinematics. CFO is applied to the PBM antenna benchmark suite and the…

Other Computer Science · Computer Science 2010-03-02 Richard A. Formato

Large Language Models (LLMs) are increasingly embedded in enterprise workflows, yet their performance remains highly sensitive to prompt design. Automatic Prompt Optimization (APO) seeks to mitigate this instability, but existing approaches…

Artificial Intelligence · Computer Science 2026-02-03 Wei Chen , Yanbin Fang , Shuran Fu , Fasheng Xu , Xuan Wei

Large language models (LLMs) trained with reinforcement objectives often achieve superficially correct answers via shortcut strategies, pairing correct outputs with spurious or unfaithful reasoning and degrading under small causal…

Machine Learning · Computer Science 2025-09-30 Xiangqi Wang , Yue Huang , Yujun Zhou , Xiaonan Luo , Kehan Guo , Xiangliang Zhang

Safety is a fundamental challenge in reinforcement learning (RL), particularly in real-world applications such as autonomous driving, robotics, and healthcare. To address this, Constrained Markov Decision Processes (CMDPs) are commonly used…

Machine Learning · Computer Science 2026-02-18 Chang Liu , Yunfan Li , Lin F. Yang

Among on-policy reinforcement learning algorithms, Proximal Policy Optimization (PPO) demonstrates is widely favored for its simplicity, numerical stability, and strong empirical performance. Standard PPO relies on surrogate objectives…

Machine Learning · Computer Science 2026-02-03 Shunpeng Yang , Ben Liu , Hua Chen

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

Robotics · Computer Science 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

We introduce the Value-at-Risk Constrained Policy Optimization algorithm (VaR-CPO), a sample efficient and conservative method designed to optimize Value-at-Risk (VaR) constrained reinforcement learning (RL) problems. Empirically, we…

Machine Learning · Computer Science 2026-05-01 Rohan Tangri , Jan-Peter Calliess

In this paper, we show how a simulated Markov decision process (MDP) built by the so-called \emph{baseline} policies, can be used to compute a different policy, namely the \emph{simulated optimal} policy, for which the performance of this…

Optimization and Control · Mathematics 2014-10-13 Yinlam Chow , Mohammad Ghavamzadeh

Finding optimal policies for Partially Observable Markov Decision Processes (POMDPs) is challenging due to their uncountable state spaces when transformed into fully observable Markov Decision Processes (MDPs) using belief states.…

Optimization and Control · Mathematics 2024-09-09 Yunus Emre Demirci , Ali Devran Kara , Serdar Yüksel

In Constrained Reinforcement Learning (CRL), agents explore the environment to learn the optimal policy while satisfying constraints. The penalty function method has recently been studied as an effective approach for handling constraints,…

Machine Learning · Computer Science 2024-07-23 Shiqing Gao , Jiaxin Ding , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Training and deploying machine learning models that meet fairness criteria for protected groups are fundamental in modern artificial intelligence. While numerous constraints and regularization terms have been proposed in the literature to…

Machine Learning · Computer Science 2024-04-09 Sina Baharlouei , Shivam Patel , Meisam Razaviyayn

As large language model agents tackle increasingly complex long-horizon tasks, effective post-training becomes critical. Prior work faces fundamental challenges: outcome-only rewards fail to precisely attribute credit to intermediate steps,…

Computation and Language · Computer Science 2026-04-30 Mukai Li , Qingcheng Zeng , Tianqing Fang , Zhenwen Liang , Linfeng Song , Qi Liu , Haitao Mi , Dong Yu

Proximal policy optimization (PPO) approximates the trust region update using multiple epochs of clipped SGD. Each epoch may drift further from the natural gradient direction, creating path-dependent noise. To understand this drift, we can…

Machine Learning · Computer Science 2026-03-16 Zelal Su , Mustafaoglu , Sungyoung Lee , Eshan Balachandar , Risto Miikkulainen , Keshav Pingali

While Group Relative Policy Optimization (GRPO) has emerged as a scalable framework for critic-free policy learning, extending it to settings with explicit behavioral constraints remains underexplored. We introduce Constrained GRPO, a…

Machine Learning · Computer Science 2026-02-09 Roger Girgis , Rodrigue de Schaetzen , Luke Rowe , Azalée Robitaille , Christopher Pal , Liam Paull

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

Machine Learning · Computer Science 2020-06-16 Jun Song , Chaoyue Zhao

We propose a successive convex approximation based off-policy optimization (SCAOPO) algorithm to solve the general constrained reinforcement learning problem, which is formulated as a constrained Markov decision process (CMDP) in the…

Machine Learning · Computer Science 2022-04-20 Chang Tian , An Liu , Guang Huang , Wu Luo

A core challenge in policy optimization in competitive Markov decision processes is the design of efficient optimization methods with desirable convergence and stability properties. To tackle this, we propose competitive policy optimization…

Machine Learning · Computer Science 2020-06-19 Manish Prajapat , Kamyar Azizzadenesheli , Alexander Liniger , Yisong Yue , Anima Anandkumar

Solving tasks in Reinforcement Learning is no easy feat. As the goal of the agent is to maximize the accumulated reward, it often learns to exploit loopholes and misspecifications in the reward signal resulting in unwanted behavior. While…

Machine Learning · Computer Science 2018-12-27 Chen Tessler , Daniel J. Mankowitz , Shie Mannor

The alignment of Large Language Models (LLMs) is crucial for ensuring their safety and reliability in practical applications. Direct Preference Optimization (DPO) has emerged as an efficient method that directly optimizes models using…

Computation and Language · Computer Science 2025-10-30 Jie Sun , Junkang Wu , Jiancan Wu , Zhibo Zhu , Xingyu Lu , Jun Zhou , Lintao Ma , Xiang Wang