中文
相关论文

相关论文: Eval-PPO: Building an Efficient Threat Evaluator U…

200 篇论文

Constrained Reinforcement Learning (RL) aims to maximize the return while adhering to predefined constraint limits, which represent domain-specific safety requirements. In continuous control settings, where learning agents govern system…

机器学习 · 计算机科学 2025-09-12 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

This paper addresses the challenge of edge caching in dynamic environments, where rising traffic loads strain backhaul links and core networks. We propose a Proximal Policy Optimization (PPO)-based caching strategy that fully incorporates…

网络与互联网体系结构 · 计算机科学 2024-11-18 Farnaz Niknia , Ping Wang

Reinforcement Learning (RL) for constrained MDPs (CMDPs) is an increasingly important problem for various applications. Often, the average criterion is more suitable than the discounted criterion. Yet, RL for average-CMDPs (ACMDPs) remains…

机器学习 · 计算机科学 2024-05-27 Akhil Agnihotri , Rahul Jain , Haipeng Luo

Safe reinforcement learning (RL) is crucial for deploying RL agents in real-world applications, as it aims to maximize long-term rewards while satisfying safety constraints. However, safe RL often suffers from sample inefficiency, requiring…

机器学习 · 计算机科学 2024-06-03 Shangding Gu , Laixi Shi , Yuhao Ding , Alois Knoll , Costas Spanos , Adam Wierman , Ming Jin

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

机器人学 · 计算机科学 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

Neural Network based approximations of the Value function make up the core of leading Policy Based methods such as Trust Regional Policy Optimization (TRPO) and Proximal Policy Optimization (PPO). While this adds significant value when…

机器学习 · 计算机科学 2024-06-03 Hari Srikanth

Large language models (LLMs) trained with reinforcement objectives often achieve superficially correct answers via shortcut strategies, pairing correct outputs with spurious or unfaithful reasoning and degrading under small causal…

机器学习 · 计算机科学 2025-09-30 Xiangqi Wang , Yue Huang , Yujun Zhou , Xiaonan Luo , Kehan Guo , Xiangliang Zhang

Classical reinforcement learning (RL) aims to optimize the expected cumulative reward. In this work, we consider the RL setting where the goal is to optimize the quantile of the cumulative reward. We parameterize the policy controlling…

机器学习 · 计算机科学 2023-05-15 Jinyang Jiang , Jiaqiao Hu , Yijie Peng

The alignment of language models with human preferences is vital for their application in real-world tasks. The problem is formulated as optimizing the model's policy to maximize the expected reward that reflects human preferences with…

计算与语言 · 计算机科学 2024-06-06 Haozhe Ji , Cheng Lu , Yilin Niu , Pei Ke , Hongning Wang , Jun Zhu , Jie Tang , Minlie Huang

In Constrained Reinforcement Learning (CRL), agents explore the environment to learn the optimal policy while satisfying constraints. The penalty function method has recently been studied as an effective approach for handling constraints,…

机器学习 · 计算机科学 2024-07-23 Shiqing Gao , Jiaxin Ding , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Single-trajectory reinforcement learning (RL) methods aim to optimize policies from datasets consisting of (prompt, response, reward) triplets, where scalar rewards are directly available. This supervision format is highly practical, as it…

机器学习 · 计算机科学 2025-12-23 Bilal Faye , Hanane Azzag , Mustapha Lebbah

Multi-agent reinforcement learning (MARL) is increasingly used to design learning-enabled agents that interact in shared environments. However, training MARL algorithms in general-sum games remains challenging: learning dynamics can become…

机器学习 · 计算机科学 2026-04-07 Addison Kalanther , Sanika Bharvirkar , Shankar Sastry , Chinmay Maheshwari

The performance of modern reinforcement learning algorithms critically relies on tuning ever-increasing numbers of hyperparameters. Often, small changes in a hyperparameter can lead to drastic changes in performance, and different…

机器学习 · 计算机科学 2025-02-05 Jacob Adkins , Michael Bowling , Adam White

Deep learning models, even the-state-of-the-art ones, are highly vulnerable to adversarial examples. Adversarial training is one of the most efficient methods to improve the model's robustness. The key factor for the success of adversarial…

机器学习 · 计算机科学 2023-06-05 Anh Bui , Trung Le , He Zhao , Quan Tran , Paul Montague , Dinh Phung

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

机器学习 · 计算机科学 2025-05-12 Bernhard Jaeger , Andreas Geiger

This paper introduces a novel agent-based approach for enhancing existing portfolio strategies using Proximal Policy Optimization (PPO). Rather than focusing solely on traditional portfolio construction, our approach aims to improve an…

投资组合管理 · 定量金融 2025-02-06 Daniil Karzanov , Rubén Garzón , Mikhail Terekhov , Caglar Gulcehre , Thomas Raffinot , Marcin Detyniecki

This paper presents a comparison between two well-known deep Reinforcement Learning (RL) algorithms: Deep Q-Learning (DQN) and Proximal Policy Optimization (PPO) in a simulated production system. We utilize a Petri Net (PN)-based simulation…

人工智能 · 计算机科学 2023-06-05 Reuf Kozlica , Stefan Wegenkittl , Simon Hirländer

We present a reinforcement learning method for training neuro-fuzzy controllers using Proximal Policy Optimization (PPO). Unlike prior approaches that used Deep Q-Networks (DQN) with Adaptive Neuro-Fuzzy Inference Systems (ANFIS), our…

机器学习 · 计算机科学 2025-07-08 Kaaustaaub Shankar , Wilhelm Louw , Kelly Cohen

Optimizing the fuel cycle cost through the optimization of nuclear reactor core loading patterns involves multiple objectives and constraints, leading to a vast number of candidate solutions that cannot be explicitly solved. To advance the…

神经与进化计算 · 计算机科学 2024-07-16 Paul Seurin , Koroush Shirvan

Group Relative Policy Optimization (GRPO) has shown promise in discrete action spaces by eliminating value function dependencies through group-based advantage estimation. However, its application to continuous control remains unexplored,…

机器人学 · 计算机科学 2025-07-29 Rajat Khanda , Mohammad Baqar , Sambuddha Chakrabarti , Satyasaran Changdar