中文
相关论文

相关论文: Discovering Policies with DOMiNO: Diversity Optimi…

200 篇论文

Adapting to the changes in transition dynamics is essential in robotic applications. By learning a conditional policy with a compact context, context-aware meta-reinforcement learning provides a flexible way to adjust behavior according to…

机器学习 · 计算机科学 2022-10-11 Yao Mu , Yuzheng Zhuang , Fei Ni , Bin Wang , Jianyu Chen , Jianye Hao , Ping Luo

We present Reward-Switching Policy Optimization (RSPO), a paradigm to discover diverse strategies in complex RL environments by iteratively finding novel policies that are both locally optimal and sufficiently different from existing ones.…

机器学习 · 计算机科学 2022-05-04 Zihan Zhou , Wei Fu , Bingliang Zhang , Yi Wu

Offline reinforcement learning agents face significant deployment challenges due to the synthetic-to-real distribution mismatch. While most prior research has focused on improving the fidelity of synthetic sampling and incorporating…

机器学习 · 计算机科学 2025-10-01 Chi Zhou , Wang Luo , Haoran Li , Congying Han , Tiande Guo , Zicheng Zhang

On-policy reinforcement learning methods like GRPO suffer from mode collapse: they exhibit reduced solution diversity, concentrating probability mass on a single solution once discovered and ceasing exploration of alternative strategies. We…

A fundamental challenge in reinforcement learning is to learn policies that generalize beyond the operating domains experienced during training. In this paper, we approach this challenge through the following invariance principle: an agent…

机器学习 · 计算机科学 2020-11-10 Anoopkumar Sonar , Vincent Pacelli , Anirudha Majumdar

In order for reinforcement learning techniques to be useful in real-world decision making processes, they must be able to produce robust performance from limited data. Deep policy optimization methods have achieved impressive results on…

机器学习 · 计算机科学 2020-12-22 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient methods, which employ multiple policies to collect diverse…

机器学习 · 计算机科学 2026-03-04 Naoki Shitanda , Motoki Omura , Tatsuya Harada , Takayuki Osa

Traffic simulators are important tools in autonomous driving development. While continuous progress has been made to provide developers more options for modeling various traffic participants, tuning these models to increase their behavioral…

A policy in deep reinforcement learning (RL), either deterministic or stochastic, is commonly parameterized as a Gaussian distribution alone, limiting the learned behavior to be unimodal. However, the nature of many practical…

机器学习 · 计算机科学 2025-08-20 SM Mazharul Islam , Manfred Huber

Decision-making under distribution shift is a central challenge in reinforcement learning (RL), where training and deployment environments differ. We study this problem through the lens of robust Markov decision processes (RMDPs), which…

机器学习 · 计算机科学 2025-10-17 Jingwen Gu , Yiting He , Zhishuai Liu , Pan Xu

The policy gradient method enjoys the simplicity of the objective where the agent optimizes the cumulative reward directly. Moreover, in the continuous action domain, parameterized distribution of action distribution allows easy control of…

机器学习 · 计算机科学 2022-12-16 Md Masudur Rahman , Yexiang Xue

In complex reinforcement learning (RL) problems, policies with similar rewards may have substantially different behaviors. It remains a fundamental challenge to optimize rewards while also discovering as many diverse strategies as possible,…

机器学习 · 计算机科学 2023-10-24 Wei Fu , Weihua Du , Jingwei Li , Sunli Chen , Jingzhao Zhang , Yi Wu

In this work, we provide an extended discussion of a new approach to explainable Reinforcement Learning called Diverse Near-Optimal Alternatives (DNA), first proposed at L4DC 2025. DNA seeks a set of reasonable "options" for…

机器学习 · 计算机科学 2025-06-12 Noel Brindise , Vijeth Hebbar , Riya Shah , Cedric Langbort

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

计算与语言 · 计算机科学 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

Solving tasks in Reinforcement Learning is no easy feat. As the goal of the agent is to maximize the accumulated reward, it often learns to exploit loopholes and misspecifications in the reward signal resulting in unwanted behavior. While…

机器学习 · 计算机科学 2018-12-27 Chen Tessler , Daniel J. Mankowitz , Shie Mannor

In reinforcement learning, agents often learn policies for specific tasks without the ability to generalize this knowledge to related tasks. This paper introduces an algorithm that attempts to address this limitation by decomposing neural…

机器学习 · 计算机科学 2024-10-16 Mahdi Alikhasi , Levi H. S. Lelis

In this paper we design hybrid control policies for hybrid systems whose mathematical models are unknown. Our contributions are threefold. First, we propose a framework for modelling the hybrid control design problem as a single Markov…

系统与控制 · 电气工程与系统科学 2020-09-03 Meet Gandhi , Atreyee Kundu , Shalabh Bhatnagar

In neural combinatorial optimization (CO), reinforcement learning (RL) can turn a deep neural net into a fast, powerful heuristic solver of NP-hard problems. This approach has a great potential in practical applications because it allows…

机器学习 · 计算机科学 2021-07-14 Yeong-Dae Kwon , Jinho Choo , Byoungjip Kim , Iljoo Yoon , Youngjune Gwon , Seungjai Min

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

神经与进化计算 · 计算机科学 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

机器学习 · 计算机科学 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters