中文
相关论文

相关论文: Soft policy optimization using dual-track advantag…

200 篇论文

Conventional Reinforcement Learning (RL) algorithms usually have one single agent learning to solve the task independently. As a result, the agent can only explore a limited part of the state-action space while the learned behavior is…

机器学习 · 计算机科学 2020-06-16 Zhenghao Peng , Hao Sun , Bolei Zhou

Direct Preference Optimization (DPO) has gained attention as an efficient alternative to reinforcement learning from human feedback (RLHF) for aligning large language models (LLMs) with human preferences. Despite its advantages, DPO suffers…

计算与语言 · 计算机科学 2025-02-21 Ruichen Shao , Bei Li , Gangao Liu , Yang Chen , Xiang Zhou , Jingang Wang , Xunliang Cai , Peng Li

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

机器人学 · 计算机科学 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

Off-policy learning allows us to learn about possible policies of behavior from experience generated by a different behavior policy. Temporal difference (TD) learning algorithms can become unstable when combined with function approximation…

机器学习 · 计算机科学 2021-06-23 Ray Jiang , Tom Zahavy , Zhongwen Xu , Adam White , Matteo Hessel , Charles Blundell , Hado van Hasselt

Continuous trajectory tracking control of quadrotors is complicated when considering noise from the environment. Due to the difficulty in modeling the environmental dynamics, tracking methodologies based on conventional control theory, such…

机器人学 · 计算机科学 2023-02-14 Boyuan Deng , Jian Sun , Zhuo Li , Gang Wang

This research focuses on enhancing reinforcement learning (RL) algorithms by integrating penalty functions to guide agents in avoiding unwanted actions while optimizing rewards. The goal is to improve the learning process by ensuring that…

机器学习 · 计算机科学 2025-04-07 Sai Gana Sandeep Pula , Sathish A. P. Kumar , Sumit Jha , Arvind Ramanathan

Jumping constitutes an essential component of quadruped robots' locomotion capabilities, which includes dynamic take-off and adaptive landing. Existing quadrupedal jumping studies mainly focused on the stance and flight phase by assuming a…

机器人学 · 计算机科学 2025-09-17 Renjie Wang , Shangke Lyu , Xin Lang , Wei Xiao , Donglin Wang

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new…

机器学习 · 计算机科学 2017-07-25 Tuomas Haarnoja , Haoran Tang , Pieter Abbeel , Sergey Levine

Training agents via off-policy deep reinforcement learning (RL) requires a large memory, named replay memory, that stores past experiences used for learning. These experiences are sampled, uniformly or non-uniformly, to create the batches…

机器学习 · 计算机科学 2022-12-27 Bumgeun Park , Taeyoung Kim , Woohyeon Moon , Luiz Felipe Vecchietti , Dongsoo Har

Reinforcement learning with sparse rewards is challenging because an agent can rarely obtain non-zero rewards and hence, gradient-based optimization of parameterized policies can be incremental and slow. Recent work demonstrated that using…

机器学习 · 计算机科学 2021-02-16 Yijie Guo , Jongwook Choi , Marcin Moczulski , Shengyu Feng , Samy Bengio , Mohammad Norouzi , Honglak Lee

Maximum entropy reinforcement learning integrates exploration into policy learning by providing additional intrinsic rewards proportional to the entropy of some distribution. In this paper, we propose a novel approach in which the intrinsic…

机器学习 · 计算机科学 2025-09-30 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

This paper studies satisfaction of temporal properties on unknown stochastic processes that have continuous state spaces. We show how reinforcement learning (RL) can be applied for computing policies that are finite-memory and deterministic…

系统与控制 · 电气工程与系统科学 2020-09-29 Milad Kazemi , Sadegh Soudjani

In this paper, we investigate a novel digital network twin (DNT) assisted deep learning (DL) model training framework. In particular, we consider a physical network where a base station (BS) uses several antennas to serve multiple mobile…

网络与互联网体系结构 · 计算机科学 2026-03-11 Hanzhi Yu , Hasan Farooq , Julien Forgeat , Shruti Bothe , Kristijonas Cyras , Md Moin Uddin Chowdhury , Mingzhe Chen

Recently, reinforcement learning (RL) has become a common choice in enhancing the reasoning capabilities of vision-language models (VLMs). Considering existing RL-based finetuning methods, entropy intervention turns out to be an effective…

人工智能 · 计算机科学 2025-12-13 Yang Yu , Zhuangzhuang Chen , Siqi Wang , Lanqing Li , Xiaomeng Li

In many real-world reinforcement learning applications, access to the environment is limited to a fixed dataset, instead of direct (online) interaction with the environment. When using this data for either evaluation or training of a new…

机器学习 · 计算机科学 2019-11-06 Ofir Nachum , Yinlam Chow , Bo Dai , Lihong Li

The goal of this paper is to study a distributed version of the gradient temporal-difference (GTD) learning algorithm for multi-agent Markov decision processes (MDPs). The temporal difference (TD) learning is a reinforcement learning (RL)…

最优化与控制 · 数学 2018-08-23 Donghwan Lee , Hyungjin Yoon , Naira Hovakimyan

Dynamic real-time optimization (DRTO) is a challenging task due to the fact that optimal operating conditions must be computed in real time. The main bottleneck in the industrial application of DRTO is the presence of uncertainty. Many…

We present a novel reinforcement learning (RL) environment designed to both optimize industrial sorting systems and study agent behavior in evolving spaces. In simulating material flow within a sorting process our environment follows the…

机器学习 · 计算机科学 2025-03-14 Tom Maus , Nico Zengeler , Tobias Glasmachers

Generalized Advantage Estimation (GAE) has been used to mitigate the computational complexity of reinforcement learning (RL) by employing an exponentially weighted estimation of the advantage function to reduce the variance in policy…

机器学习 · 计算机科学 2025-07-24 Shahil Shaik , Jonathon M. Smereka , Yue Wang

Being able to solve a task in diverse ways makes agents more robust to task variations and less prone to local optima. In this context, constrained diversity optimization has become a useful reinforcement learning (RL) framework for…

机器学习 · 计算机科学 2026-05-13 Cornelius V. Braun , Sayantan Auddy , Marc Toussaint