中文
相关论文

相关论文: S$^2$AC: Energy-Based Reinforcement Learning with …

200 篇论文

We study robust reinforcement learning (RL) with the goal of determining a well-performing policy that is robust against model mismatch between the training simulator and the testing environment. Previous policy-based robust RL algorithms…

机器学习 · 计算机科学 2023-12-12 Ruida Zhou , Tao Liu , Min Cheng , Dileep Kalathil , P. R. Kumar , Chao Tian

The ability to discover approximately optimal policies in domains with sparse rewards is crucial to applying reinforcement learning (RL) in many real-world scenarios. Approaches such as neural density models and continuous exploration…

机器学习 · 计算机科学 2019-09-25 Bogdan Mazoure , Thang Doan , Audrey Durand , R Devon Hjelm , Joelle Pineau

Soft Actor Critic (SAC) algorithms show remarkable performance in complex simulated environments. A key element of SAC networks is entropy regularization, which prevents the SAC actor from optimizing against fine grained features,…

机器学习 · 计算机科学 2020-06-23 Miguel Campo , Zhengxing Chen , Luke Kung , Kittipat Virochsiri , Jianyu Wang

Most prior approaches to offline reinforcement learning (RL) utilize \textit{behavior regularization}, typically augmenting existing off-policy actor critic algorithms with a penalty measuring divergence between the policy and the offline…

机器学习 · 计算机科学 2021-10-15 Haoran Xu , Xianyuan Zhan , Jianxiong Li , Honglei Yin

Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample…

机器人学 · 计算机科学 2025-09-08 Zhihao Zhang , Chengyang Peng , Ekim Yurtsever , Keith A. Redmill

Quantum optimal control in the presence of decoherence is difficult, particularly when not all Hamiltonian parameters are known precisely, as in quantum sensing applications. In this context, maximizing the sensitivity of the system is the…

量子物理 · 物理学 2026-01-19 Logan W. Cooke , Stefanie Czischek

We propose a new algorithm, Mean Actor-Critic (MAC), for discrete-action continuous-state reinforcement learning. MAC is a policy gradient algorithm that uses the agent's explicit representation of all action values to estimate the gradient…

Reinforcement Learning (RL) is a powerful framework to address the discrepancy between loss functions used during training and the final evaluation metrics to be used at test time. When applied to neural Machine Translation (MT), it…

计算与语言 · 计算机科学 2021-02-24 Julia Ive , Zixu Wang , Marina Fomicheva , Lucia Specia

Deep reinforcement learning (RL) has achieved remarkable success, yet its deployment in real-world scenarios is often limited by vulnerability to environmental uncertainties. Distributionally robust RL (DR-RL) algorithms have been proposed…

机器学习 · 计算机科学 2026-04-21 Mingxuan Cui , Duo Zhou , Yuxuan Han , Grani A. Hanasusanto , Qiong Wang , Huan Zhang , Zhengyuan Zhou

Discrete reinforcement learning (RL) algorithms have demonstrated exceptional performance in solving sequential decision tasks with discrete action spaces, such as Atari games. However, their effectiveness is hindered when applied to…

机器学习 · 计算机科学 2023-08-22 Yechen Zhang , Jian Sun , Gang Wang , Zhuo Li , Wei Chen

Spiking neural networks (SNNs) and biologically-inspired learning mechanisms are attractive in mobile robotics, where the size and performance of onboard neural network policies are constrained by power and computational budgets. Existing…

多智能体系统 · 计算机科学 2026-03-18 Ugur Akcal , Seung Hyun Kim , Mikihisa Yuasa , Hamid Osooli , Jiarui Sun , Ribhav Sahu , Mattia Gazzola , Huy T. Tran , Girish Chowdhary

Actor-critic algorithms address the dual goals of reinforcement learning (RL), policy evaluation and improvement via two separate function approximators. The practicality of this approach comes at the expense of training instability, caused…

机器学习 · 计算机科学 2024-06-11 Bahareh Tasdighi , Abdullah Akgül , Manuel Haussmann , Kenny Kazimirzak Brink , Melih Kandemir

Reinforcement learning for control over continuous spaces typically uses high-entropy stochastic policies, such as Gaussian distributions, for local exploration and estimating policy gradient to optimize performance. Many robotic control…

机器学习 · 计算机科学 2024-04-03 Ya-Chien Chang , Sicun Gao

Many policy gradient methods are variants of Actor-Critic (AC), where a value function (critic) is learned to facilitate updating the parameterized policy (actor). The update to the actor involves a log-likelihood update weighted by the…

机器学习 · 计算机科学 2023-03-02 Samuel Neumann , Sungsu Lim , Ajin Joseph , Yangchen Pan , Adam White , Martha White

While reinforcement learning has shown experimental success in a number of applications, it is known to be sensitive to noise and perturbations in the parameters of the system, leading to high variance in the total reward amongst different…

系统与控制 · 电气工程与系统科学 2024-12-02 Erfaun Noorani , Christos Mavridis , John Baras

We develop a deep reinforcement learning (RL) framework for an optimal market-making (MM) trading problem, specifically focusing on price processes with semi-Markov and Hawkes Jump-Diffusion dynamics. We begin by discussing the basics of RL…

计算金融 · 定量金融 2025-03-03 Luca Lalor , Anatoliy Swishchuk

Load serving entities with storage units reach sizes and performances that can significantly impact clearing prices in electricity markets. Nevertheless, price endogeneity is rarely considered in storage bidding strategies and modeling the…

系统与控制 · 电气工程与系统科学 2021-06-07 Mathilde D. Badoual , Scott J. Moura

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

人工智能 · 计算机科学 2023-03-09 Qin Yang , Ramviyas Parasuraman

Off-policy reinforcement learning (RL) is concerned with learning a rewarding policy by executing another policy that gathers samples of experience. While the former policy (i.e. target policy) is rewarding but in-expressive (in most cases,…

机器学习 · 计算机科学 2020-03-02 Anji Liu , Yitao Liang , Guy Van den Broeck

Policy-gradient methods in Reinforcement Learning(RL) are very universal and widely applied in practice but their performance suffers from the high variance of the gradient estimate. Several procedures were proposed to reduce it including…

机器学习 · 计算机科学 2022-06-16 Maxim Kaledin , Alexander Golubev , Denis Belomestny