中文
相关论文

相关论文: Beware of Instantaneous Dependence in Reinforcemen…

200 篇论文

In Europe, profit-seeking balance responsible parties can deviate in real time from their day-ahead nominations to assist transmission system operators in maintaining the supply-demand balance. Model predictive control (MPC) strategies to…

系统与控制 · 电气工程与系统科学 2025-10-07 Seyed Soroush Karimi Madahi , Kenneth Bruninx , Bert Claessens , Chris Develder

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

机器学习 · 计算机科学 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

We study the problem of off-policy value evaluation in reinforcement learning (RL), where one aims to estimate the value of a new policy based on data collected by a different policy. This problem is often a critical step when applying RL…

机器学习 · 计算机科学 2016-05-27 Nan Jiang , Lihong Li

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

机器学习 · 计算机科学 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

Model-free reinforcement learning (RL) is a powerful approach for learning control policies directly from high-dimensional state and observation. However, it tends to be data-inefficient, which is especially costly in robotic learning…

机器人学 · 计算机科学 2020-10-14 Xubo Lyu , Mo Chen

The learned policy of model-free offline reinforcement learning (RL) methods is often constrained to stay within the support of datasets to avoid possible dangerous out-of-distribution actions or states, making it challenging to handle…

机器学习 · 计算机科学 2022-10-11 Jiafei Lyu , Xiu Li , Zongqing Lu

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the…

系统与控制 · 电气工程与系统科学 2024-09-21 Yixuan Sun , Sami Khairy , Richard B. Vilim , Rui Hu , Akshay J. Dave

Traditionally, reinforcement learning methods predict the next action based on the current state. However, in many situations, directly applying actions to control systems or robots is dangerous and may lead to unexpected behaviors because…

机器人学 · 计算机科学 2020-11-03 Nan Lin , Yuxuan Li , Yujun Zhu , Ruolin Wang , Xiayu Zhang , Jianmin Ji , Keke Tang , Xiaoping Chen , Xinming Zhang

Many real-world applications require an agent to make robust and deliberate decisions with multimodal information (e.g., robots with multi-sensory inputs). However, it is very challenging to train the agent via reinforcement learning (RL)…

机器学习 · 计算机科学 2023-02-21 Jinming Ma , Feng Wu , Yingfeng Chen , Xianpeng Ji , Yu Ding

Model-free reinforcement learning (RL) is a powerful, general tool for learning complex behaviors. However, its sample efficiency is often impractically large for solving challenging real-world problems, even with off-policy algorithms such…

机器学习 · 计算机科学 2020-02-25 Vitchyr Pong , Shixiang Gu , Murtaza Dalal , Sergey Levine

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

人工智能 · 计算机科学 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

机器学习 · 计算机科学 2026-02-23 Daqian Shao

Reinforcement learning (RL) has produced spectacular results in games, robotics, and continuous control. Yet, despite these successes, learned policies often fail to generalize beyond their training distribution, limiting real-world impact.…

机器学习 · 计算机科学 2026-04-06 André Biedenkapp

Agents trained via deep reinforcement learning (RL) routinely fail to generalize to unseen environments, even when these share the same underlying dynamics as the training levels. Understanding the generalization properties of RL is one of…

机器学习 · 计算机科学 2020-11-03 Martin Bertran , Natalia Martinez , Mariano Phielipp , Guillermo Sapiro

The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are…

机器学习 · 计算机科学 2020-09-11 Marcin Szulc , Jakub Łyskawa , Paweł Wawrzyński

We study Reinforcement Learning (RL) in environments with large state spaces, where function approximation is required for sample-efficient learning. Departing from a long history of prior work, we consider the weakest possible form of…

机器学习 · 计算机科学 2025-04-09 Akshay Krishnamurthy , Gene Li , Ayush Sekhari

Real-time inference is a challenge of real-world reinforcement learning due to temporal differences in time-varying environments: the system collects data from the past, updates the decision model in the present, and deploys it in the…

机器学习 · 计算机科学 2024-05-28 Hyunin Lee , Ming Jin , Javad Lavaei , Somayeh Sojoudi

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

机器学习 · 计算机科学 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

Standard model-based reinforcement learning (MBRL) approaches fit a transition model of the environment to all past experience, but this wastes model capacity on data that is irrelevant for policy improvement. We instead propose a new…

机器学习 · 计算机科学 2023-05-23 Yecheng Jason Ma , Kausik Sivakumar , Jason Yan , Osbert Bastani , Dinesh Jayaraman

Traditionally, Reinforcement Learning (RL) aims at deciding how to act optimally for an artificial agent. We argue that deciding when to act is equally important. As humans, we drift from default, instinctive or memorized behaviors to…

机器学习 · 计算机科学 2022-03-17 Alexis Jacq , Johan Ferret , Olivier Pietquin , Matthieu Geist