中文
相关论文

相关论文: Off-Policy General Value Functions to Represent Dy…

200 篇论文

Off-policy learning refers to the problem of learning the value function of a way of behaving, or policy, while following a different policy. Gradient-based off-policy learning algorithms, such as GTD and TDC/GQ, converge even when using…

人工智能 · 计算机科学 2015-12-15 Lucas Lehnert , Doina Precup

Despite of the recent progress in agents that learn through interaction, there are several challenges in terms of sample efficiency and generalization across unseen behaviors during training. To mitigate these problems, we propose and apply…

机器学习 · 计算机科学 2019-12-10 Luckeciano C. Melo , Marcos R. O. A. Maximo , Adilson Marques da Cunha

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

Off-policy policy optimization is a challenging problem in reinforcement learning (RL). The algorithms designed for this problem often suffer from high variance in their estimators, which results in poor sample efficiency, and have issues…

机器学习 · 计算机科学 2020-09-15 Daoming Lyu , Qi Qi , Mohammad Ghavamzadeh , Hengshuai Yao , Tianbao Yang , Bo Liu

Recent advances of gradient temporal-difference methods allow to learn off-policy multiple value functions in parallel with- out sacrificing convergence guarantees or computational efficiency. This opens up new possibilities for sound…

人工智能 · 计算机科学 2014-05-22 Anna Harutyunyan , Tim Brys , Peter Vrancx , Ann Nowe

Learning to optimize - the idea that we can learn from data algorithms that optimize a numerical criterion - has recently been at the heart of a growing number of research efforts. One of the most challenging issues within this approach is…

机器学习 · 计算机科学 2018-02-21 Louis Faury , Flavian Vasile

In imitation learning, behavior learning is generally done using the features extracted from the demonstration data. Recent deep learning algorithms enable the development of machine learning methods that can get high dimensional data as an…

机器人学 · 计算机科学 2018-07-25 Okan Aşık , Binnur Görer , H. Levent Akın

A central challenge to applying many off-policy reinforcement learning algorithms to real world problems is the variance introduced by importance sampling. In off-policy learning, the agent learns about a different policy than the one being…

机器学习 · 计算机科学 2022-06-20 Eric Graves , Sina Ghiassian

This paper seeks to establish a framework for directing a society of simple, specialized, self-interested agents to solve what traditionally are posed as monolithic single-agent sequential decision problems. What makes it challenging to use…

机器学习 · 计算机科学 2020-08-17 Michael Chang , Sidhant Kaushik , S. Matthew Weinberg , Thomas L. Griffiths , Sergey Levine

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

机器学习 · 计算机科学 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

Compared to on-policy counterparts, off-policy model-free deep reinforcement learning can improve data efficiency by repeatedly using the previously gathered data. However, off-policy learning becomes challenging when the discrepancy…

机器学习 · 计算机科学 2023-09-27 Baturay Saglam , Dogan C. Cicek , Furkan B. Mutlu , Suleyman S. Kozat

Reinforcement learning has steadily improved and outperform human in lots of traditional games since the resurgence of deep neural network. However, these success is not easy to be copied to autonomous driving because the state spaces in…

计算机视觉与模式识别 · 计算机科学 2019-05-21 Sen Wang , Daoyuan Jia , Xinshuo Weng

Learning policies which are robust to changes in the environment are critical for real world deployment of Reinforcement Learning agents. They are also necessary for achieving good generalization across environment shifts. We focus on…

机器学习 · 计算机科学 2023-06-08 Anuj Mahajan , Amy Zhang

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

机器人学 · 计算机科学 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

Automating the segregation process is a need for every sector experiencing a high volume of materials handling, repetitive and exhaustive operations, in addition to risky exposures. Learning automated pick-and-place operations can be…

机器学习 · 计算机科学 2024-04-30 Hariharan Arunachalam , Marc Hanheide , Sariah Mghames

This paper investigates the problem of online prediction learning, where learning proceeds continuously as the agent interacts with an environment. The predictions made by the agent are contingent on a particular way of behaving,…

机器学习 · 计算机科学 2018-11-08 Sina Ghiassian , Andrew Patterson , Martha White , Richard S. Sutton , Adam White

In a sequential decision-making problem, off-policy evaluation estimates the expected cumulative reward of a target policy using logged trajectory data generated from a different behavior policy, without execution of the target policy.…

机器学习 · 计算机科学 2022-11-04 Jie Wang , Rui Gao , Hongyuan Zha

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

机器人学 · 计算机科学 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

Deploying reinforcement learning in the real world remains challenging due to sample inefficiency, sparse rewards, and noisy visual observations. Prior work leverages demonstrations and human feedback to improve learning efficiency and…

人工智能 · 计算机科学 2026-01-23 Xiefeng Wu , Mingyu Hu , Shu Zhang

Reinforcement learning has shown promise in learning policies that can solve complex problems. However, manually specifying a good reward function can be difficult, especially for intricate tasks. Inverse reinforcement learning offers a…

机器学习 · 计算机科学 2017-11-28 Peter Henderson , Wei-Di Chang , Pierre-Luc Bacon , David Meger , Joelle Pineau , Doina Precup