中文
相关论文

相关论文: Double Meta-Learning for Data Efficient Policy Opt…

200 篇论文

Deep reinforcement learning algorithms require large amounts of experience to learn an individual task. While in principle meta-reinforcement learning (meta-RL) algorithms enable agents to learn new skills from small amounts of experience,…

机器学习 · 计算机科学 2019-03-21 Kate Rakelly , Aurick Zhou , Deirdre Quillen , Chelsea Finn , Sergey Levine

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

机器学习 · 计算机科学 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…

机器学习 · 计算机科学 2020-06-16 Yuda Song , Aditi Mavalankar , Wen Sun , Sicun Gao

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

机器学习 · 计算机科学 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Meta-reinforcement learning algorithms can enable robots to acquire new skills much more quickly, by leveraging prior experience to learn how to learn. However, much of the current research on meta-reinforcement learning focuses on task…

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning…

机器学习 · 计算机科学 2021-02-17 Qi Wang , Herke van Hoof

Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the context of reinforcement learning, meta-learning algorithms acquire reinforcement learning procedures to solve new problems more efficiently by…

机器学习 · 计算机科学 2020-05-01 Abhishek Gupta , Benjamin Eysenbach , Chelsea Finn , Sergey Levine

Meta-reinforcement learning (meta-RL) algorithms enable agents to adapt quickly to tasks from few samples in dynamic environments. Such a feat is achieved through dynamic representations in an agent's policy network (obtained via reasoning…

神经与进化计算 · 计算机科学 2022-04-27 Eseoghene Ben-Iwhiwhu , Jeffery Dick , Nicholas A. Ketz , Praveen K. Pilly , Andrea Soltoggio

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model-free methods. Unfortunately, the sample…

机器学习 · 计算机科学 2021-07-20 Aske Plaat , Walter Kosters , Mike Preuss

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

机器学习 · 计算机科学 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

The process of robot design is a complex task and the majority of design decisions are still based on human intuition or tedious manual tuning. A more informed way of facing this task is computational design methods where design parameters…

机器人学 · 计算机科学 2022-10-07 Álvaro Belmonte-Baeza , Joonho Lee , Giorgio Valsecchi , Marco Hutter

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

机器学习 · 计算机科学 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Meta-gradient methods (Xu et al., 2018; Zahavy et al., 2020) offer a promising solution to the problem of hyperparameter selection and adaptation in non-stationary reinforcement learning problems. However, the properties of meta-gradients…

机器学习 · 计算机科学 2022-09-14 Jelena Luketina , Sebastian Flennerhag , Yannick Schroecker , David Abel , Tom Zahavy , Satinder Singh

Rather than learning new control policies for each new task, it is possible, when tasks share some structure, to compose a "meta-policy" from previously learned policies. This paper reports results from experiments using Deep Reinforcement…

人工智能 · 计算机科学 2017-11-07 Richard Liaw , Sanjay Krishnan , Animesh Garg , Daniel Crankshaw , Joseph E. Gonzalez , Ken Goldberg

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

In this work, we propose three efficient restart paradigms for model-free non-stationary reinforcement learning (RL). We identify two core issues with the restart design of Mao et al. (2022)'s RestartQ-UCB algorithm: (1) complete…

机器学习 · 计算机科学 2025-10-15 Hiroshi Nonaka , Simon Ambrozak , Sofia R. Miskala-Dinc , Amedeo Ercole , Aviva Prins

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

机器学习 · 计算机科学 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

机器人学 · 计算机科学 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

机器学习 · 计算机科学 2023-04-04 Marc Rigter

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

系统与控制 · 电气工程与系统科学 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson