中文
相关论文

相关论文: Meta Reinforcement Learning with Distribution of E…

200 篇论文

Reinforcement learning techniques achieved human-level performance in several tasks in the last decade. However, in recent years, the need for interpretability emerged: we want to be able to understand how a system works and the reasons…

机器学习 · 计算机科学 2023-01-13 Leonardo Lucio Custode , Giovanni Iacca

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

机器学习 · 计算机科学 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma

Meta-learning models, or models that learn to learn, have been a long-desired target for their ability to quickly solve new tasks. Traditional meta-learning methods can require expensive inner and outer loops, thus there is demand for…

神经与进化计算 · 计算机科学 2021-03-12 Kevin Frans , Olaf Witkowski

Credit assignment in Meta-reinforcement learning (Meta-RL) is still poorly understood. Existing methods either neglect credit assignment to pre-adaptation behavior or implement it naively. This leads to poor sample-efficiency during…

机器学习 · 计算机科学 2022-02-14 Jonas Rothfuss , Dennis Lee , Ignasi Clavera , Tamim Asfour , Pieter Abbeel

Evolution Strategy (ES) algorithms have shown promising results in training complex robotic control policies due to their massive parallelism capability, simple implementation, effective parameter-space exploration, and fast training time.…

机器人学 · 计算机科学 2022-07-28 Kuang-Huei Lee , Ofir Nachum , Tingnan Zhang , Sergio Guadarrama , Jie Tan , Wenhao Yu

Large language models increasingly require structured inference, from JSON schema enforcement to multi-lingual parsing, where outputs must satisfy complex constraints. We introduce MetaJuLS, a meta-reinforcement learning approach that…

计算与语言 · 计算机科学 2026-01-27 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Model-free deep reinforcement learning algorithms have been shown to be capable of learning a wide range of robotic skills, but typically require a very large number of samples to achieve good performance. Model-based algorithms, in…

机器学习 · 计算机科学 2017-12-05 Anusha Nagabandi , Gregory Kahn , Ronald S. Fearing , Sergey Levine

Portfolio optimization involves determining the optimal allocation of portfolio assets in order to maximize a given investment objective. Traditionally, some form of mean-variance optimization is used with the aim of maximizing returns…

Reinforcement learning (RL) algorithms have demonstrated promising results on complex tasks, yet often require impractical numbers of samples since they learn from scratch. Meta-RL aims to address this challenge by leveraging experience…

机器学习 · 计算机科学 2020-10-28 Russell Mendonca , Abhishek Gupta , Rosen Kralev , Pieter Abbeel , Sergey Levine , Chelsea Finn

This paper proposes a novel deep reinforcement learning architecture that was inspired by previous tree structured architectures which were only useable in discrete action spaces. Policy Prediction Network offers a way to improve sample…

机器学习 · 计算机科学 2019-09-18 Zac Wellmer , James Kwok

This work explores learning agent-agnostic synthetic environments (SEs) for Reinforcement Learning. SEs act as a proxy for target environments and allow agents to be trained more efficiently than when directly trained on the target…

机器学习 · 计算机科学 2021-02-09 Fabio Ferreira , Thomas Nierhoff , Frank Hutter

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

机器学习 · 计算机科学 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

Designing evolutionary algorithms capable of uncovering highly evolvable representations is an open challenge; such evolvability is important because it accelerates evolution and enables fast adaptation to changing circumstances. This paper…

神经与进化计算 · 计算机科学 2019-07-16 Alexander Gajewski , Jeff Clune , Kenneth O. Stanley , Joel Lehman

Evolution Strategies (ES) are stochastic derivative-free optimization algorithms whose most prominent representative, the CMA-ES algorithm, is widely used to solve difficult numerical optimization problems. We provide the first rigorous…

最优化与控制 · 数学 2022-10-25 Cheikh Touré , Anne Auger , Nikolaus Hansen

Many real-world domains are subject to a structured non-stationarity which affects the agent's goals and the environmental dynamics. Meta-reinforcement learning (RL) has been shown successful for training agents that quickly adapt to…

机器学习 · 计算机科学 2021-05-20 Riccardo Poiani , Andrea Tirinzoni , Marcello Restelli

Studies have shown evolution strategies (ES) to be a promising approach for reinforcement learning (RL) with deep neural networks. However, the issue of high sample complexity persists in applications of ES to deep RL over long horizons.…

神经与进化计算 · 计算机科学 2022-11-15 Nick Zhang , Abhishek Gupta , Zefeng Chen , Yew-Soon Ong

In recent years, Evolutionary Strategies were actively explored in robotic tasks for policy search as they provide a simpler alternative to reinforcement learning algorithms. However, this class of algorithms is often claimed to be…

机器人学 · 计算机科学 2021-11-10 Vladislav Kurenkov , Bulat Maksudov

A key problem in the theory of meta-learning is to understand how the task distributions influence transfer risk, the expected error of a meta-learner on a new task drawn from the unknown task distribution. In this paper, focusing on fixed…

机器学习 · 统计学 2021-06-15 Mikhail Konobeev , Ilja Kuzborskij , Csaba Szepesvári

Solving the Goal-Conditioned Reward Sparse (GCRS) task is a challenging reinforcement learning problem due to the sparsity of reward signals. In this work, we propose a new formulation of GCRS tasks from the perspective of the drifted…

机器学习 · 计算机科学 2020-05-01 Hao Sun , Xinyu Pan , Bo Dai , Dahua Lin , Bolei Zhou

Meta-reinforcement learning algorithms can enable robots to acquire new skills much more quickly, by leveraging prior experience to learn how to learn. However, much of the current research on meta-reinforcement learning focuses on task…