中文
相关论文

相关论文: On First-Order Meta-Reinforcement Learning with Mo…

200 篇论文

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

机器学习 · 计算机科学 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

Reinforcement learning (RL) in large or infinite state spaces is notoriously challenging, both theoretically (where worst-case sample and computational complexities must scale with state space cardinality) and experimentally (where function…

机器学习 · 计算机科学 2024-05-28 Marcel Hussing , Michael Kearns , Aaron Roth , Sikata Bela Sengupta , Jessica Sorrell

Although deep reinforcement learning (DRL) has shown promising results for autonomous navigation in interactive traffic scenarios, existing work typically adopts a fixed behavior policy to control social vehicles in the training…

机器人学 · 计算机科学 2023-07-20 Kanghoon Lee , Jiachen Li , David Isele , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

The optimal dispatch of energy storage systems (ESSs) presents formidable challenges due to the uncertainty introduced by fluctuations in dynamic prices, demand consumption, and renewable-based energy generation. By exploiting the…

系统与控制 · 电气工程与系统科学 2023-07-27 Shengren Hou , Edgar Mauricio Salazar Duque , Peter Palensky , Pedro P. Vergara

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

流体动力学 · 物理学 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

We investigate a Federated Reinforcement Learning with Environment Heterogeneity (FRL-EH) framework, where local environments exhibit statistical heterogeneity. Within this framework, agents collaboratively learn a global policy by…

机器学习 · 计算机科学 2025-07-22 Ukjo Hwang , Songnam Hong

Efficiently adapting to new environments and changes in dynamics is critical for agents to successfully operate in the real world. Reinforcement learning (RL) based approaches typically rely on external reward feedback for adaptation.…

机器学习 · 计算机科学 2019-03-05 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Jie Tan , Chelsea Finn

Deep reinforcement learning algorithms require large amounts of experience to learn an individual task. While in principle meta-reinforcement learning (meta-RL) algorithms enable agents to learn new skills from small amounts of experience,…

机器学习 · 计算机科学 2019-03-21 Kate Rakelly , Aurick Zhou , Deirdre Quillen , Chelsea Finn , Sergey Levine

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

机器学习 · 计算机科学 2026-04-07 Yaoze Guo , Shana Moothedath

A common challenge in reinforcement learning is how to convert the agent's interactions with an environment into fast and robust learning. For instance, earlier work makes use of domain knowledge to improve existing reinforcement learning…

机器学习 · 计算机科学 2020-04-01 Yannis Flet-Berliac , Philippe Preux

Model-Agnostic Meta-Learning (MAML) is a versatile meta-learning framework applicable to both supervised learning and reinforcement learning (RL). However, applying MAML to meta-reinforcement learning (meta-RL) presents notable challenges.…

机器学习 · 计算机科学 2025-10-02 Yang Zhang , Huiwen Yan , Mushuang Liu

Offline meta-reinforcement learning (OMRL) utilizes pre-collected offline datasets to enhance the agent's generalization ability on unseen tasks. However, the context shift problem arises due to the distribution discrepancy between the…

机器学习 · 计算机科学 2023-11-08 Yunkai Gao , Rui Zhang , Jiaming Guo , Fan Wu , Qi Yi , Shaohui Peng , Siming Lan , Ruizhi Chen , Zidong Du , Xing Hu , Qi Guo , Ling Li , Yunji Chen

We propose a novel approach to address one aspect of the non-stationarity problem in multi-agent reinforcement learning (RL), where the other agents may alter their policies due to environment changes during execution. This violates the…

机器学习 · 计算机科学 2019-12-03 Yixiang Wang , Feng Wu

While deep reinforcement learning (RL) has fueled multiple high-profile successes in machine learning, it is held back from more widespread adoption by its often poor data efficiency and the limited generality of the policies it produces. A…

机器学习 · 计算机科学 2025-05-30 Jacob Beck , Risto Vuorio , Evan Zheran Liu , Zheng Xiong , Luisa Zintgraf , Chelsea Finn , Shimon Whiteson

Multi-objective reinforcement learning (MORL) is used to solve problems involving multiple objectives. An MORL agent must make decisions based on the diverse signals provided by distinct reward functions. Training an MORL agent yields a set…

人工智能 · 计算机科学 2024-11-08 Zuzanna Osika , Jazmin Zatarain-Salazar , Frans A. Oliehoek , Pradeep K. Murukannaiah

We propose \textit{Meta-Regularization}, a novel approach for the adaptive choice of the learning rate in first-order gradient descent methods. Our approach modifies the objective function by adding a regularization term on the learning…

机器学习 · 计算机科学 2021-04-13 Guangzeng Xie , Hao Jin , Dachao Lin , Zhihua Zhang

Learning in multi-agent systems is highly challenging due to several factors including the non-stationarity introduced by agents' interactions and the combinatorial nature of their state and action spaces. In particular, we consider the…

机器学习 · 统计学 2023-05-10 Barna Pásztor , Ilija Bogunovic , Andreas Krause

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

机器学习 · 计算机科学 2021-06-03 Sindhu Padakandla

Meta-Reinforcement Learning (Meta-RL) enables fast adaptation to new testing tasks. Despite recent advancements, it is still challenging to learn performant policies across multiple complex and high-dimensional tasks. To address this, we…

机器学习 · 计算机科学 2024-12-17 Minjae Cho , Chuangchuang Sun

Reinforcement learning algorithms can acquire policies for complex tasks autonomously. However, the number of samples required to learn a diverse set of skills can be prohibitively large. While meta-reinforcement learning methods have…

机器学习 · 计算机科学 2020-06-17 Russell Mendonca , Xinyang Geng , Chelsea Finn , Sergey Levine