中文
相关论文

相关论文: Efficient Meta Reinforcement Learning for Preferen…

200 篇论文

Many sequential decision-making tasks involve optimizing multiple conflicting objectives, requiring policies that adapt to different user preferences. In multi-objective reinforcement learning (MORL), one widely studied approach} addresses…

机器学习 · 计算机科学 2026-04-28 Ying-Tu Chen , Wei Hung , Bing-Shu Wu , Zhang-Wei Hong , Ping-Chun Hsieh

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

机器学习 · 计算机科学 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma

Conveying complex objectives to reinforcement learning (RL) agents can often be difficult, involving meticulous design of reward functions that are sufficiently informative yet easy enough to provide. Human-in-the-loop RL methods allow…

机器学习 · 计算机科学 2021-06-10 Kimin Lee , Laura Smith , Pieter Abbeel

Meta reinforcement learning (meta-RL) extracts knowledge from previous tasks and achieves fast adaptation to new tasks. Despite recent progress, efficient exploration in meta-RL remains a key challenge in sparse-reward tasks, as it requires…

人工智能 · 计算机科学 2021-11-15 Jin Zhang , Jianhao Wang , Hao Hu , Tong Chen , Yingfeng Chen , Changjie Fan , Chongjie Zhang

In Meta-Reinforcement Learning (meta-RL) an agent is trained on a set of tasks to prepare for and learn faster in new, unseen, but related tasks. The training tasks are usually hand-crafted to be representative of the expected distribution…

人工智能 · 计算机科学 2021-07-07 Ricardo Luna Gutierrez , Matteo Leonetti

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This…

机器学习 · 计算机科学 2018-12-06 Tristan Deleu , Yoshua Bengio

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both…

机器学习 · 计算机科学 2012-08-07 Riad Akrour , Marc Schoenauer , Michèle Sebag

For sophisticated reinforcement learning (RL) systems to interact usefully with real-world environments, we need to communicate complex goals to these systems. In this work, we explore goals defined in terms of (non-expert) human…

机器学习 · 统计学 2023-02-20 Paul Christiano , Jan Leike , Tom B. Brown , Miljan Martic , Shane Legg , Dario Amodei

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

机器学习 · 计算机科学 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

This paper introduces the offline meta-reinforcement learning (offline meta-RL) problem setting and proposes an algorithm that performs well in this setting. Offline meta-RL is analogous to the widely successful supervised learning strategy…

机器学习 · 计算机科学 2021-07-22 Eric Mitchell , Rafael Rafailov , Xue Bin Peng , Sergey Levine , Chelsea Finn

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

机器人学 · 计算机科学 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

For robots to be effectively deployed in novel environments and tasks, they must be able to understand the feedback expressed by humans during intervention. This can either correct undesirable behavior or indicate additional preferences.…

机器人学 · 计算机科学 2023-06-05 Alvin Shek , Bo Ying Su , Rui Chen , Changliu Liu

Preference-aligned robot navigation in human environments is typically achieved through learning-based approaches, utilizing user feedback or demonstrations for personalization. However, personal preferences are subject to change and might…

机器人学 · 计算机科学 2025-10-21 Jorge de Heuvel , Tharun Sethuraman , Maren Bennewitz

Meta-learning algorithms can accelerate the model-based reinforcement learning (MBRL) algorithms by finding an initial set of parameters for the dynamical model such that the model can be trained to match the actual dynamics of the system…

机器人学 · 计算机科学 2021-01-08 Rituraj Kaushik , Timothée Anne , Jean-Baptiste Mouret

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

机器学习 · 计算机科学 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

In human-in-the-loop reinforcement learning or environments where calculating a reward is expensive, the costly rewards can make learning efficiency challenging to achieve. The cost of obtaining feedback from humans or calculating expensive…

机器学习 · 计算机科学 2025-03-03 Muhammed Yusuf Satici , David L. Roberts

Modern meta-reinforcement learning (Meta-RL) methods are mainly developed based on model-agnostic meta-learning, which performs policy gradient steps across tasks to maximize policy performance. However, the gradient conflict problem is…

人工智能 · 计算机科学 2022-09-22 Haozhi Wang , Qing Wang , Yunfeng Shao , Dong Li , Jianye Hao , Yinchuan Li

Meta-reinforcement learning (meta-RL) algorithms allow for agents to learn new behaviors from small amounts of experience, mitigating the sample inefficiency problem in RL. However, while meta-RL agents can adapt quickly to new tasks at…

机器学习 · 计算机科学 2022-04-26 Michael Wan , Jian Peng , Tanmay Gangwani

Fast adaptation to new tasks is extremely important for embodied agents in the real world. Meta-reinforcement learning (meta-RL) has emerged as an effective method to enable fast adaptation in unknown environments. Compared to on-policy…

机器学习 · 计算机科学 2024-06-19 Menglong Zhang , Fuyuan Qian , Quanying Liu

Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new…