中文
相关论文

相关论文: Hierarchical Variational Imitation Learning of Con…

200 篇论文

We study how to effectively leverage expert feedback to learn sequential decision-making policies. We focus on problems with sparse rewards and long time horizons, which typically pose significant challenges in reinforcement learning. We…

机器学习 · 计算机科学 2018-06-12 Hoang M. Le , Nan Jiang , Alekh Agarwal , Miroslav Dudík , Yisong Yue , Hal Daumé

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

机器学习 · 计算机科学 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

Fashion is a complex social phenomenon. People follow fashion styles from demonstrations by experts or fashion icons. However, for machine agent, learning to imitate fashion experts from demonstrations can be challenging, especially for…

机器学习 · 计算机科学 2020-04-15 Shizhu Liu , Shanglin Yang , Hui Zhou

In this paper, we describe a novel approach to imitation learning that infers latent policies directly from state observations. We introduce a method that characterizes the causal effects of latent actions on observations while…

机器学习 · 计算机科学 2019-05-14 Ashley D. Edwards , Himanshu Sahni , Yannick Schroecker , Charles L. Isbell

Reinforcement learning algorithms struggle on tasks with complex hierarchical dependency structures. Humans and other intelligent agents do not waste time assessing the utility of every high-level action in existence, but instead only…

机器学习 · 计算机科学 2022-03-25 Robby Costales , Shariq Iqbal , Fei Sha

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

机器学习 · 计算机科学 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood

Large language models (LLMs) struggle on processing complicated observations in interactive decision making tasks. To alleviate this issue, we propose a simple hierarchical prompting approach. Diverging from previous prompting approaches…

计算与语言 · 计算机科学 2023-10-31 Abishek Sridhar , Robert Lo , Frank F. Xu , Hao Zhu , Shuyan Zhou

Multi-agent shepherding represents a challenging distributed control problem where herder agents must coordinate to guide independently moving targets to desired spatial configurations. Most existing control strategies assume cohesive…

系统与控制 · 电气工程与系统科学 2025-08-05 Italo Napolitano , Stefano Covone , Andrea Lama , Francesco De Lellis , Mario di Bernardo

Recent advances in hierarchical robot systems leverage a high-level planner to propose task plans and a low-level policy to generate robot actions. This design allows training the planner on action-free or even non-robot data sources (e.g.,…

机器人学 · 计算机科学 2026-02-13 Yitian Zheng , Zhangchen Ye , Weijun Dong , Shengjie Wang , Yuyang Liu , Chongjie Zhang , Chuan Wen , Yang Gao

Distribution-free predictive inference beyond the construction of prediction sets has gained a lot of interest in recent applications. One such application is the selection task, where the objective is to design a reliable selection rule to…

统计方法学 · 统计学 2025-01-07 Yonghoon Lee , Zhimei Ren

One of the common ways children learn is by mimicking adults. Imitation learning focuses on learning policies with suitable performance from demonstrations generated by an expert, with an unspecified performance measure, and unobserved…

机器学习 · 计算机科学 2022-08-15 Junzhe Zhang , Daniel Kumor , Elias Bareinboim

Robotic imitation learning faces a fundamental trade-off between modeling long-horizon dependencies and enabling fine-grained closed-loop control. Existing fixed-frequency action chunking approaches struggle to achieve both. Building on…

机器人学 · 计算机科学 2026-04-08 Jiyao Zhang , Zimu Han , Junhan Wang , Xionghao Wu , Shihong Lin , Jinzhou Li , Hongwei Fan , Ruihai Wu , Dongjiang Li , Hao Dong

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

机器学习 · 计算机科学 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

The options framework for hierarchical reinforcement learning has increased its popularity in recent years and has made improvements in tackling the scalability problem in reinforcement learning. Yet, most of these recent successes are…

机器学习 · 计算机科学 2022-03-11 Vittorio Giammarino , Ioannis Ch. Paschalidis

It has been a challenge to learning skills for an agent from long-horizon unannotated demonstrations. Existing approaches like Hierarchical Imitation Learning(HIL) are prone to compounding errors or suboptimal solutions. In this paper, we…

机器学习 · 计算机科学 2021-06-14 Mingxuan Jing , Wenbing Huang , Fuchun Sun , Xiaojian Ma , Tao Kong , Chuang Gan , Lei Li

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

机器人学 · 计算机科学 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

机器学习 · 计算机科学 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

人工智能 · 计算机科学 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions. When performing demonstrations, experts are not always consistent and might…

机器学习 · 计算机科学 2021-01-05 Sagar Gubbi Venkatesh , Nihesh Rathod , Shishir Kolathaya , Bharadwaj Amrutur

Scenarios requiring humans to choose from multiple seemingly optimal actions are commonplace, however standard imitation learning often fails to capture this behavior. Instead, an over-reliance on replicating expert actions induces…

机器人学 · 计算机科学 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara