English
Related papers

Related papers: Transfering Hierarchical Structure with Dual Meta …

200 papers

In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine…

Robotics · Computer Science 2022-11-02 Mingxi Jia , Dian Wang , Guanang Su , David Klee , Xupeng Zhu , Robin Walters , Robert Platt

Interactive Imitation Learning (IIL) is a branch of Imitation Learning (IL) where human feedback is provided intermittently during robot execution allowing an online improvement of the robot's behavior. In recent years, IIL has increasingly…

With the growing popularity of deep reinforcement learning (DRL), human-in-the-loop (HITL) approach has the potential to revolutionize the way we approach decision-making problems and create new opportunities for human-AI collaboration. In…

Even though machine learning algorithms already play a significant role in data science, many current methods pose unrealistic assumptions on input data. The application of such methods is difficult due to incompatible data formats, or…

Machine Learning · Computer Science 2022-06-09 Simon Mandlik , Tomas Pevny

Cross-domain imitation learning (CDIL) accelerates policy learning by transferring expert knowledge across domains, which is valuable in applications where the collection of expert data is costly. Existing methods are either supervised,…

Machine Learning · Computer Science 2026-02-12 Li-Min Chu , Kai-Siang Ma , Ming-Hong Chen , Ping-Chun Hsieh

Learning quickly is of great importance for machine intelligence deployed in online platforms. With the capability of transferring knowledge from learned tasks, meta-learning has shown its effectiveness in online scenarios by continuously…

Machine Learning · Computer Science 2020-10-23 Huaxiu Yao , Yingbo Zhou , Mehrdad Mahdavi , Zhenhui Li , Richard Socher , Caiming Xiong

In recent years, by utilizing optimization techniques to formulate the propagation of deep model, a variety of so-called Optimization-Derived Learning (ODL) approaches have been proposed to address diverse learning and vision tasks.…

Machine Learning · Computer Science 2023-09-13 Risheng Liu , Xuan Liu , Shangzhi Zeng , Jin Zhang , Yixuan Zhang

Meta-Reinforcement Learning (Meta-RL) enables fast adaptation to new testing tasks. Despite recent advancements, it is still challenging to learn performant policies across multiple complex and high-dimensional tasks. To address this, we…

Machine Learning · Computer Science 2024-12-17 Minjae Cho , Chuangchuang Sun

Model-based imitation learning (MBIL) is a popular reinforcement learning method that improves sample efficiency on high-dimension input sources, such as images and videos. Following the convention of MBIL research, existing algorithms are…

Machine Learning · Computer Science 2023-06-21 Shenghua Wan , Yucen Wang , Minghao Shao , Ruying Chen , De-Chuan Zhan

Sequence models in reinforcement learning require task knowledge to estimate the task policy. This paper presents a hierarchical algorithm for learning a sequence model from demonstrations. The high-level mechanism guides the low-level…

Machine Learning · Computer Science 2022-09-22 André Correia , Luís A. Alexandre

Humans are capable of learning a new behavior by observing others to perform the skill. Similarly, robots can also implement this by imitation learning. Furthermore, if with external guidance, humans can master the new behavior more…

Robotics · Computer Science 2019-12-30 Boyi Liu , Lujia Wang , Ming Liu , Cheng-Zhong Xu

In this work, we introduce a new perspective for learning transferable content in multi-task imitation learning. Humans are able to transfer skills and knowledge. If we can cycle to work and drive to the store, we can also cycle to the…

Machine Learning · Computer Science 2022-07-27 Bian Xihan , Oscar Mendez , Simon Hadfield

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Multi-task multi-agent reinforcement learning (MT-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle…

Robotics · Computer Science 2025-07-10 Guobin Zhu , Rui Zhou , Wenkang Ji , Hongyin Zhang , Donglin Wang , Shiyu Zhao

Hierarchical reinforcement learning (HRL) has seen widespread interest as an approach to tractable learning of complex modular behaviors. However, existing work either assume access to expert-constructed hierarchies, or use…

Machine Learning · Computer Science 2021-10-19 Kurtland Chua , Qi Lei , Jason D. Lee

Real-world robot manipulation in dynamic unstructured environments requires lifelong adaptability to evolving objects, scenes and tasks. Traditional imitation learning relies on static training paradigms, which are ill-suited for lifelong…

Robotics · Computer Science 2025-04-23 Jingkai Xu , Xiangli Nie

Meta-learning allows an intelligent agent to leverage prior learning episodes as a basis for quickly improving performance on a novel task. Bayesian hierarchical modeling provides a theoretical framework for formalizing meta-learning as…

Machine Learning · Computer Science 2018-01-29 Erin Grant , Chelsea Finn , Sergey Levine , Trevor Darrell , Thomas Griffiths

Humans perceive actions through key transitions that structure actions across multiple abstraction levels, whereas machines, relying on visual features, tend to over-segment. This highlights the difficulty of enabling hierarchical reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Junxian Huang , Ruichu Cai , Hao Zhu , Juntao Fang , Boyan Xu , Weilin Chen , Zijian Li , Shenghua Gao

Deep neural networks (DNNs) often suffer from "catastrophic forgetting" during incremental learning (IL) --- an abrupt degradation of performance on the original set of classes when the training objective is adapted to a newly added set of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Junting Zhang , Jie Zhang , Shalini Ghosh , Dawei Li , Serafettin Tasci , Larry Heck , Heming Zhang , C. -C. Jay Kuo

In order to efficiently learn with small amount of data on new tasks, meta-learning transfers knowledge learned from previous tasks to the new ones. However, a critical challenge in meta-learning is the task heterogeneity which cannot be…

Machine Learning · Computer Science 2020-01-06 Huaxiu Yao , Xian Wu , Zhiqiang Tao , Yaliang Li , Bolin Ding , Ruirui Li , Zhenhui Li