English
Related papers

Related papers: Cross-Domain Transfer via Semantic Skill Imitation

200 papers

Agents that can learn to imitate given video observation -- \emph{without direct access to state or action information} are more applicable to learning in the natural world. However, formulating a reinforcement learning (RL) agent that…

Machine Learning · Computer Science 2023-07-14 Glen Berseth , Florian Golemo , Christopher Pal

In this work, we introduce a novel method to learn everyday-like multi-stage tasks from a single human demonstration, without requiring any prior object knowledge. Inspired by the recent Coarse-to-Fine Imitation Learning method, we model…

Robotics · Computer Science 2021-11-16 Norman Di Palo , Edward Johns

The process of developing control functions for embedded systems is resource-, time-, and data-intensive, often resulting in sub-optimal cost and solutions approaches. Reinforcement Learning (RL) has great potential for autonomously…

Machine Learning · Computer Science 2025-03-06 Mario Picerno , Lucas Koch , Kevin Badalian , Marius Wegener , Joschka Schaub , Charles Robert Koch , Jakob Andert

We tackle real-world long-horizon robot manipulation tasks through skill discovery. We present a bottom-up approach to learning a library of reusable skills from unsegmented demonstrations and use these skills to synthesize prolonged robot…

Robotics · Computer Science 2022-01-25 Yifeng Zhu , Peter Stone , Yuke Zhu

Long-horizon tasks in robotic manipulation present significant challenges in reinforcement learning (RL) due to the difficulty of designing dense reward functions and effectively exploring the expansive state-action space. However, despite…

Machine Learning · Computer Science 2025-10-06 Adrià López Escoriza , Nicklas Hansen , Stone Tao , Tongzhou Mu , Hao Su

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

We present a deep imitation learning framework for robotic bimanual manipulation in a continuous state-action space. A core challenge is to generalize the manipulation skills to objects in different locations. We hypothesize that modeling…

Real-world robotics problems often occur in domains that differ significantly from the robot's prior training environment. For many robotic control tasks, real world experience is expensive to obtain, but data is easy to collect in either…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Eric Tzeng , Coline Devin , Judy Hoffman , Chelsea Finn , Pieter Abbeel , Sergey Levine , Kate Saenko , Trevor Darrell

End-to-end learning is emerging as a powerful paradigm for robotic manipulation, but its effectiveness is limited by data scarcity and the heterogeneity of action spaces across robot embodiments. In particular, diverse action spaces across…

Robotics · Computer Science 2026-03-23 Erik Bauer , Elvis Nava , Robert K. Katzschmann

Transferring learned skills across diverse situations remains a fundamental challenge for autonomous agents, particularly when agents are not allowed to interact with an exact target setup. While prior approaches have predominantly focused…

Machine Learning · Computer Science 2024-07-25 Hayato Watahiki , Ryo Iwase , Ryosuke Unno , Yoshimasa Tsuruoka

Transferring high-level knowledge from a source task to a target task is an effective way to expedite reinforcement learning (RL). For example, propositional logic and first-order logic have been used as representations of such knowledge.…

Artificial Intelligence · Computer Science 2019-09-11 Zhe Xu , Ufuk Topcu

Imitation learning in robots, also called programing by demonstration, has made important advances in recent years, allowing humans to teach context dependant motor skills/tasks to robots. We propose to extend the usual contexts…

Artificial Intelligence · Computer Science 2012-03-13 Thomas Cederborg , Pierre-Yves Oudeyer

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Learning from Demonstration (LfD) offers a promising paradigm for robot skill acquisition. Recent approaches attempt to extract manipulation commands directly from video demonstrations, yet face two critical challenges: (1) general video…

Robotics · Computer Science 2026-02-24 Thanh Nguyen Canh , Thanh-Tuan Tran , Haolan Zhang , Ziyan Gao , Nak Young Chong , Xiem HoangVan

Visual imitation learning provides a framework for learning complex manipulation behaviors by leveraging human demonstrations. However, current interfaces for imitation such as kinesthetic teaching or teleoperation prohibitively restrict…

Robotics · Computer Science 2020-08-12 Sarah Young , Dhiraj Gandhi , Shubham Tulsiani , Abhinav Gupta , Pieter Abbeel , Lerrel Pinto

Robots could learn their own state and world representation from perception and experience without supervision. This desirable goal is the main focus of our field of interest, state representation learning (SRL). Indeed, a compact…

Machine Learning · Computer Science 2021-09-28 Astrid Merckling , Alexandre Coninx , Loic Cressot , Stéphane Doncieux , Nicolas Perrin-Gilbert

Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on…

Machine Learning · Computer Science 2020-10-23 Karl Pertsch , Youngwoon Lee , Joseph J. Lim

Imitation learning is a popular approach for teaching motor skills to robots. However, most approaches focus on extracting policy parameters from execution traces alone (i.e., motion trajectories and perceptual data). No adequate…

Robotics · Computer Science 2020-10-26 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Stefan Lee , Chitta Baral , Heni Ben Amor

Manipulating objects is a hallmark of human intelligence, and an important task in domains such as robotics. In principle, Reinforcement Learning (RL) offers a general approach to learn object manipulation. In practice, however, domains…

Robotics · Computer Science 2024-04-02 Dan Haramati , Tal Daniel , Aviv Tamar

The rapid proliferation of new users and items on the social web has aggravated the gray-sheep user/long-tail item challenge in recommender systems. Historically, cross-domain co-clustering methods have successfully leveraged shared users…

Information Retrieval · Computer Science 2020-05-22 Adit Krishnan , Mahashweta Das , Mangesh Bendre , Hao Yang , Hari Sundaram