English
Related papers

Related papers: BEAC: Imitating Complex Exploration and Task-orien…

200 papers

Imitation learning with human data has demonstrated remarkable success in teaching robots in a wide range of skills. However, the inherent diversity in human behavior leads to the emergence of multi-modal data distributions, thereby…

Behavioral cloning uses a dataset of demonstrations to learn a policy. To overcome computationally expensive training procedures and address the policy adaptation problem, we propose to use latent spaces of pre-trained foundation models to…

Artificial Intelligence · Computer Science 2024-04-09 Federco Malato , Florian Leopold , Andrew Melnik , Ville Hautamaki

Visual imitation learning provides an effective framework to learn skills from demonstrations. However, the quality of the provided demonstrations usually significantly affects the ability of an agent to acquire desired skills. Therefore,…

Robotics · Computer Science 2023-03-02 Ray Chen Zheng , Kaizhe Hu , Zhecheng Yuan , Boyuan Chen , Huazhe Xu

We consider interactive learning in the realizable setting and develop a general framework to handle problems ranging from best arm identification to active classification. We begin our investigation with the observation that agnostic…

Machine Learning · Computer Science 2021-11-10 Julian Katz-Samuels , Blake Mason , Kevin Jamieson , Rob Nowak

We study ObjectGoal Navigation -- where a virtual robot situated in a new environment is asked to navigate to an object. Prior work has shown that imitation learning (IL) using behavior cloning (BC) on a dataset of human demonstrations…

Machine Learning · Computer Science 2023-03-28 Ram Ramrakhya , Dhruv Batra , Erik Wijmans , Abhishek Das

Robots in many real-world settings have access to force/torque sensors in their gripper and tactile sensing is often necessary in tasks that involve contact-rich motion. In this work, we leverage surprise from mismatches in touch feedback…

Machine Learning · Computer Science 2021-06-29 Sai Rajeswar , Cyril Ibrahim , Nitin Surya , Florian Golemo , David Vazquez , Aaron Courville , Pedro O. Pinheiro

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

Machine Learning · Computer Science 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

Imitation learning (IL) has shown great success in learning complex robot manipulation tasks. However, there remains a need for practical safety methods to justify widespread deployment. In particular, it is important to certify that a…

We study optimal teaching of Linear Behavior Cloning (LBC) learners. In this setup, the teacher can select which states to demonstrate to an LBC learner. The learner maintains a version space of infinite linear hypotheses consistent with…

Machine Learning · Computer Science 2023-11-28 Shubham Kumar Bharti , Stephen Wright , Adish Singla , Xiaojin Zhu

Traditional imitation learning provides a set of methods and algorithms to learn a reward function or policy from expert demonstrations. Learning from demonstration has been shown to be advantageous for navigation tasks as it allows for…

Robotics · Computer Science 2021-08-03 Christian Ellis , Maggie Wigness , John G. Rogers , Craig Lennon , Lance Fiondella

Imitation learning techniques have been shown to be highly effective in real-world control scenarios, such as robotics. However, these approaches not only suffer from compounding error issues but also require human experts to provide…

Robotics · Computer Science 2025-02-21 Yigit Korkmaz , Erdem Bıyık

Interactions with either environments or expert policies during training are needed for most of the current imitation learning (IL) algorithms. For IL problems with no interactions, a typical approach is Behavior Cloning (BC). However,…

Robotics · Computer Science 2021-04-06 HaoChih Lin , Baopu Li , Xin Zhou , Jiankun Wang , Max Q. -H. Meng

In real-world sequential decision making tasks like autonomous driving, robotics, and healthcare, learning from observed state-action trajectories is critical for tasks like imitation, classification, and clustering. For example,…

Machine Learning · Computer Science 2025-01-20 Zichang Ge , Changyu Chen , Arunesh Sinha , Pradeep Varakantham

Effective exploration is crucial to discovering optimal strategies for multi-agent reinforcement learning (MARL) in complex coordination tasks. Existing methods mainly utilize intrinsic rewards to enable committed exploration or use…

Machine Learning · Computer Science 2024-03-04 Zeyang Liu , Lipeng Wan , Xinrui Yang , Zhuoran Chen , Xingyu Chen , Xuguang Lan

Two prominent challenges in explainability research involve 1) the nuanced evaluation of explanations and 2) the modeling of missing information through baseline representations. The existing literature introduces diverse evaluation…

Machine Learning · Computer Science 2024-12-24 Oren Barkan , Yehonatan Elisha , Jonathan Weill , Noam Koenigstein

It is a popular belief that model-based Reinforcement Learning (RL) is more sample efficient than model-free RL, but in practice, it is not always true due to overweighed model errors. In complex and noisy settings, model-based RL tends to…

Machine Learning · Computer Science 2020-10-13 Feiyang Pan , Jia He , Dandan Tu , Qing He

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

Imitation learning (IL) is a simple and powerful way to use high-quality human driving data, which can be collected at scale, to produce human-like behavior. However, policies based on imitation learning alone often fail to sufficiently…

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

Machine Learning · Computer Science 2021-03-11 Zhangjie Cao , Dorsa Sadigh