English
Related papers

Related papers: Waypoint-Based Imitation Learning for Robotic Mani…

200 papers

Ensembling deep learning models is a shortcut to promote its implementation in new scenarios, which can avoid tuning neural networks, losses and training algorithms from scratch. However, it is difficult to collect sufficient accurate and…

Machine Learning · Computer Science 2020-12-04 Jun Yang , Fei Wang

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati

In agricultural automation, inherent occlusion presents a major challenge for robotic harvesting. We propose a novel imitation learning-based viewpoint planning approach to actively adjust camera viewpoint and capture unobstructed images of…

Robotics · Computer Science 2025-03-14 Lun Li , Hamidreza Kasaei

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

Machine Learning · Computer Science 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

Visual imitation learning enables robotic agents to acquire skills by observing expert demonstration videos. In the one-shot setting, the agent generates a policy after observing a single expert demonstration without additional fine-tuning.…

Robotics · Computer Science 2026-01-01 Raktim Gautam Goswami , Prashanth Krishnamurthy , Yann LeCun , Farshad Khorrami

Recent progress in end-to-end Imitation Learning approaches has shown promising results and generalization capabilities on mobile manipulation tasks. Such models are seeing increasing deployment in real-world settings, where scaling up…

Robotics · Computer Science 2023-02-10 Cem Gokmen , Daniel Ho , Mohi Khansari

Driving requires reacting to a wide variety of complex environment conditions and agent behaviors. Explicitly modeling each possible scenario is unrealistic. In contrast, imitation learning can, in theory, leverage data from large fleets of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Felipe Codevilla , Eder Santana , Antonio M. López , Adrien Gaidon

Imitation learning addresses the challenge of learning by observing an expert's demonstrations without access to reward signals from environments. Most existing imitation learning methods that do not require interacting with environments…

Machine Learning · Computer Science 2024-06-04 Shang-Fu Chen , Hsiang-Chun Wang , Ming-Hao Hsu , Chun-Mao Lai , Shao-Hua Sun

Masked Autoencoder (MAE) is a self-supervised approach for representation learning, widely applicable to a variety of downstream tasks in computer vision. In spite of its success, it is still not fully uncovered what and how MAE exactly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jeongwoo Shin , Inseo Lee , Junho Lee , Joonseok Lee

Learning from visual data opens the potential to accrue a large range of manipulation behaviors by leveraging human demonstrations without specifying each of them mathematically, but rather through natural task specification. In this paper,…

Robotics · Computer Science 2021-11-16 Haoyu Xiong , Quanzhou Li , Yun-Chun Chen , Homanga Bharadhwaj , Samarth Sinha , Animesh Garg

We present a data-driven optimization framework that aims to address online adaptation of the flight path shape for an airborne wind energy system (AWE) that follows a repetitive path to generate power. Specifically, Bayesian optimization,…

Systems and Control · Electrical Eng. & Systems 2020-11-18 Ali Baheri , Chris Vermillion

Learning by examples, which learns to solve a new problem by looking into how similar problems are solved, is an effective learning method in human learning. When a student learns a new topic, he/she finds out exemplar topics that are…

Machine Learning · Computer Science 2021-09-23 Shentong Mo , Pengtao Xie

We propose an imitation learning system for autonomous driving in urban traffic with interactions. We train a Behavioral Cloning~(BC) policy to imitate driving behavior collected from the real urban traffic, and apply the data aggregation…

Robotics · Computer Science 2021-09-06 Zhao-Heng Yin , Chenran Li , Liting Sun , Masayoshi Tomizuka , Wei Zhan

Humans often learn how to perform tasks via imitation: they observe others perform a task, and then very quickly infer the appropriate actions to take based on their observations. While extending this paradigm to autonomous agents is a…

Artificial Intelligence · Computer Science 2018-05-15 Faraz Torabi , Garrett Warnell , Peter Stone

The field of visual representation learning has seen explosive growth in the past years, but its benefits in robotics have been surprisingly limited so far. Prior work uses generic visual representations as a basis to learn (task-specific)…

Robotics · Computer Science 2023-08-16 Jianren Wang , Sudeep Dasari , Mohan Kumar Srirama , Shubham Tulsiani , Abhinav Gupta

Learning robotic tasks in the real world is still highly challenging and effective practical solutions remain to be found. Traditional methods used in this area are imitation learning and reinforcement learning, but they both have…

Machine Learning · Computer Science 2022-08-02 Abdalkarim Mohtasib , Gerhard Neumann , Heriberto Cuayahuitl

Robotic skills can be learned via imitation learning (IL) using user-provided demonstrations, or via reinforcement learning (RL) using large amountsof autonomously collected experience.Both methods have complementarystrengths and…

Intelligent instruction-following robots capable of improving from autonomously collected experience have the potential to transform robot learning: instead of collecting costly teleoperated demonstration data, large-scale deployment of…

Robotics · Computer Science 2025-02-26 Zhiyuan Zhou , Pranav Atreya , Abraham Lee , Homer Walke , Oier Mees , Sergey Levine

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

This work considers robot keypoint estimation on color images as a supervised machine learning task. We propose the use of probabilistically created renderings to overcome the lack of labeled real images. Rather than sampling from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Christoph Heindl , Sebastian Zambal , Josef Scharinger