English
Related papers

Related papers: FUNCanon: Learning Pose-Aware Action Primitives vi…

200 papers

Vision-based learning methods provide promise for robots to learn complex manipulation tasks. However, how to generalize the learned manipulation skills to real-world interactions remains an open question. In this work, we study robotic…

Robotics · Computer Science 2020-03-03 Zhixin Jia , Mengxiang Lin , Zhixin Chen , Shibo Jian

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

In this paper, we propose a real-world benchmark for studying robotic learning in the context of functional manipulation: a robot needs to accomplish complex long-horizon behaviors by composing individual manipulation skills in functionally…

Robotics · Computer Science 2024-09-04 Jianlan Luo , Charles Xu , Fangchen Liu , Liam Tan , Zipeng Lin , Jeffrey Wu , Pieter Abbeel , Sergey Levine

The domain of robotics is challenging to apply deep reinforcement learning due to the need for large amounts of data and for ensuring safety during learning. Curriculum learning has shown good performance in terms of sample- efficient deep…

Robotics · Computer Science 2022-04-15 Anil Kurkcu , Cihan Acar , Domenico Campolo , Keng Peng Tee

Effectively integrating diverse sensory modalities is crucial for robotic manipulation. However, the typical approach of feature concatenation is often suboptimal: dominant modalities such as vision can overwhelm sparse but critical signals…

Building robotic agents capable of operating across diverse environments and object types remains a significant challenge, often requiring extensive data collection. This is particularly restrictive in robotics, where each data point must…

Robotics · Computer Science 2025-02-28 Siddhant Haldar , Lerrel Pinto

We introduce SPOT, an object-centric imitation learning framework. The key idea is to capture each task by an object-centric representation, specifically the SE(3) object pose trajectory relative to the target. This approach decouples…

Robotics · Computer Science 2025-05-15 Cheng-Chun Hsu , Bowen Wen , Jie Xu , Yashraj Narang , Xiaolong Wang , Yuke Zhu , Joydeep Biswas , Stan Birchfield

Generalization in robotic manipulation remains a critical challenge, particularly when scaling to new environments with limited demonstrations. This paper introduces CAGE, a novel robotic manipulation policy designed to overcome these…

Robotics · Computer Science 2024-12-09 Shangning Xia , Hongjie Fang , Cewu Lu , Hao-Shu Fang

We present a unified framework for multi-task locomotion and manipulation policy learning grounded in a contact-explicit representation. Instead of designing different policies for different tasks, our approach unifies the definition of a…

Robotics · Computer Science 2026-05-05 Shafeef Omar , Majid Khadiv

When an autonomous robot learns how to execute actions, it is of interest to know if and when the execution policy can be generalised to variations of the learning scenarios. This can inform the robot about the necessity of additional…

Robotics · Computer Science 2021-07-21 Alex Mitrevski , Paul G. Plöger , Gerhard Lakemeyer

Sequential manipulation tasks require a robot to perceive the state of an environment and plan a sequence of actions leading to a desired goal state. In such tasks, the ability to reason about spatial relations among object entities from…

Robotics · Computer Science 2022-09-15 Wentao Yuan , Chris Paxton , Karthik Desingh , Dieter Fox

How do we imbue robots with the ability to efficiently manipulate unseen objects and transfer relevant skills based on demonstrations? End-to-end learning methods often fail to generalize to novel objects or unseen configurations. Instead,…

Robotics · Computer Science 2024-05-03 Chuer Pan , Brian Okorn , Harry Zhang , Ben Eisner , David Held

Foundation models hold significant potential for enabling robots to perform long-horizon general manipulation tasks. However, the simplicity of tasks and the uniformity of environments in existing benchmarks restrict their effective…

Robotics · Computer Science 2025-04-04 Liming Zheng , Feng Yan , Fanfan Liu , Chengjian Feng , Zhuoliang Kang , Lin Ma

This paper presents ArticuBot, in which a single learned policy enables a robotics system to open diverse categories of unseen articulated objects in the real world. This task has long been challenging for robotics due to the large…

It is a long-standing problem in robotics to develop agents capable of executing diverse manipulation tasks from visual observations in unstructured real-world environments. To achieve this goal, the robot needs to have a comprehensive…

Recent progress on vision-language foundation models have brought significant advancement to building general-purpose robots. By using the pre-trained models to encode the scene and instructions as inputs for decision making, the…

Machine Learning · Computer Science 2023-03-22 Yuying Ge , Annabella Macaluso , Li Erran Li , Ping Luo , Xiaolong Wang

Systematic Generalization refers to a learning algorithm's ability to extrapolate learned behavior to unseen situations that are distinct but semantically similar to its training data. As shown in recent work, state-of-the-art deep learning…

Artificial Intelligence · Computer Science 2020-10-06 Tong Gao , Qi Huang , Raymond J. Mooney

Manipulation planning is the task of computing robot trajectories that move a set of objects to their target configuration while satisfying physically feasibility. In contrast to existing works that assume known object templates, we are…

Robotics · Computer Science 2019-09-17 Wei Gao , Russ Tedrake

Industrial deployment of robotic visual anomaly detection (VAD) is fundamentally constrained by passive perception under diverse 6-DoF pose configurations and unstable operating conditions such as illumination changes and shadows, where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Teng Yan , Binkai Liu , Shuai Liu , Yue Yu , Bingzhuo Zhong

Modeling generalized robot control policies poses ongoing challenges for language-guided robot manipulation tasks. Existing methods often struggle to efficiently utilize cross-dataset resources or rely on resource-intensive vision-language…

Robotics · Computer Science 2024-11-05 Wenhui Tan , Bei Liu , Junbo Zhang , Ruihua Song , Jianlong Fu