English
Related papers

Related papers: Object Rearrangement Using Learned Implicit Collis…

200 papers

Grasping unknown objects from a single view has remained a challenging topic in robotics due to the uncertainty of partial observation. Recent advances in large-scale models have led to benchmark solutions such as GraspNet-1Billion.…

Robotics · Computer Science 2025-07-17 Hao Chen , Takuya Kiyokawa , Zhengtao Hu , Weiwei Wan , Kensuke Harada

Using visual model-based learning for deformable object manipulation is challenging due to difficulties in learning plannable visual representations along with complex dynamic models. In this work, we propose a new learning framework that…

Machine Learning · Computer Science 2020-03-12 Wilson Yan , Ashwin Vangipuram , Pieter Abbeel , Lerrel Pinto

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

Manipulating deformable objects arises in daily life and numerous applications. Despite phenomenal advances in industrial robotics, manipulation of deformable objects remains mostly a manual task. This is because of the high number of…

Robotics · Computer Science 2024-01-31 Burak Aksoy , John Wen

Vision-based robotic object grasping is typically investigated in the context of isolated objects or unstructured object sets in bin picking scenarios. However, there are several settings, such as construction or warehouse automation, where…

Imitation learning of robot policies from few demonstrations is crucial in open-ended applications. We propose a new method, Interaction Warping, for learning SE(3) robotic manipulation policies from a single demonstration. We infer the 3D…

We propose a novel pipeline for unknown object grasping in shared robotic autonomy scenarios. State-of-the-art methods for fully autonomous scenarios are typically learning-based approaches optimised for a specific end-effector, that…

Legged manipulators extend robotic capabilities beyond static manipulation by integrating agile locomotion with versatile arm control. However, achieving precise manipulation while maintaining coordinated locomotion remains a major…

Deep Learning (DL) has become essential in various robotics applications due to excelling at processing raw sensory data to extract task specific information from semantic objects. For example, vision-based object-relative navigation relies…

Robotics · Computer Science 2025-09-03 Thomas Jantos , Stephan Weiss , Jan Steinbrener

Scene flow estimation is the task to predict the point-wise or pixel-wise 3D displacement vector between two consecutive frames of point clouds or images, which has important application in fields such as service robots and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Wang , Yunzhe Hu , Xinrui Wu , Hesheng Wang

Object detection models shipped with camera-equipped edge devices cannot cover the objects of interest for every user. Therefore, the incremental learning capability is a critical feature for a robust and personalized object detection…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Dawei Li , Serafettin Tasci , Shalini Ghosh , Jingwen Zhu , Junting Zhang , Larry Heck

The most recent trend in estimating the 6D pose of rigid objects has been to train deep networks to either directly regress the pose from the image or to predict the 2D locations of 3D keypoints, from which the pose can be obtained using a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yinlin Hu , Joachim Hugonot , Pascal Fua , Mathieu Salzmann

Perceptual understanding of the scene and the relationship between its different components is important for successful completion of robotic tasks. Representation learning has been shown to be a powerful technique for this, but most of the…

Predicting the outcome of liquid droplet collisions is an extensively studied phenomenon but the current physics based models for predicting the outcomes are poor (accuracy $\approx 43\%$). The key weakness of these models is their limited…

Machine Learning · Computer Science 2021-10-04 Arpit Agarwal

To fully understand the 3D context of a single image, a visual system must be able to segment both the visible and occluded regions of objects, while discerning their occlusion order. Ideally, the system should be able to handle any object…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Jiayang Ao , Qiuhong Ke , Krista A. Ehinger

We consider the problem of learning object arrangements in a 3D scene. The key idea here is to learn how objects relate to human poses based on their affordances, ease of use and reachability. In contrast to modeling object-object…

Machine Learning · Computer Science 2012-07-03 Yun Jiang , Marcus Lim , Ashutosh Saxena

This paper presents a data-efficient approach to learning transferable forward models for robotic push manipulation. Our approach extends our previous work on contact-based predictors by leveraging information on the pushed object's local…

Robotics · Computer Science 2019-05-10 Jochen Stüber , Marek Kopicki , Claudio Zito

Adaptive control for real-time manipulation requires quick estimation and prediction of object properties. While robot learning in this area primarily focuses on using vision, many tasks cannot rely on vision due to object occlusion. Here,…

Robotics · Computer Science 2021-10-12 Ahalya Prabhakar , Stanislas Furrer , Lorenzo Panchetti , Maxence Perret , Aude Billard

In the past few years, we have seen great progress in perception algorithms, particular through the use of deep learning. However, most existing approaches focus on a few categories of interest, which represent only a small fraction of the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Kelvin Wong , Shenlong Wang , Mengye Ren , Ming Liang , Raquel Urtasun

Object grasping in cluttered scenes is a widely investigated field of robot manipulation. Most of the current works focus on estimating grasp pose from point clouds based on an efficient single-shot grasp detection network. However, due to…

Robotics · Computer Science 2021-05-19 Wei Wei , Yongkang Luo , Fuyu Li , Guangyun Xu , Jun Zhong , Wanyi Li , Peng Wang