English
Related papers

Related papers: Real-Time Grasping Strategies Using Event Camera

200 papers

Despite recent advancements in AI for robotics, grasping remains a partially solved challenge, hindered by the lack of benchmarks and reproducibility constraints. This paper introduces a vision-based grasping framework that can easily be…

Robotics · Computer Science 2024-03-13 François Hélénon , Johann Huber , Faïz Ben Amar , Stéphane Doncieux

Grasping in cluttered environments is a fundamental but challenging robotic skill. It requires both reasoning about unseen object parts and potential collisions with the manipulator. Most existing data-driven approaches avoid this problem…

Robotics · Computer Science 2020-05-22 Adithyavairavan Murali , Arsalan Mousavian , Clemens Eppner , Chris Paxton , Dieter Fox

Dexterous grasping of unseen objects in dynamic environments is an essential prerequisite for the advanced manipulation of autonomous robots. Prior advances rely on several assumptions that simplify the setup, including environment…

Robotics · Computer Science 2024-04-09 Yannick Burkhardt , Qian Feng , Jianxiang Feng , Karan Sharma , Zhaopeng Chen , Alois Knoll

We present an attention based visual analysis framework to compute grasp-relevant information in order to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions…

Robotics · Computer Science 2018-09-13 Zhen Deng , Ge Gao , Simone Frintrop , Jianwei Zhang

We present a novel approach to robotic grasp planning using both a learned grasp proposal network and a learned 3D shape reconstruction network. Our system generates 6-DOF grasps from a single RGB-D image of the target object, which is…

Robotics · Computer Science 2020-11-09 Daniel Yang , Tarik Tosun , Ben Eisner , Volkan Isler , Daniel Lee

Robotic grasping is a fundamental capability for enabling autonomous manipulation, with usually infinite solutions. State-of-the-art approaches for grasping rely on learning from large-scale datasets comprising expert annotations of…

Robotics · Computer Science 2026-03-17 Manav Kulshrestha , S. Talha Bukhari , Damon Conover , Aniket Bera

Visual object tracking under challenging conditions of motion and light can be hindered by the capabilities of conventional cameras, prone to producing images with motion blur. Event cameras are novel sensors suited to robustly perform…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Irene Perez-Salesa , Rodrigo Aldana-Lopez , Carlos Sagues

We present a benchmarking study of vision-based robotic grasping algorithms with distinct approaches, and provide a comparative analysis. In particular, we compare two machine-learning-based and two analytical algorithms using an existing…

The ability to successfully grasp objects is crucial in robotics, as it enables several interactive downstream applications. To this end, most approaches either compute the full 6D pose for the object of interest or learn to predict a set…

Gathering real-world data from the robot quickly becomes a bottleneck when constructing a robot learning system for grasping. In this work, we design a semi-supervised grasping system that, on top of a small sample of robot experience,…

Robotics · Computer Science 2023-03-09 Piotr Krzywicki , Krzysztof Ciebiera , Rafał Michaluk , Inga Maziarz , Marek Cygan

A key challenge in scaling up robot learning to many skills and environments is removing the need for human supervision, so that robots can collect their own data and improve their own performance without being limited by the cost of…

Machine Learning · Computer Science 2017-03-14 Chelsea Finn , Sergey Levine

When performing manipulation-based activities such as picking objects, a mobile robot needs to position its base at a location that supports successful execution. To address this problem, prominent approaches typically rely on costly grasp…

Robotics · Computer Science 2024-05-28 Manish Saini , Melvin Paul Jacob , Minh Nguyen , Nico Hochgeschwender

This paper presents the first active object mapping framework for complex robotic manipulation and autonomous perception tasks. The framework is built on an object SLAM system integrated with a simultaneous multi-object pose estimation…

Robotics · Computer Science 2022-01-11 Yanmin Wu , Yunzhou Zhang , Delong Zhu , Xin Chen , Sonya Coleman , Wenkai Sun , Xinggang Hu , Zhiqiang Deng

Deep learning has significantly advanced computer vision and natural language processing. While there have been some successes in robotics using deep learning, it has not been widely adopted. In this paper, we present a novel robotic grasp…

Robotics · Computer Science 2017-07-25 Sulabh Kumra , Christopher Kanan

Event cameras are bio-inspired vision sensors that naturally capture the dynamics of a scene, filtering out redundant information. This paper presents a deep neural network approach that unlocks the potential of event cameras on a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Ana I. Maqueda , Antonio Loquercio , Guillermo Gallego , Narciso Garcia , Davide Scaramuzza

In order to function in unstructured environments, robots need the ability to recognize unseen novel objects. We take a step in this direction by tackling the problem of segmenting unseen object instances in tabletop environments. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Christopher Xie , Yu Xiang , Arsalan Mousavian , Dieter Fox

Learning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by…

Machine Learning · Computer Science 2018-03-06 Kuan Fang , Yunfei Bai , Stefan Hinterstoisser , Silvio Savarese , Mrinal Kalakrishnan

This paper proposes a visual-servoing method dedicated to grasping of daily-life objects. In order to obtain an affordable solution, we use a low-accurate robotic arm. Our method corrects errors by using an RGB-D sensor. It is based on SURF…

Robotics · Computer Science 2016-12-13 Ludovic Hofer , Michio Tanaka , Hakaru Tamukoh , Amir Ali Forough Nassiraei , Takashi Morie

We consider the problem of robotic grasping using depth + RGB information sampling from a real sensor. we design an encoder-decoder neural network to predict grasp policy in real time. This method can fuse the advantage of depth image and…

Robotics · Computer Science 2019-06-03 Song Yaoxian , Cheng Chun , Fei Yuejiao , Li Xiangqing , Yu Changbin

We introduce a novel robotic system for improving unseen object instance segmentation in the real world by leveraging long-term robot interaction with objects. Previous approaches either grasp or push an object and then obtain the…