English
Related papers

Related papers: Gradient based Grasp Pose Optimization on a NeRF t…

200 papers

The method of deep learning has achieved excellent results in improving the performance of robotic grasping detection. However, the deep learning methods used in general object detection are not suitable for robotic grasping detection.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Hu Cao , Guang Chen , Zhijun Li , Jianjie Lin , Alois Knoll

Applications that interact with the real world such as augmented reality or robot manipulation require a good understanding of the location and pose of the surrounding objects. In this paper, we present a new approach to estimate the 6…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Daniel Mas Montserrat , Jianhang Chen , Qian Lin , Jan P. Allebach , Edward J. Delp

We present a new dataset for 6-DoF pose estimation of known objects, with a focus on robotic manipulation research. We propose a set of toy grocery objects, whose physical instantiations are readily available for purchase and are…

Robotics · Computer Science 2022-12-19 Stephen Tyree , Jonathan Tremblay , Thang To , Jia Cheng , Terry Mosier , Jeffrey Smith , Stan Birchfield

General object grasping is an important yet unsolved problem in the field of robotics. Most of the current methods either generate grasp poses with few DoF that fail to cover most of the success grasps, or only take the unstable depth image…

Robotics · Computer Science 2021-03-04 Minghao Gou , Hao-Shu Fang , Zhanda Zhu , Sheng Xu , Chenxi Wang , Cewu Lu

Neural Radiance Fields, or NeRFs, have drastically improved novel view synthesis and 3D reconstruction for rendering. NeRFs achieve impressive results on object-centric reconstructions, but the quality of novel view synthesis with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Georgios Kopanas , George Drettakis

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

We propose a novel algorithm for the fitting of 3D human shape to images. Combining the accuracy and refinement capabilities of iterative gradient-based optimization techniques with the robustness of deep neural networks, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jie Song , Xu Chen , Otmar Hilliges

Robotic grasping aims to detect graspable points and their corresponding gripper configurations in a particular scene, and is fundamental for robot manipulation. Existing research works have demonstrated the potential of using a transformer…

Robotics · Computer Science 2023-01-31 Zhenjie Zhao , Hang Yu , Hang Wu , Xuebo Zhang

This paper aims to improve robots' versatility and adaptability by allowing them to use a large variety of end-effector tools and quickly adapt to new tools. We propose AdaGrasp, a method to learn a single grasping policy that generalizes…

Robotics · Computer Science 2021-03-16 Zhenjia Xu , Beichun Qi , Shubham Agrawal , Shuran Song

Grasping of novel objects in pick and place applications is a fundamental and challenging problem in robotics, specifically for complex-shaped objects. It is observed that the well-known strategies like \textit{i}) grasping from the…

Robotics · Computer Science 2020-01-08 Mohit Vohra , Ravi Prakash , Laxmidhar Behera

In this research, we introduce a deep reinforcement learning-based control approach to address the intricate challenge of the robotic pre-grasping phase under microgravity conditions. Leveraging reinforcement learning eliminates the…

Robotics · Computer Science 2024-12-16 Bahador Beigomi , Zheng H. Zhu

This paper considers the problem of grasp pose detection in point clouds. We follow a general algorithmic structure that first generates a large set of 6-DOF grasp candidates and then classifies each of them as a good or a bad grasp. Our…

Robotics · Computer Science 2017-06-23 Marcus Gualtieri , Andreas ten Pas , Kate Saenko , Robert Platt

We present a novel optimization algorithm called DroNeRF for the autonomous positioning of monocular camera drones around an object for real-time 3D reconstruction using only a few images. Neural Radiance Fields or NeRF, is a novel view…

Robotics · Computer Science 2023-08-08 Dipam Patel , Phu Pham , Aniket Bera

Neural radiance field (NeRF) has achieved impressive results in high-quality 3D scene reconstruction. However, NeRF heavily relies on precise camera poses. While recent works like BARF have introduced camera pose optimization within NeRF,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Yunlong Ran , Yanxu Li , Qi Ye , Yuchi Huo , Zechun Bai , Jiahao Sun , Jiming Chen

Grasping by a robot in unstructured environments is deemed a critical challenge because of the requirement for effective adaptation to a wide variation in object geometries, material properties, and other environmental factors. In this…

Robotics · Computer Science 2024-11-20 Leonidas Askianakis

Recent progress in large-scale scene rendering has yielded Neural Radiance Fields (NeRF)-based models with an impressive ability to synthesize scenes across small objects and indoor scenes. Nevertheless, extending this idea to large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Xiaohan Zhang , Yukui Qiu , Zhenyu Sun , Qi Liu

For many robotic manipulation and contact tasks, it is crucial to accurately estimate uncertain object poses, for which certain geometry and sensor information are fused in some optimal fashion. Previous results for this problem primarily…

Robotics · Computer Science 2023-05-29 Jeongmin Lee , Minji Lee , Dongjun Lee

Neural Radiance Fields (NeRFs) have become a widely-applied scene representation technique in recent years, showing advantages for robot navigation and manipulation tasks. To further advance the utility of NeRFs for robotics, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jiankai Sun , Yan Xu , Mingyu Ding , Hongwei Yi , Chen Wang , Jingdong Wang , Liangjun Zhang , Mac Schwager

Grasping algorithms have evolved from planar depth grasping to utilizing point cloud information, allowing for application in a wider range of scenarios. However, data-driven grasps based on models trained on basic open-source datasets may…

Robotics · Computer Science 2023-10-31 Xiao Hu , Xiangsheng Chen

In this paper, we present a novel method for self-supervised fine-tuning of pose estimation. Leveraging zero-shot pose estimation, our approach enables the robot to automatically obtain training data without manual labeling. After pose…

Robotics · Computer Science 2024-12-13 Frederik Hagelskjær