English
Related papers

Related papers: 6D Robotic Assembly Based on RGB-only Object Pose …

200 papers

This work presents a framework for monocular 6D pose estimation of surgical instruments in open surgery, addressing challenges such as object articulations, specularity, occlusions, and synthetic-to-real domain adaptation. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Robert Spektor , Tom Friedman , Itay Or , Gil Bolotin , Shlomi Laufer

We introduce a new approach for robotic manipulation tasks in human settings that necessitates understanding the 3D geometric connections between a pair of objects. Conventional end-to-end training approaches, which convert pixel…

Robotics · Computer Science 2024-05-22 Xuxin Cheng , Heng Yu , Harry Zhang , Wenxing Deng

The accurate estimation of six degrees-of-freedom (6DoF) object poses is essential for many applications in robotics and augmented reality. However, existing methods for 6DoF pose estimation often depend on CAD templates or dense support…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Panwang Pan , Zhiwen Fan , Brandon Y. Feng , Peihao Wang , Chenxin Li , Zhangyang Wang

6D object pose estimation networks are limited in their capability to scale to large numbers of object instances due to the close-set assumption and their reliance on high-fidelity object CAD models. In this work, we study a new open set…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yisheng He , Yao Wang , Haoqiang Fan , Jian Sun , Qifeng Chen

6D object pose estimation remains challenging for many applications due to dependencies on complete 3D models, multi-view images, or training limited to specific object categories. These requirements make generalization to novel objects…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Mengya Liu , Siyuan Li , Ajad Chhatkuli , Prune Truong , Luc Van Gool , Federico Tombari

In this work we propose a learning approach to high-precision robotic assembly problems. We focus on the contact-rich phase, where the assembly pieces are in close contact with each other. Unlike many learning-based approaches that heavily…

Robotics · Computer Science 2021-08-03 Jieliang Luo , Hui Li

Interactive and spatially aware technologies are transforming educational frameworks, particularly in K-12 settings where hands-on exploration fosters deeper conceptual understanding. However, during collaborative tasks, existing systems…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Changsoo Jung , Sheikh Mannan , Jack Fitzgerald , Nathaniel Blanchard

Accurate knowledge of object poses is crucial to successful robotic manipulation tasks, and yet most current approaches only work in laboratory settings. Noisy sensors and cluttered scenes interfere with accurate pose recognition, which is…

Robotics · Computer Science 2017-10-12 Felix Jonathan , Chris Paxton , Gregory D. Hager

Robotic systems often require precise scene analysis capabilities, especially in unstructured, cluttered situations, as occurring in human-made environments. While current deep-learning based methods yield good estimates of object poses,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-09 Arul Selvam Periyasamy , Max Schwarz , Sven Behnke

In this work, motivated by recent manufacturing trends, we investigate autonomous robotic assembly. Industrial assembly tasks require contact-rich manipulation skills, which are challenging to acquire using classical control and motion…

Robotics · Computer Science 2018-07-26 Garrett Thomas , Melissa Chien , Aviv Tamar , Juan Aparicio Ojea , Pieter Abbeel

Object 6D pose estimation is an important research topic in the field of computer vision due to its wide application requirements and the challenges brought by complexity and changes in the real-world. We think fully exploring the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Weitong Hua , Jiaxin Guo , Yue Wang , Rong Xiong

State estimation from measured data is crucial for robotic applications as autonomous systems rely on sensors to capture the motion and localize in the 3D world. Among sensors that are designed for measuring a robot's pose, or for soft…

Robotics · Computer Science 2023-02-28 Jingpei Lu , Fei Liu , Cedric Girerd , Michael C. Yip

Creating mobile robots which are able to find and manipulate objects in large environments is an active topic of research. These robots not only need to be capable of searching for specific objects but also to estimate their poses often…

Robotics · Computer Science 2022-03-09 Jascha Hellwig , Mark Baierl , Joao Carvalho , Julen Urain , Jan Peters

Recent learning methods for object pose estimation require resource-intensive training for each individual object instance or category, hampering their scalability in real applications when confronted with previously unseen objects. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Junwen Huang , Hao Yu , Kuan-Ting Yu , Nassir Navab , Slobodan Ilic , Benjamin Busam

We present an approach for recognizing all objects in a scene and estimating their full pose from an accurate 3D instance-aware semantic reconstruction using an RGB-D camera. Our framework couples convolutional neural networks (CNNs) and a…

Robotics · Computer Science 2019-10-01 Dinh-Cuong Hoang , Todor Stoyanov , Achim J. Lilienthal

Deep object pose estimators are notoriously overconfident. A grasping agent that both estimates the 6-DoF pose of a target object and predicts the uncertainty of its own estimate could avoid task failure by choosing not to act under high…

Robotics · Computer Science 2025-06-27 Eric C. Joyce , Qianwen Zhao , Nathaniel Burgdorfer , Long Wang , Philippos Mordohai

Assistive robotic systems endeavour to support those with movement disabilities, enabling them to move again and regain functionality. Main issue with these systems is the complexity of their low-level control, and how to translate this to…

Robotics · Computer Science 2019-03-07 Ali Shafti , Pavel Orlov , A. Aldo Faisal

A critical goal in robotics and autonomy is to teach robots to adapt to real-world collaborative tasks, particularly in automatic assembly. The ability of a robot to understand the original intent of an incomplete assembly and complete…

Robotics · Computer Science 2024-10-22 Alan Chen , Changliu Liu

In the industrial domain, the pose estimation of multiple texture-less shiny parts is a valuable but challenging task. In this particular scenario, it is impractical to utilize keypoints or other texture information because most of them are…

Robotics · Computer Science 2019-09-27 Chen Chen , Xin Jiang , Weiguo Zhou , Yun-Hui Liu

Robot pose estimation is a challenging and crucial task for vision-based surgical robotic automation. Typical robotic calibration approaches, however, are not applicable to surgical robots, such as the da Vinci Research Kit (dVRK), due to…

Robotics · Computer Science 2025-03-11 Zekai Liang , Zih-Yun Chiu , Florian Richter , Michael C. Yip