English

High-Precision Transformer-Based Visual Servoing for Humanoid Robots in Aligning Tiny Objects

Computer Vision and Pattern Recognition 2026-01-06 v2 Robotics

Abstract

High-precision tiny object alignment remains a common and critical challenge for humanoid robots in real-world. To address this problem, this paper proposes a vision-based framework for precisely estimating and controlling the relative position between a handheld tool and a target object for humanoid robots, e.g., a screwdriver tip and a screw head slot. By fusing images from the head and torso cameras on a robot with its head joint angles, the proposed Transformer-based visual servoing method can correct the handheld tool's positional errors effectively, especially at a close distance. Experiments on M4-M8 screws demonstrate an average convergence error of 0.8-1.3 mm and a success rate of 93\%-100\%. Through comparative analysis, the results validate that this capability of high-precision tiny object alignment is enabled by the Distance Estimation Transformer architecture and the Multi-Perception-Head mechanism proposed in this paper.

Keywords

Cite

@article{arxiv.2503.04862,
  title  = {High-Precision Transformer-Based Visual Servoing for Humanoid Robots in Aligning Tiny Objects},
  author = {Jialong Xue and Wei Gao and Yu Wang and Chao Ji and Dongdong Zhao and Shi Yan and Shiwu Zhang},
  journal= {arXiv preprint arXiv:2503.04862},
  year   = {2026}
}

Comments

for associated video, see https://b23.tv/cklF7aK

R2 v1 2026-06-28T22:09:52.334Z