English
Related papers

Related papers: High-Precision Transformer-Based Visual Servoing f…

200 papers

Visual servoing is a well-known task in robotics. However, there are still challenges when multiple visual sources are combined to accurately guide the robot or occlusions appear. In this paper we present a novel visual servoing approach…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hanz Cuevas-Velasquez , Nanbo Li , Radim Tylecek , Marcelo Saval-Calvo , Robert B. Fisher

Accurate in-hand pose estimation is crucial for robotic object manipulation, but visual occlusion remains a major challenge for vision-based approaches. This paper presents an approach to robotic in-hand object pose estimation, combining…

Robotics · Computer Science 2025-06-13 Felix Nonnengießer , Alap Kshirsagar , Boris Belousov , Jan Peters

This study presents a vision-guided robotic control system for automated fruit tree pruning applications. Traditional pruning practices are labor-intensive and limit agricultural efficiency and scalability, highlighting the need for…

Robotics · Computer Science 2025-06-09 Dawood Ahmed , Basit Muhammad Imran , Martin Churuvija , Manoj Karkee

Humans are remarkably proficient at controlling their limbs and tools from a wide range of viewpoints and angles, even in the presence of optical distortions. In robotics, this ability is referred to as visual servoing: moving a tool or…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Fereshteh Sadeghi , Alexander Toshev , Eric Jang , Sergey Levine

Many works in collaborative robotics and human-robot interaction focuses on identifying and predicting human behaviour while considering the information about the robot itself as given. This can be the case when sensors and the robot are…

Vision-based control systems, such as image-based visual servoing (IBVS), have been extensively explored for precise robot manipulation. A persistent challenge, however, is maintaining robust target tracking under partial or full…

Robotics · Computer Science 2025-10-30 Jee Won Lee , Hansol Lim , Sooyeun Yang , Jongseong Brad Choi

Robots need the capability of placing objects in arbitrary, specific poses to rearrange the world and achieve various valuable tasks. Object reorientation plays a crucial role in this as objects may not initially be oriented such that the…

Robotics · Computer Science 2022-02-23 Kentaro Wada , Stephen James , Andrew J. Davison

In everyday life collaboration tasks between human operators and robots, the former necessitate simple ways for programming new skills, the latter have to show adaptive capabilities to cope with environmental changes. The joint use of…

Robotics · Computer Science 2023-09-15 Rocco Felici , Matteo Saveriano , Loris Roveda , Antonio Paolillo

This paper presents a novel manipulation strategy that uses keypoint correspondences extracted from visuo-tactile sensor images to facilitate precise object manipulation. Our approach uses the visuo-tactile feedback to guide the robot's…

Robotics · Computer Science 2024-05-24 Jeong-Jung Kim , Doo-Yeol Koh , Chang-Hyun Kim

Learning to solve precision-based manipulation tasks from visual feedback using Reinforcement Learning (RL) could drastically reduce the engineering efforts required by traditional robot systems. However, performing fine-grained motor…

Robotics · Computer Science 2022-01-21 Rishabh Jangir , Nicklas Hansen , Sambaran Ghosal , Mohit Jain , Xiaolong Wang

In this paper, we propose a method to align and place a fabric piece on top of another using a dual-arm manipulator and a grayscale camera, so that their surface textures are accurately matched. We propose a novel control scheme that…

Robotics · Computer Science 2025-12-29 Fuyuki Tokuda , Akira Seino , Akinari Kobayashi , Kai Tang , Kazuhiro Kosuge

This work proposes a fast deployment pipeline for visually-servoed robots which does not assume anything about either the robot - e.g. sizes, colour or the presence of markers - or the deployment environment. In this, accurate estimation of…

Robotics · Computer Science 2023-06-27 Luke Robinson , Daniele De Martini , Matthew Gadd , Paul Newman

Precision is a crucial performance indicator for robot arms, as high precision manipulation allows for a wider range of applications. Traditional methods for improving robot arm precision rely on error compensation. However, these methods…

Robotics · Computer Science 2023-02-28 Qu Weiming , Liu Tianlin , Luo Dingsheng

The robotic manipulation of deformable linear objects has shown great potential in a wide range of real-world applications. However, it presents many challenges due to the objects' complex nonlinearity and high-dimensional configuration. In…

Robotics · Computer Science 2023-09-12 Jiaming Qi , Guangtao Ran , Bohui Wang , Jian Liu , Wanyu Ma , Peng Zhou , David Navarro-Alarcon

Hand-eye calibration, as a fundamental task in vision-based robotic systems, aims to estimate the transformation matrix between the coordinate frame of the camera and the robot flange. Most approaches to hand-eye calibration rely on…

Robotics · Computer Science 2024-09-06 Leihui Li , Xingyu Yang , Riwei Wang , Xuping Zhang

We propose a visual servoing method consisting of a detection network and a velocity trajectory planner. First, the detection network estimates the objects position and orientation in the image space. Furthermore, these are normalized and…

Robotics · Computer Science 2024-12-13 Constantin Schempp , Christian Friedrich

Visual servoing, the method of controlling robot motion through feedback from visual sensors, has seen significant advancements with the integration of optical flow-based methods. However, its application remains limited by inherent…

It is challenging for humans -- particularly those living with physical disabilities -- to control high-dimensional, dexterous robots. Prior work explores learning embedding functions that map a human's low-dimensional inputs (e.g., via a…

Robotics · Computer Science 2021-05-04 Siddharth Karamcheti , Albert J. Zhai , Dylan P. Losey , Dorsa Sadigh

This paper presents a new dual quaternion-based formulation for pose-based visual servoing. Extending our previous work on local contact moment (LoCoMo) based grasp planning, we demonstrate grasping of arbitrarily moving objects in 3D…

Robotics · Computer Science 2021-07-20 Cristiana de Farias , Maxime Adjigble , Brahim Tamadazte , Rustam Stolkin , Naresh Marturi

Traditional visual servoing methods suffer from serving between scenes from multiple perspectives, which humans can complete with visual signals alone. In this paper, we investigated how multi-perspective visual servoing could be solved…

Robotics · Computer Science 2023-12-27 Lei Zhang , Jiacheng Pei , Kaixin Bai , Zhaopeng Chen , Jianwei Zhang