English
Related papers

Related papers: Realtime State Estimation with Tactile and Visual …

200 papers

Compared to rigid hands, underactuated compliant hands offer greater adaptability to object shapes, provide stable grasps, and are often more cost-effective. However, they introduce uncertainties in hand-object interactions due to their…

Robotics · Computer Science 2025-03-04 Osher Azulay , Dhruv Metha Ramesh , Nimrod Curtis , Avishai Sintov

This paper proposes a novel active visuo-tactile based methodology wherein the accurate estimation of the time-invariant SE(3) pose of objects is considered for autonomous robotic manipulators. The robot equipped with tactile sensors on the…

Robotics · Computer Science 2021-08-10 Prajval Kumar Murali , Michael Gentner , Mohsen Kaboli

Deformable object manipulation is a classical and challenging research area in robotics. Compared with rigid object manipulation, this problem is more complex due to the deformation properties including elastic, plastic, and elastoplastic…

Robotic manipulation in industrial scenarios such as construction commonly faces uncertain observations in which the state of the manipulating object may not be accurately captured due to occlusions and partial observables. For example,…

Robotics · Computer Science 2025-05-23 Xiao Hu , Yang Ye

Knowledge of 3-D object shape is of great importance to robot manipulation tasks, but may not be readily available in unstructured environments. While vision is often occluded during robot-object interaction, high-resolution tactile sensors…

Robotics · Computer Science 2022-03-11 Sudharshan Suresh , Zilin Si , Joshua G. Mangelson , Wenzhen Yuan , Michael Kaess

Coordinating proximity and tactile imaging by collocating cameras with tactile sensors can 1) provide useful information before contact such as object pose estimates and visually servo a robot to a target with reduced occlusion and higher…

Robotics · Computer Science 2022-04-29 Arkadeep Narayan Chaudhury , Timothy Man , Wenzhen Yuan , Christopher G. Atkeson

Data-driven approaches to tactile sensing aim to overcome the complexity of accurately modeling contact with soft materials. However, their widespread adoption is impaired by concerns about data efficiency and the capability to generalize…

Robotics · Computer Science 2020-03-06 Carmelo Sferrazza , Thomas Bi , Raffaello D'Andrea

This work deals with a practical everyday problem: stable object placement on flat surfaces starting from unknown initial poses. Common object-placing approaches require either complete scene specifications or extrinsic sensor measurements,…

Accurate estimation of the relative pose between an object and a robot hand is critical for many manipulation tasks. However, most of the existing object-in-hand pose datasets use two-finger grippers and also assume that the object remains…

Robotics · Computer Science 2023-04-11 Yuyang Tu , Junnan Jiang , Shuang Li , Norman Hendrich , Miao Li , Jianwei Zhang

We investigate how high-resolution tactile sensors can be utilized in combination with vision and depth sensing, to improve grasp stability prediction. Recent advances in simulating high-resolution tactile sensing, in particular the TACTO…

Robotics · Computer Science 2022-06-14 Lachlan Chumbley , Morris Gu , Rhys Newbury , Jurgen Leitner , Akansel Cosgun

Robust and precise robotic assembly entails insertion of constituent components. Insertion success is hindered when noise in scene understanding exceeds tolerance limits, especially when fabricated with tight tolerances. In this work, we…

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

Object pose estimation methods allow finding locations of objects in unstructured environments. This is a highly desired skill for autonomous robot manipulation as robots need to estimate the precise poses of the objects in order to…

Robotics · Computer Science 2022-03-22 Tarik Kelestemur , Robert Platt , Taskin Padir

Detection of slip during object grasping and manipulation plays a vital role in object handling. Existing solutions primarily rely on visual information to devise a strategy for grasping. However, for robotic systems to attain a level of…

We introduce a novel approach that combines tactile estimation and control for in-hand object manipulation. By integrating measurements from robot kinematics and an image-based tactile sensor, our framework estimates and tracks object pose…

Robotics · Computer Science 2024-01-23 Antonia Bronars , Sangwoon Kim , Parag Patre , Alberto Rodriguez

Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. Our tactile sensing provides us with a lot of information regarding contact formations as well as geometric information about objects during any…

Robotics · Computer Science 2023-06-06 Kei Ota , Devesh K. Jha , Hsiao-Yu Tung , Joshua B. Tenenbaum

Contact-rich manipulation is difficult for robots to execute and requires accurate perception of the environment. In some scenarios, vision is occluded. The robot can then no longer obtain real-time scene state information through visual…

Robotics · Computer Science 2026-01-27 Gaozhao Wang , Xing Liu , Zhenduo Ye , Zhengxiong Liu , Panfeng Huang

Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on…

Robotics · Computer Science 2024-09-24 Jose A. Eyzaguirre , Miquel Oller , Nima Fazeli

Robust manipulation often hinges on a robot's ability to perceive extrinsic contacts-contacts between a grasped object and its surrounding environment. However, these contacts are difficult to observe through vision alone due to occlusions,…

Robotics · Computer Science 2025-10-01 Xili Yi , Jayjun Lee , Nima Fazeli

Dense collections of movable objects are common in everyday spaces-from cabinets in a home to shelves in a warehouse. Safely retracting objects from such collections is difficult for robots, yet people do it frequently, leveraging learned…

Robotics · Computer Science 2025-12-02 Dane Brouwer , Joshua Citron , Heather Nolte , Jeannette Bohg , Mark Cutkosky