English
Related papers

Related papers: 3D-ViTac: Learning Fine-Grained Manipulation with …

200 papers

Reproducing the capabilities of the human sense of touch in machines is an important step in enabling robot manipulation to have the ease of human dexterity. A combination of robotic technologies will be needed, including soft robotics,…

Robotics · Computer Science 2021-07-23 Nathan F. Lepora

Bimanual dexterous manipulation remains significant challenges in robotics due to the high DoFs of each hand and their coordination. Existing single-hand manipulation techniques often leverage human demonstrations to guide RL methods but…

Robotics · Computer Science 2025-12-29 Zhengnan Sun , Zhaotai Shi , Jiayin Chen , Qingtao Liu , Yu Cui , Qi Ye , Jiming Chen

Dexterous manipulation requires precise geometric reasoning, yet existing visuo-tactile learning methods struggle with sub-millimeter precision tasks that are routine for traditional model-based approaches. We identify a key limitation:…

Robotics · Computer Science 2026-02-27 Jialei Huang , Yang Ye , Yuanqing Gong , Xuezhou Zhu , Yang Gao , Kaifeng Zhang

Tactile sensing plays a fundamental role in enabling robots to navigate dynamic and unstructured environments, particularly in applications such as delicate object manipulation, surface exploration, and human-robot interaction. In this…

Robotics · Computer Science 2025-09-18 Annan Zhang , Miguel Flores-Acton , Andy Yu , Anshul Gupta , Maggie Yao , Daniela Rus

High-resolution optical tactile sensors are increasingly used in robotic learning environments due to their ability to capture large amounts of data directly relating to agent-environment interaction. However, there is a high barrier of…

Robotics · Computer Science 2022-07-28 Yijiong Lin , John Lloyd , Alex Church , Nathan F. Lepora

Distributed tactile sensing for multi-force detection is crucial for various aerial robot interaction tasks. However, current contact sensing solutions on drones only exploit single end-effector sensors and cannot provide distributed…

Robotics · Computer Science 2024-10-28 Emanuele Aucone , Carmelo Sferrazza , Manuel Gregor , Raffaello D'Andrea , Stefano Mintchev

Optical tactile sensors have recently become popular. They provide high spatial resolution, but struggle to offer fine temporal resolutions. To overcome this shortcoming, we study the idea of replacing the RGB camera with an event-based…

Robotics · Computer Science 2024-08-16 Niklas Funk , Erik Helmut , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

The tactile sensing capabilities of human hands are essential in performing daily activities. Simultaneously perceiving normal and shear forces via the mechanoreceptors integrated into the hands enables humans to achieve daily tasks like…

Robotics · Computer Science 2022-06-20 Zeyu Lu , Xingyu Gao , Haoyong Yu

Stable and robust robotic grasping is essential for current and future robot applications. In recent works, the use of large datasets and supervised learning has enhanced speed and precision in antipodal grasping. However, these methods…

Robotics · Computer Science 2025-02-28 Boya Zhang , Iris Andrussow , Andreas Zell , Georg Martius

Tactile sensing is a widely-studied means of implicit communication between robot and human. In this paper, we investigate how tactile sensing can help bridge differences between robotic embodiments in the context of collaborative…

Robotics · Computer Science 2025-09-17 William van den Bogert , Madhavan Iyengar , Nima Fazeli

Rich contact perception is crucial for robotic manipulation, yet traditional tactile skins remain expensive and complex to integrate. This paper presents a scalable alternative: high-accuracy whole-body touch localization via vibro-acoustic…

Robotics · Computer Science 2026-01-29 Wadhah Zai El Amri , Nicolás Navarro-Guerrero

Data-driven approaches struggle with precise manipulation; imitation learning requires many hard-to-obtain demonstrations, while reinforcement learning yields brittle, non-generalizable policies. We introduce VisuoTactile Local (ViTaL)…

Robotics · Computer Science 2025-06-17 Zifan Zhao , Siddhant Haldar , Jinda Cui , Lerrel Pinto , Raunaq Bhirangi

Robots operating in human-centered environments, such as retail stores, restaurants, and households, are often required to distinguish between similar objects in different contexts with a high degree of accuracy. However, fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Songsong Xiong , Georgios Tziafas , Hamidreza Kasaei

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is…

Robotics · Computer Science 2022-03-30 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

Adaptive control for real-time manipulation requires quick estimation and prediction of object properties. While robot learning in this area primarily focuses on using vision, many tasks cannot rely on vision due to object occlusion. Here,…

Robotics · Computer Science 2021-10-12 Ahalya Prabhakar , Stanislas Furrer , Lorenzo Panchetti , Maxence Perret , Aude Billard

Aiming to replicate human-like dexterity, perceptual experiences, and motion patterns, we explore learning from human demonstrations using a bimanual system with multifingered hands and visuotactile data. Two significant challenges exist:…

Robotics · Computer Science 2024-05-24 Toru Lin , Yu Zhang , Qiyang Li , Haozhi Qi , Brent Yi , Sergey Levine , Jitendra Malik

Incorporating effective tactile sensing and mechanical compliance is key towards enabling robust and safe operation of robots in unknown, uncertain and cluttered environments. Towards realizing this goal, we present a lightweight,…

Robotics · Computer Science 2019-04-05 Alex Alspach , Kunimatsu Hashimoto , Naveen Kuppuswamy , Russ Tedrake

Soft robots are powerful tools for manipulating delicate objects, yet their adoption is hindered by two gaps: the lack of integrated tactile sensing and sensor signal distortion caused by actuator deformations. This paper addresses these…

Robotics · Computer Science 2025-12-04 Chengjin Du , Federico Bernabei , Zhengyin Du , Sergio Decherchi , Matteo Lo Preti , Lucia Beccai

Tactile sensing is crucial for robotic hands to achieve human-level dexterous manipulation, especially in scenarios with visual occlusion. However, its application is often hindered by the difficulty of collecting large-scale real-world…

Robotics · Computer Science 2025-12-30 Chi Zhang , Penglin Cai , Haoqi Yuan , Chaoyi Xu , Zongqing Lu

Telerobotics enables humans to overcome spatial constraints and physically interact with the environment in remote locations. However, the sensory feedback provided by the system to the user is often purely visual, limiting the user's…