English
Related papers

Related papers: Image-to-Force Estimation for Soft Tissue Interact…

200 papers

Soft bodies made from flexible and deformable materials are popular in many robotics applications, but their proprioceptive sensing has been a long-standing challenge. In other words, there has hardly been a method to measure and model the…

Robotics · Computer Science 2019-12-09 Ruoyu Wang , Shiheng Wang , Songyu Du , Erdong Xiao , Wenzhen Yuan , Chen Feng

While visuomotor policy learning has advanced robotic manipulation, precisely executing contact-rich tasks remains challenging due to the limitations of vision in reasoning about physical interactions. To address this, recent work has…

Robotics · Computer Science 2024-10-29 Venkatesh Pattabiraman , Yifeng Cao , Siddhant Haldar , Lerrel Pinto , Raunaq Bhirangi

To perform complex tasks, robots must be able to interact with and manipulate their surroundings. One of the key challenges in accomplishing this is robust state estimation during physical interactions, where the state involves not only the…

Microsurgery involves the dexterous manipulation of delicate tissue or fragile structures such as small blood vessels, nerves, etc., under a microscope. To address the limitation of imprecise manipulation of human hands, robotic systems…

Robotics · Computer Science 2023-11-20 Jialin Lin , Xiaoqing Guo , Wen Fan , Wei Li , Yuanyi Wang , Jiaming Liang , Weiru Liu , Lei Wei , Dandan Zhang

This study presents an innovative computer vision framework designed to analyze human movements in industrial settings, aiming to enhance biomechanical analysis by integrating seamlessly with existing software. Through a combination of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Jesudara Omidokun , Darlington Egeonu , Bochen Jia , Liang Yang

We study the problem of learning physical object representations for robot manipulation. Understanding object physics is critical for successful object manipulation, but also challenging because physical object properties can rarely be…

Robotics · Computer Science 2019-06-13 Zhenjia Xu , Jiajun Wu , Andy Zeng , Joshua B. Tenenbaum , Shuran Song

In image-assisted minimally invasive surgeries (MIS), understanding surgical scenes is vital for real-time feedback to surgeons, skill evaluation, and improving outcomes through collaborative human-robot procedures. Within this context, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mithun Parab , Pranay Lendave , Jiyoung Kim , Thi Quynh Dan Nguyen , Palash Ingle

Soft lubricated contacts exhibit complex interfacial behaviours governed by the coupled effects of multiscale surface roughness and non-linear fluid-solid interactions. Accurately capturing this interplay across thin-film flows is…

Soft Condensed Matter · Physics 2025-11-12 Qian Wang , Suhaib Ardah , Tom Reddyhoff , Daniele Dini

This paper introduces the methodology proposed by our group to model the biological soft tissues deformations and to couple these models with Computer-Assisted Surgical (CAS) applications. After designing CAS protocols that mainly focused…

Robotic disassembly involves contact-rich interactions in which successful manipulation depends not only on geometric alignment but also on force-dependent state transitions. While vision-based policies perform well in structured settings,…

Vision-based tactile sensors, through high-resolution optical measurements, can effectively perceive the geometric shape of objects and the force information during the contact process, thus helping robots acquire higher-dimensional tactile…

Robotics · Computer Science 2026-03-06 Xi Lin , Weiliang Xu , Yixian Mao , Jing Wang , Meixuan Lv , Lu Liu , Xihui Luo , Xinming Li

Advanced dexterous manipulation involving multiple simultaneous contacts across different surfaces, like pinching coins from ground or manipulating intertwined objects, remains challenging for robotic systems. Such tasks exceed the…

Robotics · Computer Science 2025-06-11 Won Kyung Do , Matthew Strong , Aiden Swann , Boshu Lei , Monroe Kennedy

For soft continuum arms, visual servoing is a popular control strategy that relies on visual feedback to close the control loop. However, robust visual servoing is challenging as it requires reliable feature extraction from the image,…

Grasping compliant objects is difficult for robots - applying too little force may cause the grasp to fail, while too much force may lead to object damage. A robot needs to apply the right amount of force to quickly and confidently grasp…

Robotics · Computer Science 2024-01-17 Maceon Knopke , Liguo Zhu , Peter Corke , Fangyi Zhang

Based on point spread function (PSF) engineering and astigmatism due to a pair of cylindrical lenses, a novel compressed imaging mechanism is proposed to achieve single-shot incoherent 3D imaging. The speckle-like PSF of the imaging system…

Optics · Physics 2021-05-24 Qiong Gao , Weidong Qu , Ming Shao , Wei Liu , Xiangzheng Cheng

Robotic assistance has significantly improved the outcomes of open microsurgery and rigid endoscopic surgery, however is yet to make an impact in flexible endoscopic neurosurgery. Some of the most common intracranial procedures for…

Robotics · Computer Science 2024-04-23 Kieran Gilday , Irena Zubak , Andreas Raabe , Josie Hughes

There is a growing need for soft robotic platforms that perform gentle, precise handling of a wide variety of objects. Existing surface-based manipulation systems, however, lack the compliance and tactile feedback needed for delicate…

Robotics · Computer Science 2026-02-25 Gayatri Indukumar , Muhammad Awais , Diana Cafiso , Matteo Lo Preti , Lucia Beccai

Tactile sensing plays an important role in robotic perception and manipulation tasks. To overcome the real-world limitations of data collection, simulating tactile response in a virtual environment comes as a desirable direction of robotic…

Robotics · Computer Science 2021-08-21 Yikai Wang , Wenbing Huang , Bin Fang , Fuchun Sun , Chang Li

The deployment of complex soft robots in multiphysics environments requires advanced simulation frameworks that not only capture interactions between different types of material, but also translate accurately to real-world performance. Soft…

Robotics · Computer Science 2026-03-09 Manuel Mekkattu , Mike Y. Michelis , Robert K. Katzschmann

The importance of force perception in interacting with the environment was proven years ago. However, it is still a challenge to measure the contact force distribution accurately in real-time. In order to break through this predicament, we…

Robotics · Computer Science 2022-02-15 Lunwei Zhang , Yue Wang , Yao Jiang