English
Related papers

Related papers: Learning User Interaction Forces using Vision for …

200 papers

Haptic feedback to the surgeon during robotic surgery would enable safer and more immersive surgeries but estimating tissue interaction forces at the tips of robotically controlled surgical instruments has proven challenging. Few existing…

Robotics · Computer Science 2024-10-01 Hao Yang , Haoying Zhou , Gregory S. Fischer , Jie Ying Wu

Robotic manipulation of highly deformable cloth presents a promising opportunity to assist people with several daily tasks, such as washing dishes; folding laundry; or dressing, bathing, and hygiene assistance for individuals with severe…

Robotics · Computer Science 2022-08-12 Yufei Wang , David Held , Zackory Erickson

Perception is essential for the active interaction of physical agents with the external environment. The integration of multiple sensory modalities, such as touch and vision, enhances this perceptual process, creating a more comprehensive…

Robotics · Computer Science 2025-02-10 Enrico Donato , Egidio Falotico , Thomas George Thuruthel

Over the past decades, we have witnessed a rapid emergence of soft and reconfigurable robots thanks to their capability to interact safely with humans and adapt to complex environments. However, their softness makes accurate control very…

Robotics · Computer Science 2024-11-13 Jun Wang , Zhi Qiao , Wenlong Zhang , Suyi Li

This paper presents a sensorized vision-enabled prosthetic hand aimed at replicating a natural hand's performance, functionality, appearance, and comfort. The design goal was to create an accessible substitution with a user-friendly…

Human-Computer Interaction · Computer Science 2024-07-23 Md Abdul Baset Sarker , Juan Pablo S. Sola , Aaron Jones , Evan Laing , Ernesto Sola-Thomas , Masudul H. Imtiaz

Haptic feedback has been a long-missed feature in robotic-assisted surgery, one that would allow surgeons to perceive tissue properties and apply controlled forces during delicate procedures. Although commercial robotic systems have begun…

Robotics · Computer Science 2026-04-28 Walid Shaker , Mustafa Suphi Erden

Recently, soft actuator-based exosuits have gained interest, due to their high strength-to-weight ratio, inherent safety, and low cost. We present a novel wrist exosuit actuated by fabric pneumatic artificial muscles that has lightweight…

Robotics · Computer Science 2024-04-15 Katalin Schäffer , Yasemin Ozkan-Aydin , Margaret M. Coad

Interest in soft continuum arms has increased as their inherent material elasticity enables safe and adaptive interactions with the environment. However to achieve full autonomy in these arms, accurate three-dimensional shape sensing is…

Robotics · Computer Science 2024-10-30 Ali AlBeladi , Girish Krishnan , Mohamed-Ali Belabbas , Seth Hutchinson

Contact feedback is essential for contact-rich robotic manipulation, as it allows the robot to detect subtle interaction changes and adjust its actions accordingly. Six-axis force-torque sensors are commonly used to obtain contact feedback,…

Robotics · Computer Science 2025-12-12 Jinxuan Zhu , Zihao Yan , Yangyu Xiao , Jingxiang Guo , Chenrui Tie , Xinyi Cao , Yuhang Zheng , Lin Shao

For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact.…

We introduce SoftAct, a framework for teaching soft robot hands to perform human-like manipulation skills by explicitly reasoning about contact forces. Leveraging immersive virtual reality, our system captures rich human demonstrations,…

Contact-rich manipulation demands human-like integration of perception and force feedback: vision should guide task progress, while high-frequency interaction control must stabilize contact under uncertainty. Existing learning-based…

Controlling fine-grained forces during manipulation remains a core challenge in robotics. While robot policies learned from robot-collected data or simulation show promise, they struggle to generalize across the diverse range of real-world…

This is the preprint version of our paper on IEEE Virtual Reality Conference 2015. A touch-less interaction technology on vision based wearable device is designed and evaluated. Users interact with the application with dynamic hands/feet…

Human-Computer Interaction · Computer Science 2015-07-30 Zhihan Lv , Liangbing Feng , Shengzhong Feng , Haibo Li

Skin-like tactile sensors provide robots with rich feedback related to the force distribution applied to their soft surface. The complexity of interpreting raw tactile information has driven the use of machine learning algorithms to convert…

Robotics · Computer Science 2019-12-12 Carmelo Sferrazza , Adam Wahlsten , Camill Trueeb , Raffaello D'Andrea

In this paper, we address force-aware control and force distribution in robotic platforms with multi-fingered hands. Given a target goal and force estimates from tactile sensors, we design a controller that adapts the motion of the torso,…

Robotics · Computer Science 2026-05-29 Pasquale Marra , Gabriele M. Caddeo , Ugo Pattacini , Lorenzo Natale

Grasping objects whose physical properties are unknown is still a great challenge in robotics. Most solutions rely entirely on visual data to plan the best grasping strategy. However, to match human abilities and be able to reliably pick…

Robotics · Computer Science 2021-09-24 Pietro Griffa , Carmelo Sferrazza , Raffaello D'Andrea

Manipulation without grasping, known as non-prehensile manipulation, is essential for dexterous robots in contact-rich environments, but presents many challenges relating with underactuation, hybrid-dynamics, and frictional uncertainty.…

Robotics · Computer Science 2024-12-18 Juan Del Aguila Ferrandis , João Moura , Sethu Vijayakumar

Estimation of a hand grip force is essential for the understanding of force pattern during the execution of assembly or disassembly operations. Human demonstration of a correct way of doing an operation is a powerful source of information…

Robotics · Computer Science 2018-03-06 Andrey Sartison , Dima Mironov , Kamal Youcef-Toumi , Dzmitry Tsetserukou

We describe a single fingertip-mounted sensing system for robot manipulation that provides proximity (pre-touch), contact detection (touch), and force sensing (post-touch). The sensor system consists of optical time-of-flight range…

Robotics · Computer Science 2018-10-02 Patrick E. Lancaster , Joshua R. Smith , Siddhartha S. Srinivasa