English
Related papers

Related papers: Object Recognition and Force Estimation with the G…

200 papers

Robotic manipulation can benefit from wrist-mounted force/torque (F/T) sensors, but conventional F/T sensors can be expensive, difficult to install, and damaged by high loads. We present Visual Force/Torque Sensing (VFTS), a method that…

Robotics · Computer Science 2023-05-09 Jeremy A. Collins , Patrick Grady , Charles C. Kemp

Tactile sensing is inherently contact based. To use tactile data, robots need to make contact with the surface of an object. This is inefficient in applications where an agent needs to make a decision between multiple alternatives that…

Robotics · Computer Science 2021-10-19 Karankumar Patel , Soshi Iba , Nawid Jamali

We address the challenge of reliable and accurate proprioception in soft robots, specifically those with tight packaging constraints and relying only on internally embedded sensors. While various sensing approaches with single sensors have…

In this paper we propose a novel method for in-hand object recognition. The method is composed of a grasp stabilization controller and two exploratory behaviours to capture the shape and the softness of an object. Grasp stabilization plays…

Robotics · Computer Science 2021-06-30 Massimo Regoli , Nawid Jamali , Giorgio Metta , Lorenzo Natale

Much of the literature on robotic perception focuses on the visual modality. Vision provides a global observation of a scene, making it broadly useful. However, in the domain of robotic manipulation, vision alone can sometimes prove…

Robotics · Computer Science 2019-03-11 Justin Lin , Roberto Calandra , Sergey Levine

Based on the DeepSORT algorithm, this study explores the application of visual tracking technology in intelligent human-computer interaction, especially in the field of gesture recognition and tracking. With the rapid development of…

Human-Computer Interaction · Computer Science 2025-05-13 Tong Zhang , Fenghua Shao , Runsheng Zhang , Yifan Zhuang , Liuqingqing Yang

Estimation of tactile properties from vision, such as slipperiness or roughness, is important to effectively interact with the environment. These tactile properties help us decide which actions we should choose and how to perform them.…

Robotics · Computer Science 2019-07-10 Kuniyuki Takahashi , Jethro Tan

Goal: A limitation in robotic surgery is the lack of force feedback, due to challenges in suitable sensing techniques. To enhance the perception of the surgeons and precise force rendering, estimation of these forces along with tissue…

Systems and Control · Electrical Eng. & Systems 2025-04-30 Srikar Annamraju , Yuxi Chen , Jooyoung Lim , Inki Kim

Hand detection is essential for many hand related tasks, e.g. parsing hand pose, understanding gesture, which are extremely useful for robotics and human-computer interaction. However, hand detection in uncontrolled environments is…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Xiaoming Deng , Ye Yuan , Yinda Zhang , Ping Tan , Liang Chang , Shuo Yang , Hongan Wang

Vision-based tactile sensors have gained extensive attention in the robotics community. The sensors are highly expected to be capable of extracting contact information i.e. haptic information during in-hand manipulation. This nature of…

Rotational displacement about the grasping point is a common grasp failure when an object is grasped at a location away from its center of gravity. Tactile sensors with soft surfaces, such as GelSight sensors, can detect the rotation…

Robotics · Computer Science 2021-08-03 Raj Kolamuri , Zilin Si , Yufan Zhang , Arpit Agarwal , Wenzhen Yuan

Tactile sensing plays a fundamental role in enabling robots to navigate dynamic and unstructured environments, particularly in applications such as delicate object manipulation, surface exploration, and human-robot interaction. In this…

Robotics · Computer Science 2025-09-18 Annan Zhang , Miguel Flores-Acton , Andy Yu , Anshul Gupta , Maggie Yao , Daniela Rus

The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in…

Robotics · Computer Science 2021-10-01 Carmelo Sferrazza , Raffaello D'Andrea

High-density afferents in the human hand have long been regarded as essential for human grasping and manipulation abilities. In contrast, robotic tactile sensors are typically used to provide low-density contact data, such as…

Robotics · Computer Science 2020-06-09 Yashraj S. Narang , Karl Van Wyk , Arsalan Mousavian , Dieter Fox

Object properties perceived through the tactile sense, such as weight, friction, and slip, greatly influence motor control during manipulation tasks. However, the provision of tactile information during robotic training in…

Purpose. Precise placement of needles is a challenge in a number of clinical applications such as brachytherapy or biopsy. Forces acting at the needle cause tissue deformation and needle deflection which in turn may lead to misplacement or…

With soft robotics being increasingly employed in settings demanding high and controlled contact forces, recent research has demonstrated the use of soft robots to estimate or intrinsically sense forces without requiring external sensing…

Robotics · Computer Science 2021-11-22 Lukas Lindenroth , Danail Stoyanov , Kawal Rhode , Hongbin Liu

In this paper, we present a methodology that uses an optical tactile sensor for efficient tactile exploration of embedded objects within soft materials. The methodology consists of an exploration phase, where a probabilistic estimate of the…

Robotics · Computer Science 2024-04-01 Jose A. Solano-Castellanos , Won Kyung Do , Monroe Kennedy

Skin recognition is used in many applications ranging from algorithms for face detection, hand gesture analysis, and to objectionable image filtering. In this work a skin recognition system was developed and tested. While many skin…

Computer Vision and Pattern Recognition · Computer Science 2013-11-26 Nidhal K. El Abbadi , Nazar Dahir , Zaid Abd Alkareem

While gesture recognition using vision or robot skins is an active research area in Human-Robot Collaboration (HRC), this paper explores deep learning methods relying solely on a robot's built-in joint sensors, eliminating the need for…

Robotics · Computer Science 2025-08-19 Deqing Song , Weimin Yang , Maryam Rezayati , Hans Wernher van de Venn