English
Related papers

Related papers: Advancements in Tactile Hand Gesture Recognition f…

200 papers

The sense of touch plays a key role in enabling humans to understand and interact with surrounding environments. For robots, tactile sensing is also irreplaceable. While interacting with objects, tactile sensing provides useful information…

Robotics · Computer Science 2021-12-30 Jiaqi Jiang , Shan Luo

Fine dexterous manipulation requires reactive control based on rich sensing of manipulator-object interactions. Tactile sensing arrays provide rich contact information across the manipulator's surface. However their implementation faces two…

Robotics · Computer Science 2025-03-11 Elie Chelly , Andrea Cherubini , Philippe Fraisse , Faiz Ben Amar , Mahdi Khoramshahi

The user's palm plays an important role in object detection and manipulation. The design of a robust multi-contact tactile display must consider the sensation and perception of of the stimulated area aiming to deliver the right stimuli at…

Human-Computer Interaction · Computer Science 2020-06-23 Miguel Altamirano Cabrera , Juan Heredia , Dzmitry Tsetserukou

In this paper, we propose a micro hand gesture recognition system and methods using ultrasonic active sensing. This system uses micro dynamic hand gestures for recognition to achieve human-computer interaction (HCI). The implemented system,…

Signal Processing · Electrical Eng. & Systems 2024-12-02 Yu Sang , Laixi Shi , Yimin Liu

The possibility for humans to interact with physical or virtual systems using gestures has been vastly explored by researchers and designers in the last twenty years to provide new and intuitive interaction modalities. Unfortunately, the…

Human-Computer Interaction · Computer Science 2022-01-26 Alessandro Carfì , Fulvio Mastrogiovanni

Direct and natural interaction is essential for intuitive human-robot collaboration, eliminating the need for additional devices such as joysticks, tablets, or wearable sensors. In this paper, we present a lightweight deep learning-based…

Object properties perceived through the tactile sense, such as weight, friction, and slip, greatly influence motor control during manipulation tasks. However, the provision of tactile information during robotic training in…

Human gesture recognition has assumed a capital role in industrial applications, such as Human-Machine Interaction. We propose an approach for segmentation and classification of dynamic gestures based on a set of handcrafted features, which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 André Brás , Miguel Simão , Pedro Neto

In general, robotic dexterous hands are equipped with various sensors for acquiring multimodal contact information such as position, force, and pose of the grasped object. This multi-sensor-based design adds complexity to the robotic…

Robotics · Computer Science 2024-08-12 Weiliang Xu , Guoyuan Zhou , Yuanzhi Zhou , Zhibin Zou , Jiali Wang , Wenfeng Wu , Xinming Li

Human-Computer Interaction (HCI) has been the subject of research for many years, and recent studies have focused on improving its performance through various techniques. In the past decade, deep learning studies have shown high performance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Serkan Savaş , Atilla Ergüzen

In this paper, a novel tactile sensing mechanism for soft robotic fingers is proposed. Inspired by the proprioception mechanism found in mammals, the proposed approach infers tactile information from a strain sensor attached on the finger's…

Robotics · Computer Science 2021-07-07 Chang Cheng , Yadong Yan , Mingjun Guan , Jianan Zhang , Yu Wang

Gestures are a topic of increasing interest in authentication and successful implementation as a security layer requires reliable gesture recognition. So far much work focuses on new ways to recognize gestures, leaving discussion on the…

Cryptography and Security · Computer Science 2014-08-28 Gradeigh D. Clark , Janne Lindqvist

Dynamic hand tracking and gesture recognition is a hard task since there are many joints on the fingers and each joint owns many degrees of freedom. Besides, object occlusion is also a thorny issue in finger tracking and posture…

Human-Computer Interaction · Computer Science 2018-09-18 Zhishuai Han , Xiaojuan Ban , Xiaokun Wang , Di wu

The development of tactile sensing and its fusion with computer vision is expected to enhance robotic systems in handling complex tasks like deformable object manipulation. However, readily available industrial grippers typically lack…

Robotics · Computer Science 2023-06-12 Remko Proesmans , Francis wyffels

Human tactile perception of materials relies on complex multisensory touch cues, yet the relationship between low-level tactile signals and perceptual representations remains poorly understood. This knowledge gap hinders the integration of…

Robotics · Computer Science 2026-05-29 Li Zou , Yasemin Vardar

Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in this field, gesture customization is often underexplored.…

Human-Computer Interaction · Computer Science 2024-10-04 Soroush Shahi , Vimal Mollyn , Cori Tymoszek Park , Richard Kang , Asaf Liberman , Oron Levy , Jun Gong , Abdelkareem Bedri , Gierad Laput

Hand gesture recognition possesses extensive applications in virtual reality, sign language recognition, and computer games. The direct interface of hand gestures provides us a new way for communicating with the virtual environment. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-08-11 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

While gesture recognition using vision or robot skins is an active research area in Human-Robot Collaboration (HRC), this paper explores deep learning methods relying solely on a robot's built-in joint sensors, eliminating the need for…

Robotics · Computer Science 2025-08-19 Deqing Song , Weimin Yang , Maryam Rezayati , Hans Wernher van de Venn

Rapid deployment of new tactile sensors is essential for scalable robotic manipulation, especially in multi-fingered hands equipped with vision-based tactile sensors. However, current methods for inferring contact properties rely heavily on…

Robotics · Computer Science 2026-04-02 Christopher J. Ford , Kaichen Shi , Laura Butcher , Nathan F. Lepora , Efi Psomopoulou

Camera-based tactile sensors provide robots with a high-performance tactile sensing approach for environment perception and dexterous manipulation. However, achieving comprehensive environmental perception still requires cooperation with…

Robotics · Computer Science 2025-04-15 Yueshi Dong , Jieji Ren , Zhenle Liu , Zhanxuan Peng , Zihao Yuan , Ningbin Zhang , Guoying Gu