English
Related papers

Related papers: FSGlove: An Inertial-Based Hand Tracking System wi…

200 papers

Nowadays, there are few unmanned aerial vehicles (UAVs) capable of flying, walking and grasping. A drone with all these functionalities can significantly improve its performance in complex tasks such as monitoring and exploring different…

We present CaptAinGlove, a textile-based, low-power (1.15Watts), privacy-conscious, real-time on-the-edge (RTE) glove-based solution with a tiny memory footprint (2MB), designed to recognize hand gestures used for drone control. We employ…

Machine Learning · Computer Science 2024-12-31 Hymalai Bello , Sungho Suh , Daniel Geißler , Lala Ray , Bo Zhou , Paul Lukowicz

This paper presents Glove2UAV, a wearable IMU-glove interface for intuitive UAV control through hand and finger gestures, augmented with vibrotactile warnings for exceeding predefined speed thresholds. To promote safer and more predictable…

Sensing gloves have become important tools for teleoperation and robotic policy learning as they are able to provide rich signals like speed, acceleration and tactile feedback. A common approach to track gloved hands is to directly use the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Wenhui Cui , Ziyi Kou , Chuan Qin , Ergys Ristani , Li Guan

The collaborative robot market is flourishing as there is a trend towards simplification, modularity, and increased flexibility on the production line. But when humans and robots are collaborating in a shared environment, the safety of…

Tactile sensing is a essential for skilled manipulation and object perception, but existing devices are unable to capture mechanical signals in the full gamut of regimes that are important for human touch sensing, and are unable to emulate…

Robotics · Computer Science 2019-08-23 Yitian Shao , Hui Hu , Yon Visell

Autonomous grasping is an important factor for robots physically interacting with the environment and executing versatile tasks. However, a universally applicable, cost-effective, and rapidly deployable autonomous grasping approach is still…

Robotics · Computer Science 2023-03-07 Hanwen Cao , Junda Huang , Yichuan Li , Jianshu Zhou , Yunhui Liu

Detecting and preventing slip is a major challenge in robotic hand operation, underpinning the robot's ability to perform safe and reliable grasps. Using the robotic hand design from the authors' earlier work, a sensing and control strategy…

Robotics · Computer Science 2022-02-15 Negin Nikafrooz , Zachary Fuge , Alexander Leonessa

Hands are a fundamental tool humans use to interact with the environment and objects. Through hand motions, we can obtain information about the shape and materials of the surfaces we touch, modify our surroundings by interacting with…

Human-Computer Interaction · Computer Science 2024-05-27 Valerio Belcamino , Alessandro Carfì , Fulvio Mastrogiovanni

Resistive tactile sensing gloves have captured the interest of researchers spanning diverse domains, such as robotics, healthcare, and human-computer interaction. However, existing fabrication methods often require labor-intensive assembly…

Human-Computer Interaction · Computer Science 2025-03-11 Devin Murphy , Yichen Li , Crystal Owens , Layla Stanton , Young Joong Lee , Paul Pu Liang , Yiyue Luo , Antonio Torralba , Wojciech Matusik

As robotics progresses toward general manipulation, dexterous hands are becoming increasingly critical. However, proprioception in dexterous hands remains a bottleneck due to limitations in volume and generality. In this work, we present…

Robotics · Computer Science 2025-05-14 Junda Huang , Jianshu Zhou , Honghao Guo , Yunhui Liu

Heavy-duty operations, typically performed using heavy-duty hydraulic manipulators (HHMs), are susceptible to environmental contact due to tracking errors or sudden environmental changes. Therefore, beyond precise control design, it is…

Robotics · Computer Science 2024-08-20 Mahdi Hejrati , Jouni Mattila

Reconstructing dynamic hand-object contacts is essential for realistic manipulation in AI character animation, XR, and robotics, yet it remains challenging due to heavy occlusions, complex surface details, and limitations in existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Xiaoyan Cong , Angela Xing , Chandradeep Pokhariya , Rao Fu , Srinath Sridhar

It is challenging to grasp numerous objects with varying sizes and shapes with a single robot hand. To address this, we propose a new robot hand called the 'F3 hand' inspired by the complex movements of human index finger and thumb. The F3…

Robotics · Computer Science 2022-06-17 Naoki Fukaya , Avinash Ummadisingu , Guilherme Maeda , Shin-ichi Maeda

Despite widespread adoption of smartwatches worldwide, open-benchmarks for wrist-based gesture recognition remain surprisingly limited. In this work, we introduce the first open-access multi-modal benchmark, OpenWatch, for wrist-based…

Human-Computer Interaction · Computer Science 2026-05-08 Pietro Bonazzi , Youssef Ahmed , Daniel Eckert , Andrea Ronco , Junjie Zeng , Dengxin Dai , Michele Magno

This paper addresses the scarcity of low-cost but high-dexterity platforms for collecting real-world multi-fingered robot manipulation data towards generalist robot autonomy. To achieve it, we propose the RAPID Hand, a co-optimized hardware…

Robotics · Computer Science 2025-06-10 Zhaoliang Wan , Zetong Bi , Zida Zhou , Hao Ren , Yiming Zeng , Yihan Li , Lu Qi , Xu Yang , Ming-Hsuan Yang , Hui Cheng

Direct and natural interaction is essential for intuitive human-robot collaboration, eliminating the need for additional devices such as joysticks, tablets, or wearable sensors. In this paper, we present a lightweight deep learning-based…

The use of wearable robots has been widely adopted in rehabilitation training for patients with hand motor impairments. However, the uniqueness of patients' muscle loss is often overlooked. Leveraging reinforcement learning and a…

Robotics · Computer Science 2025-05-15 Shirui Lyu , Vittorio Caggiano , Matteo Leonetti , Dario Farina , Letizia Gionfrida

Dynamic hand tracking and gesture recognition is a hard task since there are many joints on the fingers and each joint owns many degrees of freedom. Besides, object occlusion is also a thorny issue in finger tracking and posture…

Human-Computer Interaction · Computer Science 2018-09-18 Zhishuai Han , Xiaojuan Ban , Xiaokun Wang , Di wu

In this work, we introduce the EyeSight Hand, a novel 7 degrees of freedom (DoF) humanoid hand featuring integrated vision-based tactile sensors tailored for enhanced whole-hand manipulation. Additionally, we introduce an actuation scheme…

Robotics · Computer Science 2024-08-13 Branden Romero , Hao-Shu Fang , Pulkit Agrawal , Edward Adelson