English
Related papers

Related papers: Multimodal Sensing and Interaction for a Robotic H…

200 papers

Employing skin-like tactile sensors on robots enhances both the safety and usability of collaborative robots by adding the capability to detect human contact. Unfortunately, simple binary tactile sensors alone cannot determine the context…

Robotics · Computer Science 2023-04-20 Christopher Yee Wong , Lucas Vergez , Wael Suleiman

High-density electromyography (HDEMG) can detect myoelectric activity as control inputs to a variety of electronically-controlled devices. Furthermore, HDEMG sensors may be built into a variety of clothing, allowing for a non-intrusive…

Robotics · Computer Science 2024-11-05 Jehan Yang , Kent Shibata , Douglas Weber , Zackory Erickson

Tendon-driven anthropomorphic robotic hands often lack direct joint angle sensing, as the integration of joint encoders can compromise mechanical compactness and dexterity. This paper presents a computational method for estimating joint…

Robotics · Computer Science 2026-01-29 Péter Polcz , Katalin Schäffer , Miklós Koller

Haptic devices have been employed to immerse users in VR environments. In particular, hand and finger haptic devices have been deeply developed. However, this type of device occlude the hand detection by some tracking systems, or in other…

Human-Computer Interaction · Computer Science 2019-11-19 Juan Heredia , Jonathan Tirado , Vladislav Panov , Miguel Altamirano , Youcef Kamal-Toumi , Dzmitry Tsetserukou

Humans use all of their senses to accomplish different tasks in everyday activities. In contrast, existing work on robotic manipulation mostly relies on one, or occasionally two modalities, such as vision and touch. In this work, we…

Electromyography (EMG) signals are obtained from muscle cell activity. The recording and analysis of EMG signals has several applications. The EMG is of diagnostic importance for treating patients suffering from neurological and…

Systems and Control · Electrical Eng. & Systems 2025-09-18 Vinay C K , Vikas Vazhayil , Madhav rao

Human-robot collaboration (HRC) is a key focus of Industry 5.0, aiming to enhance worker productivity while ensuring well-being. The ability to perceive human psycho-physical states, such as stress and cognitive load, is crucial for…

Robotic-assisted surgery offers significant clinical advantages but largely eliminates direct haptic feedback, increasing the risk of excessive tool-tissue interaction forces. Although recent commercial systems have begun to introduce force…

Robotics · Computer Science 2026-05-01 Walid Shaker , Mustafa Suphi Erden

Manipulating objects with robotic hands is a complicated task. Not only the fingers of the hand, but also the pose of the robot's end effector need to be coordinated. Using human demonstrations of movements is an intuitive and…

Non-prehensile planar manipulation, including pushing and press-and-slide, is critical for diverse robotic tasks, but notoriously challenging due to hybrid contact mechanics, under-actuation, and asymmetric friction limits that…

Robotics · Computer Science 2026-03-19 Melih Özcan , Umut Orguner , Ozgur S. Oguz

The human foot serves as the critical interface between the body and environment during locomotion. Existing musculoskeletal models typically oversimplify foot-ground contact mechanics, limiting their ability to accurately simulate human…

Robotics · Computer Science 2025-08-19 Haixin Gong , Chen Zhang , Yanan Sui

Despite widespread adoption of smartwatches worldwide, open-benchmarks for wrist-based gesture recognition remain surprisingly limited. In this work, we introduce the first open-access multi-modal benchmark, OpenWatch, for wrist-based…

Human-Computer Interaction · Computer Science 2026-05-08 Pietro Bonazzi , Youssef Ahmed , Daniel Eckert , Andrea Ronco , Junjie Zeng , Dengxin Dai , Michele Magno

Teleoperation platforms often require the user to be situated at a fixed location to both visualize and control the movement of the robot and thus do not provide the operator with much mobility. One example is in existing robotic surgery…

Robotics · Computer Science 2022-01-12 Guanhao Fu , Ehsan Azimi , Peter Kazanzides

Future health systems require the means to assess and track the neural and physiological function of a user over long periods of time and in the community. Human body responses are manifested through multiple modalities, such as the…

Assistive electric-powered wheelchairs (EPWs) have become essential mobility aids for people with disabilities such as amyotrophic lateral sclerosis (ALS), post-stroke hemiplegia, and dementia-related mobility impairment. This work presents…

Robotics · Computer Science 2026-01-07 Md. Anowar Hossain , Mohd. Ehsanul Hoque

Thumb gestures provide an effective and unobtrusive input modality for wearable and always-available human-machine interaction. Wrist-worn surface electromyography (sEMG) has emerged as a promising approach for compact and wearable…

Human-Computer Interaction · Computer Science 2026-04-07 Wenjuan Zhong , Chenfei Ma , Kianoush Nazarpour

Humanoid robots are entering our physical world at scale, yet as oversized toys--good at singing and dancing, but short on force-interaction capabilities for practical tasks. Bridging this gap necessitates prioritizing reliable contact…

The flexible under-actuated musculoskeletal hand is superior in its adaptability and impact resistance. On the other hand, since the relationship between sensors and actuators cannot be uniquely determined, almost all its controls are based…

Recognizing human activity plays a significant role in the advancements of human-interaction applications in healthcare, personal fitness, and smart devices. Many papers presented various techniques for human activity representation that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Reem Abdel-Salam , Rana Mostafa , Mayada Hadhood

Human-Machine Interaction (HMI) systems have gained huge interest in recent years, with reference expression comprehension being one of the main challenges. Traditionally human-machine interaction has been mostly limited to speech and…

Human-Computer Interaction · Computer Science 2023-06-21 Aman Jain , Anirudh Reddy Kondapally , Kentaro Yamada , Hitomi Yanaka