English
Related papers

Related papers: Multimodal Sensing and Interaction for a Robotic H…

200 papers

$\textit{Objective.}$ In this article, we present data and methods for decoding hand gestures using surface electromyogram (EMG) signals. EMG-based upper limb interfaces are valuable for amputee rehabilitation, artificial supernumerary limb…

Signal Processing · Electrical Eng. & Systems 2025-04-04 Harshavardhana T. Gowda , Lee M. Miller

Configurable robots are made up of robotic modules that can be assembled or can configure themselves into multiple robot configurations. In this research plan, a method for upper-body rehabilitation will be discussed in the form of a…

Systems and Control · Electrical Eng. & Systems 2024-08-16 M. Hasanlu , M. Siavashi

Surface electromyography (sEMG) records muscle activity during hand movement and can be decoded to recover detailed hand articulation. EMG and egocentric vision are complementary for hand sensing: EMG captures fine-grained finger…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Ziheng Xi , Jiayi Yu , Yitao Wang , Yanbo Duan , Jianjiang Feng , Jie Zhou

Wrist-driven orthotics have been designed to assist people with C6-7 spinal cord injury, however, the kinematic constraint imposed by such a control strategy can impede mobility and lead to abnormal body motion. This study characterizes…

Robotics · Computer Science 2023-11-13 Erin Y. Chang , Raghid Mardini , Andrew I. W. McPherson , Yuri Gloumakov , Hannah S. Stuart

Hand pose tracking is essential for advancing applications in human-computer interaction. Current approaches, such as vision-based systems and wearable devices, face limitations in portability, usability, and practicality. We present a…

Human-Computer Interaction · Computer Science 2025-10-07 Yingjing Xiao , Zhichao Huang , Junbin Ren , Haichuan Song , Yang Gao , Yuting Bai , Zhanpeng Jin

This paper presents a dataset containing recordings of the electroencephalogram (EEG) and the electromyogram (EMG) from eight subjects who were assisted in moving their right arm by an active orthosis device. The supported movements were…

Human-Computer Interaction · Computer Science 2024-03-14 Niklas Kueper , Kartik Chari , Judith Bütefür , Julia Habenicht , Su Kyoung Kim , Tobias Rossol , Marc Tabie , Frank Kirchner , Elsa Andrea Kirchner

This paper proposes a wearable-controlled mobile manipulator system for intelligent smart home assistance, integrating MEMS capacitive microphones, IMU sensors, vibration motors, and pressure feedback to enhance human-robot interaction. The…

Robotics · Computer Science 2025-04-21 Xiao Jin , Bo Xiao , Huijiang Wang , Wendong Wang , Zhenhua Yu

Conventional electromyography (EMG) measures the continuous neural activity during muscle contraction, but lacks explicit quantification of the actual contraction. Mechanomyography (MMG) and accelerometers only measure body surface motion,…

Human-Computer Interaction · Computer Science 2022-11-08 Zijing Zhang , Edwin C. Kan

Without finger function, people with C5-7 spinal cord injury (SCI) regularly utilize wrist extension to passively close the fingers and thumb together for grasping. Wearable assistive grasping devices often focus on this familiar…

Robotics · Computer Science 2025-01-13 Erin Y. Chang , Andrew I. W. McPherson , Hannah S. Stuart

The aim of this work was to identify six basic movements of the hand using two systems. Being an interdisciplinary topic, there has been conducted studying in the anatomy of forearm muscles, biosignals, the method of electromyography (EMG)…

Signal Processing · Electrical Eng. & Systems 2019-06-20 Christos Sapsanis

Due to Motor Neurone Diseases, a large population remains disabled worldwide, negatively impacting their independence and quality of life. This typically involves a weakness in the hand and forearm muscles, making it difficult to perform…

Human-Computer Interaction · Computer Science 2024-08-29 Md Abdul Baset Sarker , Juan Pablo Sola-thomas , Masudul H. Imtiaz

We present a technique for providing remote tactile feedback to the thumb and index finger via a wristband device. This enables haptics for touch and pinch interactions in mixed reality (MR) while keeping the hand entirely free. We achieve…

Human-Computer Interaction · Computer Science 2024-10-31 Yudai Tanaka , Neil Weiss , Robert Cole Bolger-Cruz , Jess Hartcher-O'Brien , Brendan Flynn , Roger Boldu , Nicholas Colonnese

Myoelectric prosthetic hands are typically controlled to move between discrete positions and do not provide sensory feedback to the user. In this work, we present and evaluate a closed-loop, continuous myoelectric prosthetic hand…

Object handover is a common form of interaction that is widely present in collaborative tasks. However, achieving it efficiently remains a challenge. We address the problem of ensuring resilient robotic actions that can adapt to complex…

Robotics · Computer Science 2026-04-30 Omar Faris , Sławomir Tadeja , Fulvio Forni

Robotic palpation relies on force sensing, but force signals in soft-tissue environments are variable and cannot reliably reveal subtle subsurface features. We present a compact multimodal sensor that integrates high-resolution vision-based…

Human operators are still frequently exposed to hazardous environments such as disaster zones and industrial facilities, where intuitive and reliable teleoperation of mobile robots and Unmanned Aerial Vehicles (UAVs) is essential. In this…

Touch is a crucial sensing modality that provides rich information about object properties and interactions with the physical environment. Humans and robots both benefit from using touch to perceive and interact with the surrounding…

Brain-machine interfaces (BMIs), particularly those based on electroencephalography (EEG), offer promising solutions for assisting individuals with motor disabilities. However, challenges in reliably interpreting EEG signals for specific…

Signal Processing · Electrical Eng. & Systems 2025-04-23 Biplov Paneru , Bipul Thapa , Bishwash Paneru , Sanjog Chhetri Sapkota

Several studies report that people diagnosed with autism spectrum disorder (ASD) have low employment rates and major difficulties in maintaining occupation (Hendricks, 2010). Adopting smart and interactive technology, promoted by Industry…

Human-Computer Interaction · Computer Science 2023-04-28 Carla Dei , Matteo Meregalli Falerni , Matteo Lavit Nicora , Mattia Chiappini , Matteo Malosio , Fabio Alexander Storm

Automatic surgical gesture recognition is fundamentally important to enable intelligent cognitive assistance in robotic surgery. With recent advancement in robot-assisted minimally invasive surgery, rich information including surgical…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Yonghao Long , Jie Ying Wu , Bo Lu , Yueming Jin , Mathias Unberath , Yun-Hui Liu , Pheng Ann Heng , Qi Dou