English
Related papers

Related papers: Helios 2.0: A Robust, Ultra-Low Power Gesture Reco…

200 papers

This paper presents the design and implementation of an AI vision-controlled orthotic hand exoskeleton to enhance rehabilitation and assistive functionality for individuals with hand mobility impairments. The system leverages a Google Coral…

Robotics · Computer Science 2025-04-24 Connor Blais , Md Abdul Baset Sarker , Masudul H. Imtiaz

Wearable devices have strict power and memory limitations. As a result, there is a need to optimize the power consumption on those devices without sacrificing the accuracy. This paper presents AdaSense: a sensing, feature extraction and…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Marina Neseem , Jon Nelson , Sherief Reda

Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time,…

Egocentric gesture recognition is a pivotal technology for enhancing natural human-computer interaction, yet traditional RGB-based solutions suffer from motion blur and illumination variations in dynamic scenarios. While event cameras show…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Luming Wang , Hao Shi , Xiaoting Yin , Kailun Yang , Kaiwei Wang , Jian Bai

The sophisticated sense of touch of the human hand significantly contributes to our ability to safely, efficiently, and dexterously manipulate arbitrary objects in our environment. Robotic and prosthetic devices lack refined, tactile…

Robotics · Computer Science 2021-08-02 Xiaying Wang , Fabian Geiger , Vlad Niculescu , Michele Magno , Luca Benini

This paper proposes an idea of building an interface to merge the existing technologies like Image processing, Internet of Things, Sixth sense, etc. at one place to reduce the hardware restrictions imposed on a user and improve the…

Human-Computer Interaction · Computer Science 2024-09-05 Shubhankar Mohan , Aditi Chaudhary , Prachie Gupta , Ritu Tiwari

This study presents a lightweight, wearable fingertip haptic device that provides physics-based haptic feedback for dexterous manipulation in virtual environments without hindering real-world interactions. The device, designed with thin…

Human-Computer Interaction · Computer Science 2025-06-27 Yunxiu Xu , Siyu Wang , Shoichi Hasegawa

3D hand pose estimation from monocular videos is a long-standing and challenging problem, which is now seeing a strong upturn. In this work, we address it for the first time using a single event camera, i.e., an asynchronous vision sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Viktor Rudnev , Vladislav Golyanik , Jiayi Wang , Hans-Peter Seidel , Franziska Mueller , Mohamed Elgharib , Christian Theobalt

We design a gesture-recognition pipeline for networks of distributed, resource constrained devices utilising Einsum Networks. Einsum Networks are probabilistic circuits that feature a tractable inference, explainability, and energy…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Sahar Golipoor , Lingyun Yao , Martin Andraud , Stephan Sigg

Object manipulation is fundamental to virtual reality (VR) applications, yet conventional fingertip haptic devices fail to render certain tactile features relevant for immersive and precise interactions, as i.e. detection of edges. This…

Robotics · Computer Science 2026-04-02 Rui Chen , Xianlong Mai , Alireza Sanaei , Domenico Chiaradia , Antonio Frisoli , Daniele Leonardis

Hand gesture recognition has become an important research area, driven by the growing demand for human-computer interaction in fields such as sign language recognition, virtual and augmented reality, and robotics. Despite the rapid growth…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Manousos Linardakis , Iraklis Varlamis , Georgios Th. Papadopoulos

Hand gestures are a natural means of interaction in Augmented Reality and Virtual Reality (AR/VR) applications. Recently, there has been an increased focus on removing the dependence of accurate hand gesture recognition on complex sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Varun Jain , Shivam Aggarwal , Suril Mehta , Ramya Hebbalaguppe

This paper addresses the scarcity of low-cost but high-dexterity platforms for collecting real-world multi-fingered robot manipulation data towards generalist robot autonomy. To achieve it, we propose the RAPID Hand, a co-optimized hardware…

Robotics · Computer Science 2025-06-10 Zhaoliang Wan , Zetong Bi , Zida Zhou , Hao Ren , Yiming Zeng , Yihan Li , Lu Qi , Xu Yang , Ming-Hsuan Yang , Hui Cheng

The control of multi-fingered dexterous prosthetics hand remains challenging due to the lack of an intuitive and efficient Grasp-type Switching Interface (GSI). We propose a new GSI (i-GSI) t hat integrates the manifold power of…

Robotics · Computer Science 2022-04-25 Chunyuan Shi , Dapeng Yang , Siyang Qiu , Jingdong Zhao

We present a novel Hand-pose Embedding Interactive System (HpEIS) as a virtual sensor, which maps users' flexible hand poses to a two-dimensional visual space using a Variational Autoencoder (VAE) trained on a variety of hand poses. HpEIS…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Songpei Xu , Xuri Ge , Chaitanya Kaul , Roderick Murray-Smith

Due to Motor Neurone Diseases, a large population remains disabled worldwide, negatively impacting their independence and quality of life. This typically involves a weakness in the hand and forearm muscles, making it difficult to perform…

Human-Computer Interaction · Computer Science 2024-08-29 Md Abdul Baset Sarker , Juan Pablo Sola-thomas , Masudul H. Imtiaz

We present a novel underactued humanoid five finger soft hand, the KIT \softhand, which is equipped with cameras in the fingertips and integrates a high performance embedded system for visual processing and control. We describe the…

Robotics · Computer Science 2020-06-08 Felix Hundhausen , Julia Starke , Tamim Asfour

Camera-based tactile sensors provide robots with a high-performance tactile sensing approach for environment perception and dexterous manipulation. However, achieving comprehensive environmental perception still requires cooperation with…

Robotics · Computer Science 2025-04-15 Yueshi Dong , Jieji Ren , Zhenle Liu , Zhanxuan Peng , Zihao Yuan , Ningbin Zhang , Guoying Gu

This work describes the development of a high-resolution tactile-sensing finger for robot grasping. This finger, inspired by previous GelSight sensing techniques, features an integration that is slimmer, more robust, and with more…

Robotics · Computer Science 2018-05-16 Elliott Donlon , Siyuan Dong , Melody Liu , Jianhua Li , Edward Adelson , Alberto Rodriguez

At the present time, hand gestures recognition system could be used as a more expected and useable approach for human computer interaction. Automatic hand gesture recognition system provides us a new tactic for interactive with the virtual…

Computer Vision and Pattern Recognition · Computer Science 2014-08-08 Reza Azad , Babak Azad , Nabil Belhaj Khalifa , Shahram Jamali