English
Related papers

Related papers: Towards an End-To-End System for Real-Time Gesture…

200 papers

Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in this field, gesture customization is often underexplored.…

Human-Computer Interaction · Computer Science 2024-10-04 Soroush Shahi , Vimal Mollyn , Cori Tymoszek Park , Richard Kang , Asaf Liberman , Oron Levy , Jun Gong , Abdelkareem Bedri , Gierad Laput

Compliant grippers enable robots to work with humans in unstructured environments. In general, these grippers can improve with tactile sensing to estimate the state of objects around them to precisely manipulate objects. However,…

Robotics · Computer Science 2024-03-08 Yuxiang Ma , Arpit Agarwal , Sandra Q. Liu , Wenzhen Yuan , Edward H. Adelson

Real-time recognition of dynamic hand gestures from video streams is a challenging task since (i) there is no indication when a gesture starts and ends in the video, (ii) performed gestures should only be recognized once, and (iii) the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Okan Köpüklü , Ahmet Gunduz , Neslihan Kose , Gerhard Rigoll

We propose a set of communicative gestures and develop a gesture recognition system with the aim of facilitating more intuitive Human-Robot Interaction (HRI) through gestures. First, we propose a set of commands commonly used for…

Robotics · Computer Science 2021-09-22 Jia Chuan A. Tan , Wesley P. Chan , Nicole L. Robinson , Elizabeth A. Croft , Dana Kulic

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

We are concerned with a novel sensor-based gesture input/instruction technology which enables human beings to interact with computers conveniently. The human being wears an emitter on the finger or holds a digital pen that generates a time…

Classical Physics · Physics 2017-05-23 Yukun Guo , Jingzhi Li , Hongyu Liu , Xianchao Wang

Using physical interactive devices like mouse and keyboards hinders naturalistic human-machine interaction and increases the probability of surface contact during a pandemic. Existing gesture-recognition systems do not possess user…

Human-Computer Interaction · Computer Science 2022-09-08 Ankit Jha , Ishita , Pratham G. Shenwai , Ayush Batra , Siddharth Kotian , Piyush Modi

In this work, we use MEMS microphones as vibration sensors to simultaneously classify texture and estimate contact position and velocity. Vibration sensors are an important facet of both human and robotic tactile sensing, providing fast…

Estimating 3D hand pose from monocular RGB images is fundamental for applications in AR/VR, human-computer interaction, and sign language understanding. In this work we focus on a scenario where a discrete set of gesture labels is available…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Rui Hong , Jana Kosecka

Online recognition of gestures is critical for intuitive human-robot interaction (HRI) and further push collaborative robotics into the market, making robots accessible to more people. The problem is that it is difficult to achieve accurate…

Robotics · Computer Science 2023-04-17 M. A. Simão , O. Gibaru , P. Neto

Fiber-optic sensing, especially distributed optical fiber vibration (DVS) sensing, is gaining importance in internet of things (IoT) applications, such as industrial safety monitoring and intrusion detection. Despite their wide application,…

Systems and Control · Electrical Eng. & Systems 2024-08-23 Zhongyao Luo , Hao Wu , Zhao Ge , Ming Tang

Spotting signal patterns with varying lengths has been still an open problem in the literature. In this study, we describe a signal pattern recognition approach for continuous and simultaneous classification of a tracked hand's posture and…

Robotics · Computer Science 2015-12-03 Ali Boyali , Naohisa Hashimoto , Manolya Kavakli

We present an on-device real-time hand gesture recognition (HGR) system, which detects a set of predefined static gestures from a single RGB camera. The system consists of two parts: a hand skeleton tracker and a gesture classifier. We use…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 George Sung , Kanstantsin Sokal , Esha Uboweja , Valentin Bazarevsky , Jonathan Baccash , Eduard Gabriel Bazavan , Chuo-Ling Chang , Matthias Grundmann

Vibration patterns yield valuable information about the health state of a running machine, which is commonly exploited in predictive maintenance tasks for large industrial systems. However, the overhead, in terms of size, complexity and…

Neural and Evolutionary Computing · Computer Science 2021-06-03 Nik Dennler , Germain Haessig , Matteo Cartiglia , Giacomo Indiveri

User's intentions may be expressed through spontaneous gesturing, which have been seen only a few times or never before. Recognizing such gestures involves one shot gesture learning. While most research has focused on the recognition of the…

Human-Computer Interaction · Computer Science 2017-01-24 Maria Cabrera , Richard Voyles , Juan Wachs

Tactile sensing is vital for human dexterous manipulation, however, it has not been widely used in robotics. Compact, low-cost sensing platforms can facilitate a change, but unlike their popular optical counterparts, they are difficult to…

Robotics · Computer Science 2025-03-10 Adrian Röfer , Nick Heppert , Abdallah Ayad , Eugenio Chisari , Abhinav Valada

Gesture recognition is one of the most intuitive ways of interaction and has gathered particular attention for human computer interaction. Radar sensors possess multiple intrinsic properties, such as their ability to work in low…

Signal Processing · Electrical Eng. & Systems 2022-05-20 Souvik Hazra , Hao Feng , Gamze Naz Kiprit , Michael Stephan , Lorenzo Servadei , Robert Wille , Robert Weigel , Avik Santra

The uncertainty and variability of underwater environment propose the request to control underwater robots in real time and dynamically, especially in the scenarios where human and robots need to work collaboratively in the field. However,…

Human-Computer Interaction · Computer Science 2017-09-27 Pei Xu

A large number of sensors deployed in recent years in various setups and their data is readily available in dedicated databases or in the cloud. Of particular interest is real-time data processing and 3D visualization in web-based user…

Signal Processing · Electrical Eng. & Systems 2019-08-27 Felix G. Hamza-Lup , Ionut E. Iacob , Sushmita Khan

Humans display the remarkable ability to sense the world through tools and other held objects. For example, we are able to pinpoint impact locations on a held rod and tell apart different textures using a rigid probe. In this work, we…