English
Related papers

Related papers: Acoustic Sensing-based Hand Gesture Detection for …

200 papers

At the present time, hand gestures recognition system could be used as a more expected and useable approach for human computer interaction. Automatic hand gesture recognition system provides us a new tactic for interactive with the virtual…

Computer Vision and Pattern Recognition · Computer Science 2014-08-08 Reza Azad , Babak Azad , Nabil Belhaj Khalifa , Shahram Jamali

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without…

Human-Computer Interaction · Computer Science 2022-07-05 Alexander Schäfer , Gerd Reis , Didier Stricker

We introduce a real-time, human-in-the-loop gesture control framework that can dynamically adapt audio and music based on human movement by analyzing live video input. By creating a responsive connection between visual and auditory stimuli,…

Human-Computer Interaction · Computer Science 2025-04-29 Mahya Khazaei , Ali Bahrani , George Tzanetakis

Direct and natural interaction is essential for intuitive human-robot collaboration, eliminating the need for additional devices such as joysticks, tablets, or wearable sensors. In this paper, we present a lightweight deep learning-based…

In this research, we aim to realize cushion interface for operating smart home. We designed user-defined gestures using cushion and developed gesture recognition system. We asked some users to make gestures using cushions for operating home…

Human-Computer Interaction · Computer Science 2024-10-08 Yuri Suzuki , Kaho Kato , Naomi Furui , Daisuke Sakamoto , Yuta Sugiura

In this work, we propose a gesture based language to allow humans to interact with robots using their body in a natural way. We have created a new gesture detection model using neural networks and a custom dataset of humans performing a set…

Robotics · Computer Science 2022-06-16 Javier Laplaza , Joan Jaume Oliver , Ramón Romero , Alberto Sanfeliu , Anaís Garrell

Ultrasound imaging of the forearm has demonstrated significant potential for accurate hand gesture classification. Despite this progress, there has been limited focus on developing a stand-alone end- to-end gesture recognition system which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Keshav Bimbraw , Haichong K. Zhang , Bashima Islam

Distributed tactile sensing remains difficult to scale over large areas: dense sensor arrays increase wiring, cost, and fragility, while many alternatives provide limited coverage or miss fast interaction dynamics. We present Sound of…

Robotics · Computer Science 2026-02-20 Xili Yi , Ying Xing , Zachary Manchester , Nima Fazeli

Humans are able to convey different messages using only touch. Equipping robots with the ability to understand social touch adds another modality in which humans and robots can communicate. In this paper, we present a social gesture…

Robotics · Computer Science 2025-03-24 Dakarai Crowder , Kojo Vandyck , Xiping Sun , James McCann , Wenzhen Yuan

Grip force is commonly used as an overall health indicator in older adults and is valuable for tracking progress in physical training and rehabilitation. Existing methods for wearable grip force measurement are cumbersome and…

Human-Computer Interaction · Computer Science 2025-07-29 Kian Mahmoodi , Yudong Xie , Tan Gemicioglu , Chi-Jung Lee , Jiwan Kim , Cheng Zhang

As computing devices become increasingly integrated into daily life, there is a growing need for intuitive, always-available interaction methods, even when users' hands are occupied. In this paper, we introduce Grab-n-Go, the first wearable…

Human-Computer Interaction · Computer Science 2025-08-18 Chi-Jung Lee , Jiaxin Li , Tianhong Catherine Yu , Ruidong Zhang , Vipin Gunda , François Guimbretière , Cheng Zhang

Gestures are essential for enhancing co-speech communication, offering visual emphasis and complementing verbal interactions. While prior work has concentrated on point-level motion or fully supervised data-driven methods, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jiahui Chen , Yang Huan , Runhua Shi , Chanfan Ding , Xiaoqi Mo , Siyu Xiong , Yinong He

We present HeadText, a hands-free technique on a smart earpiece for text entry by motion sensing. Users input text utilizing only 7 head gestures for key selection, word selection, word commitment and word cancelling tasks. Head gesture…

Human-Computer Interaction · Computer Science 2022-05-24 Songlin Xu , Guanjie Wang , Ziyuan Fang , Guangwei Zhang , Guangzhu Shang , Rongde Lu , Liqun He

With the growing technology, we humans always need something that stands out from the other thing. Gestures are most desirable source to Communicate with the Machines. Human Computer Interaction finds its importance when it comes to working…

Human-Computer Interaction · Computer Science 2014-11-20 Sandeep Vasave , Amol Plave

Motivated by the growing interest in enhancing intuitive physical Human-Machine Interaction (HRI/HVI), this study aims to propose a robust tactile hand gesture recognition system. We performed a comprehensive evaluation of different hand…

Human-Computer Interaction · Computer Science 2024-05-28 Chiara Fumelli , Anirvan Dutta , Mohsen Kaboli

Hand gesture recognition possesses extensive applications in virtual reality, sign language recognition, and computer games. The direct interface of hand gestures provides us a new way for communicating with the virtual environment. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-08-11 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

This paper proposes an interactive system for mobile devices controlled by hand gestures aimed at helping people with visual impairments. This system allows the user to interact with the device by making simple static and dynamic hand…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Samer Alashhab , Antonio Javier Gallego , Miguel Ángel Lozano

This paper presents a novel soft tactile skin (STS) technology operating with sound waves. In this innovative approach, the sound waves generated by a speaker travel in channels embedded in a soft membrane and get modulated due to a…

Robotics · Computer Science 2024-03-01 Vishnu Rajendran S , Willow Mandil , Simon Parsons , Amir Ghalamzan E

Hand pose tracking is essential for advancing applications in human-computer interaction. Current approaches, such as vision-based systems and wearable devices, face limitations in portability, usability, and practicality. We present a…

Human-Computer Interaction · Computer Science 2025-10-07 Yingjing Xiao , Zhichao Huang , Junbin Ren , Haichuan Song , Yang Gao , Yuting Bai , Zhanpeng Jin

Rich contact perception is crucial for robotic manipulation, yet traditional tactile skins remain expensive and complex to integrate. This paper presents a scalable alternative: high-accuracy whole-body touch localization via vibro-acoustic…

Robotics · Computer Science 2026-01-29 Wadhah Zai El Amri , Nicolás Navarro-Guerrero