English
Related papers

Related papers: Hand Gesture Detection and Conversion to Speech an…

200 papers

In this study, we present a wireless (non-contact) gesture recognition method using only incoherent light wave signals reflected from a human subject. In comparison to existing radar, light shadow, sound and camera-based sensing systems,…

Signal Processing · Electrical Eng. & Systems 2023-06-14 Md Zobaer Islam , Li Yu , Hisham Abuella , John F. O'Hara , Christopher Crick , Sabit Ekin

This paper presents a new method for detecting and classifying a predefined set of hand gestures using a single transmitter and a single receiver utilizing a linearly frequency modulated ultrasonic signal. Gestures are identified based on…

Signal Processing · Electrical Eng. & Systems 2017-10-25 Mohammed H. AlSharif , Mohamed Saad , Tareq Y. Al-Naffouri

Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in this field, gesture customization is often underexplored.…

Human-Computer Interaction · Computer Science 2024-10-04 Soroush Shahi , Vimal Mollyn , Cori Tymoszek Park , Richard Kang , Asaf Liberman , Oron Levy , Jun Gong , Abdelkareem Bedri , Gierad Laput

Human-Robot Interaction (HRI) has become increasingly important as robots are being integrated into various aspects of daily life. One key aspect of HRI is gesture recognition, which allows robots to interpret and respond to human gestures…

Human-Computer Interaction · Computer Science 2024-01-10 Sandeep Reddy Sabbella , Sara Kaszuba , Francesco Leotta , Pascal Serrarens , Daniele Nardi

Hand gestures recognition (HGR) is one of the main areas of research for the engineers, scientists and bioinformatics. HGR is the natural way of Human Machine interaction and today many researchers in the academia and industry are working…

Human-Computer Interaction · Computer Science 2013-03-12 Ankit Chaudhary , J. L. Raheja , Karen Das , Sonia Raheja

Speaker extraction seeks to extract the clean speech of a target speaker from a multi-talker mixture speech. There have been studies to use a pre-recorded speech sample or face image of the target speaker as the speaker cue. In human…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-20 Zexu Pan , Xinyuan Qian , Haizhou Li

We propose a new technique for recognition of dumb person hand gesture in real world environment. In this technique, the hand image containing the gesture is preprocessed and then hand region is segmented by convergent the RGB color image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Muhammad Asim Khan , Lan Hong , Sajjad Ahmed

Gestures are inherent to human interaction and often complement speech in face-to-face communication, forming a multimodal communication system. An important task in gesture analysis is detecting a gesture's beginning and end. Research on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Esam Ghaleb , Ilya Burenko , Marlou Rasenberg , Wim Pouw , Ivan Toni , Peter Uhrig , Anna Wilson , Judith Holler , Aslı Özyürek , Raquel Fernández

Gesture behavior is a natural part of human conversation. Much work has focused on removing the need for tedious hand-animation to create embodied conversational agents by designing speech-driven gesture generators. However, these…

Human-Computer Interaction · Computer Science 2020-10-05 Ylva Ferstl , Michael Neff , Rachel McDonnell

The goal of this project is to create an inexpensive, lightweight, wearable assistive device that can measure hand or finger movements accurately enough to identify a range of hand gestures. One eventual application is to provide assistive…

Human-Computer Interaction · Computer Science 2020-09-29 Sanjay Seshan

During speech, people spontaneously gesticulate, which plays a key role in conveying information. Similarly, realistic co-speech gestures are crucial to enable natural and smooth interactions with social agents. Current end-to-end co-speech…

Human-Computer Interaction · Computer Science 2021-01-15 Taras Kucherenko , Patrik Jonell , Sanne van Waveren , Gustav Eje Henter , Simon Alexanderson , Iolanda Leite , Hedvig Kjellström

We introduce a real-time, human-in-the-loop gesture control framework that can dynamically adapt audio and music based on human movement by analyzing live video input. By creating a responsive connection between visual and auditory stimuli,…

Human-Computer Interaction · Computer Science 2025-04-29 Mahya Khazaei , Ali Bahrani , George Tzanetakis

This study mainly explores the application of natural gesture recognition based on computer vision in human-computer interaction, aiming to improve the fluency and naturalness of human-computer interaction through gesture recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Fenghua Shao , Tong Zhang , Shang Gao , Qi Sun , Liuqingqing Yang

Co-speech gesture generation is crucial for creating lifelike avatars and enhancing human-computer interactions by synchronizing gestures with speech. Despite recent advancements, existing methods struggle with accurately identifying the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pinxin Liu , Pengfei Zhang , Hyeongwoo Kim , Pablo Garrido , Ari Shapiro , Kyle Olszewski

Gestures performed accompanying the voice are essential for voice interaction to convey complementary semantics for interaction purposes such as wake-up state and input modality. In this paper, we investigated voice-accompanying…

Human-Computer Interaction · Computer Science 2023-03-21 Zisu Li , Cheng Liang , Yuntao Wang , Yue Qin , Chun Yu , Yukang Yan , Mingming Fan , Yuanchun Shi

American Sign Language recognition is a difficult gesture recognition problem, characterized by fast, highly articulate gestures. These are comprised of arm movements with different hand shapes, facial expression and head movements. Among…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Al Amin Hosain , Panneer Selvam Santhalingam , Parth Pathak , Huzefa Rangwala , Jana Kosecka

Sign Language is used to facilitate the communication between Deaf and non-Deaf people. It uses signs-words with basic structural elements such as handshape, parts of face, body or space, and the orientation of the fingers-palm. Sign…

Human-Computer Interaction · Computer Science 2020-12-23 Maria Papatsimouli , Lazaros Lazaridis , Konstantinos-Filippos Kollias , Ioannis Skordas , George F. Fragulis

Body language such as conversational gesture is a powerful way to ease communication. Conversational gestures do not only make a speech more lively but also contain semantic meaning that helps to stress important information in the…

Robotics · Computer Science 2022-10-14 Hitoshi Teshima , Naoki Wake , Diego Thomas , Yuta Nakashima , Hiroshi Kawasaki , Katsushi Ikeuchi

When humans speak, gestures help convey communicative intentions, such as adding emphasis or describing concepts. However, current co-speech gesture generation methods rely solely on superficial linguistic cues (e.g. speech audio or text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Pinxin Liu , Haiyang Liu , Luchuan Song , Jason J. Corso , Chenliang Xu

This software project based paper is for a vision of the near future in which computer interaction is characterized by natural face-to-face conversations with lifelike characters that speak, emote, and gesture. The first step is speech. The…

Human-Computer Interaction · Computer Science 2013-05-10 Urmila Shrawankar , Anjali Mahajan