English
Related papers

Related papers: Synthetic Video Generation for Robust Hand Gesture…

200 papers

Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in this field, gesture customization is often underexplored.…

Human-Computer Interaction · Computer Science 2024-10-04 Soroush Shahi , Vimal Mollyn , Cori Tymoszek Park , Richard Kang , Asaf Liberman , Oron Levy , Jun Gong , Abdelkareem Bedri , Gierad Laput

Human-Robot Interaction (HRI) has become increasingly important as robots are being integrated into various aspects of daily life. One key aspect of HRI is gesture recognition, which allows robots to interpret and respond to human gestures…

Human-Computer Interaction · Computer Science 2024-01-10 Sandeep Reddy Sabbella , Sara Kaszuba , Francesco Leotta , Pascal Serrarens , Daniele Nardi

Hand gesture is one of the most important means of touchless communication between human and machines. There is a great interest for commanding electronic equipment in surgery rooms by hand gesture for reducing the time of surgery and the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Ebrahim Nasr-Esfahani , Nader Karimi , S. M. Reza Soroushmehr , M. Hossein Jafari , M. Amin Khorsandi , Shadrokh Samavi , Kayvan Najarian

Gesture recognition is a hot topic in computer vision and pattern recognition, which plays a vitally important role in natural human-computer interface. Although great progress has been made recently, fast and robust hand gesture…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Hao Tang , Hong Liu , Wei Xiao , Nicu Sebe

This publication reports on a research project in which we set out to explore the advantages and disadvantages augmented reality (AR) technology has for visual data analytics. We developed a prototype of an AR data analytics application,…

Human-Computer Interaction · Computer Science 2020-10-15 Wanze Xie , Yining Liang , Janet Johnson , Andrea Mower , Samuel Burns , Colleen Chelini , Paul D Alessandro , Nadir Weibel , Jürgen P. Schulze

Hand Gesture Recognition (HGR) enables intuitive human-computer interactions in various real-world contexts. However, existing frameworks often struggle to meet the real-time requirements essential for practical HGR applications. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Oluwaleke Yusuf , Maki Habib , Mohamed Moustafa

The ongoing usage of artificial intelligence technologies in virtual reality has led to a large number of researchers exploring immersive virtual reality interaction. Gesture controllers and head-mounted displays are the primary pieces of…

Human-Computer Interaction · Computer Science 2024-05-28 Jindi Wang

Hand gesture recognition attracts great attention for interaction since it is intuitive and natural to perform. In this paper, we explore a novel method for interaction by using bone-conducted sound generated by finger movements while…

Human-Computer Interaction · Computer Science 2021-12-14 Bing Zhou , Matias Aiskovich , Sinem Guven

Electromyography (EMG)-based gesture recognition has emerged as a promising approach for human-computer interaction. However, its performance is often limited by the scarcity of labeled EMG data, significant cross-user variability, and poor…

Human-Computer Interaction · Computer Science 2025-12-11 Nana Wang , Gen Li , Pengfei Ren , Hao Su , Suli Wang

Deep generative models have various content creation applications such as graphic design, e-commerce, and virtual Try-on. However, current works mainly focus on synthesizing realistic visual outputs, often ignoring other sensory modalities,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Ruihan Gao , Wenzhen Yuan , Jun-Yan Zhu

Gestures are essential for enhancing co-speech communication, offering visual emphasis and complementing verbal interactions. While prior work has concentrated on point-level motion or fully supervised data-driven methods, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Jiahui Chen , Yang Huan , Runhua Shi , Chanfan Ding , Xiaoqi Mo , Siyu Xiong , Yinong He

Co-speech gesture generation is crucial for creating lifelike avatars and enhancing human-computer interactions by synchronizing gestures with speech. Despite recent advancements, existing methods struggle with accurately identifying the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pinxin Liu , Pengfei Zhang , Hyeongwoo Kim , Pablo Garrido , Ari Shapiro , Kyle Olszewski

Body language such as conversational gesture is a powerful way to ease communication. Conversational gestures do not only make a speech more lively but also contain semantic meaning that helps to stress important information in the…

Robotics · Computer Science 2022-10-14 Hitoshi Teshima , Naoki Wake , Diego Thomas , Yuta Nakashima , Hiroshi Kawasaki , Katsushi Ikeuchi

High-fidelity hand gesture generation represents a significant challenge in human-centric generation tasks. Existing methods typically employ a single-view mesh-rendered image prior to enhancing gesture generation quality. However, the…

Graphics · Computer Science 2025-08-07 Qifan Fu , Xu Chen , Muhammad Asad , Shanxin Yuan , Changjae Oh , Gregory Slabaugh

Hand gesture-based human-computer interaction is an important problem that is well explored using color camera data. In this work we proposed a hand gesture detection system using thermal images. Our system is capable of handling multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 James Ballow , Soumyabrata Dey

Hand gestures are an intuitive, socially acceptable, and a non-intrusive interaction modality in Mixed Reality (MR) and smartphone based applications. Unlike speech interfaces, they tend to perform well even in shared and public spaces.…

Human-Computer Interaction · Computer Science 2019-04-15 Varun Jain , Ramya Hebbalaguppe

Gesture synthesis has gained significant attention as a critical research field, aiming to produce contextually appropriate and natural gestures corresponding to speech or textual input. Although deep learning-based approaches have achieved…

Computation and Language · Computer Science 2024-05-29 Nan Gao , Zeyu Zhao , Zhi Zeng , Shuwu Zhang , Dongdong Weng , Yihua Bao

Synthesizing 3D human avatars interacting realistically with a scene is an important problem with applications in AR/VR, video games and robotics. Towards this goal, we address the task of generating a virtual human -- hands and full body…

Robotics · Computer Science 2023-03-30 Purva Tendulkar , Dídac Surís , Carl Vondrick

Automated hand gesture recognition has been a focus of the AI community for decades. Traditionally, work in this domain revolved largely around scenarios assuming the availability of the flow of images of the user hands. This has partly…

Machine Learning · Computer Science 2023-05-15 Ying Liu , Liucheng Guo , Valeri A. Makarov , Yuxiang Huang , Alexander Gorban , Evgeny Mirkes , Ivan Y. Tyukin

Dynamic hand tracking and gesture recognition is a hard task since there are many joints on the fingers and each joint owns many degrees of freedom. Besides, object occlusion is also a thorny issue in finger tracking and posture…

Human-Computer Interaction · Computer Science 2018-09-18 Zhishuai Han , Xiaojuan Ban , Xiaokun Wang , Di wu