English
Related papers

Related papers: TinyGaze: Lightweight Gaze-Gesture Recognition on …

200 papers

Gesture recognition has become increasingly important in human-computer interaction and can support different applications such as smart home, VR, and gaming. Traditional approaches usually rely on dedicated sensors that are worn by the…

Human-Computer Interaction · Computer Science 2021-06-03 Sheng Tan , Jie Yang

Gesture recognition is a cornerstone of Human-Computer Interaction (HCI) for smart eyewear, enabling natural and device-free control in augmented reality environments. Traditional vision-based approaches face significant challenges…

Machine Learning · Computer Science 2026-05-14 Pietro Bartoli , Christian Veronesi , Tommaso Bondini , Andrea Giudici , Franco Zappa

We propose a fully automatic method for learning gestures on big touch devices in a potentially multi-user context. The goal is to learn general models capable of adapting to different gestures, user styles and hardware variations (e.g.…

Machine Learning · Computer Science 2018-02-28 Quentin Debard , Christian Wolf , Stéphane Canu , Julien Arné

The use of tiny devices capable of low-latency gesture recognition is gaining momentum in everyday human-computer interaction and especially in medical monitoring fields. Embedded solutions such as fall detection, rehabilitation tracking,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Veeramani Pugazhenthi , Wei-Hsiang Chu , Junwei Lu , Jadyn N. Miyahira , Mahdi Eslamimehr , Pratik Satam , Rozhin Yasaei , Soheil Salehi

This work proposes a low-power high-accuracy embedded hand-gesture recognition algorithm targeting battery-operated wearable devices using low power short-range RADAR sensors. A 2D Convolutional Neural Network (CNN) using range frequency…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Moritz Scherer , Michele Magno , Jonas Erb , Philipp Mayer , Manuel Eggimann , Luca Benini

Recent human activity recognition (HAR) methods, based on on-body inertial sensors, have achieved increasing performance; however, this is at the expense of longer CPU calculations and greater energy consumption. Therefore, these complex…

Computers and Society · Computer Science 2018-09-26 Roman Chereshnev , Attila Kertesz-Farkas

We propose a novel low-complexity lidar gesture recognition system for mobile robot control robust to gesture variation. Our system uses a modular approach, consisting of a pose estimation module and a gesture classifier. Pose estimates are…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Simon Chamorro , Jack Collier , François Grondin

Mobile eye tracking plays a vital role in capturing human visual attention across both real-world and extended reality (XR) environments, making it an essential tool for applications ranging from behavioural research to human-computer…

Human-Computer Interaction · Computer Science 2025-11-05 Chuhan Jiao , Zhiming Hu , Andreas Bulling

Lightweight augmented reality (AR) glasses are increasingly entering everyday use, extending interaction design beyond short, isolated sessions. However, most existing gesture vocabularies are inherited from VR headsets or early AR goggles.…

Human-Computer Interaction · Computer Science 2026-03-17 Wei Wu , Binyan Xu , Soonhyeon Kweon , Yujie Wang , Leanne Chukoskie , Casper Harteveld

Previous studies have illustrated the potential of analysing gaze behaviours in collaborative learning to provide educationally meaningful information for students to reflect on their learning. Over the past decades, machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junyuan Liang , Qi Zhou , Sahan Bulathwela , Mutlu Cukurova

Smartphones with large screens provide users with increased display and interaction space but pose challenges in reaching certain areas with the thumb when using the device with one hand. To address this, we introduce GazeSwipe, a…

Human-Computer Interaction · Computer Science 2025-03-28 Zhuojiang Cai , Jingkai Hong , Zhimin Wang , Feng Lu

Existing gesture interfaces only work with a fixed set of gestures defined either by interface designers or by users themselves, which introduces learning or demonstration efforts that diminish their naturalness. Humans, on the other hand,…

Computation and Language · Computer Science 2024-11-05 Xin Zeng , Xiaoyu Wang , Tengxiang Zhang , Chun Yu , Shengdong Zhao , Yiqiang Chen

Despite widespread adoption of smartwatches worldwide, open-benchmarks for wrist-based gesture recognition remain surprisingly limited. In this work, we introduce the first open-access multi-modal benchmark, OpenWatch, for wrist-based…

Human-Computer Interaction · Computer Science 2026-05-08 Pietro Bonazzi , Youssef Ahmed , Daniel Eckert , Andrea Ronco , Junjie Zeng , Dengxin Dai , Michele Magno

Augmented Reality (AR) enables intuitive interaction with virtual annotations overlaid on the real world, supporting a wide range of applications such as remote assistance, education, and industrial training. However, as the number of…

Human-Computer Interaction · Computer Science 2025-09-16 Zahra Borhani , Ali Ebrahimpour-Boroojeny , Francisco R. Ortega

Assistive robotic systems endeavour to support those with movement disabilities, enabling them to move again and regain functionality. Main issue with these systems is the complexity of their low-level control, and how to translate this to…

Robotics · Computer Science 2019-03-07 Ali Shafti , Pavel Orlov , A. Aldo Faisal

Gesture recognition is mainly apprehensive on analyzing the functionality of human wits. The main goal of gesture recognition is to create a system which can recognize specific human gestures and use them to convey information or for device…

Artificial Intelligence · Computer Science 2010-12-02 Harshith C , Karthik R. Shastry , Manoj Ravindran , M. V. V. N. S. Srikanth , Naveen Lakshmikhanth

Various health-care applications such as assisted living, fall detection etc., require modeling of user behavior through Human Activity Recognition (HAR). HAR using mobile- and wearable-based deep learning algorithms have been on the rise…

Machine Learning · Computer Science 2019-06-04 Gautham Krishna Gudur , Prahalathan Sundaramoorthy , Venkatesh Umaashankar

Static and dynamic hand movements are basic way for human-machine interactions. To recognize and classify these movements, first these movements are captured by the cameras mounted on the augmented reality (AR) or virtual reality (VR)…

Human-Computer Interaction · Computer Science 2020-04-03 Nizamuddin Maitlo , Yanbo Wang , Chao Ping Chen , Lantian Mi , Wenbo Zhang

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap where existing AGE models often fail in practical, unconstrained scenarios, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhenhao Li , Zheng Liu , Seunghyun Lee , Amin Fadaeinejad , Yuanhao Yu