English
Related papers

Related papers: GesPlayer: Using Augmented Gestures to Empower Vid…

200 papers

This paper presents a sensorized vision-enabled prosthetic hand aimed at replicating a natural hand's performance, functionality, appearance, and comfort. The design goal was to create an accessible substitution with a user-friendly…

Human-Computer Interaction · Computer Science 2024-07-23 Md Abdul Baset Sarker , Juan Pablo S. Sola , Aaron Jones , Evan Laing , Ernesto Sola-Thomas , Masudul H. Imtiaz

Hand gestures are a natural means of interaction in Augmented Reality and Virtual Reality (AR/VR) applications. Recently, there has been an increased focus on removing the dependence of accurate hand gesture recognition on complex sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Varun Jain , Shivam Aggarwal , Suril Mehta , Ramya Hebbalaguppe

Advancements in information technology have increased demand for natural human-computer interaction in areas such as gaming, smart homes, and vehicles. However, conventional approaches like physical buttons or cameras are often limited by…

Human-Computer Interaction · Computer Science 2025-11-24 Weiyi Wang , Lanqing Yang , Linqian Gan , Guangtao Xue

The ongoing usage of artificial intelligence technologies in virtual reality has led to a large number of researchers exploring immersive virtual reality interaction. Gesture controllers and head-mounted displays are the primary pieces of…

Human-Computer Interaction · Computer Science 2024-05-28 Jindi Wang

Assistive devices for indivuals with upper-limb movement often lack controllability and intuitiveness, in particular for grasping function. In this work, we introduce a novel user interface for grasping movement control in which the user…

Quantitative Methods · Quantitative Biology 2023-06-28 Etienne Moullet , François Bailly , Justin Carpentier , Christine Azevedo Coste

We present an advance in wearable technology: a mobile-optimized, real-time, ultra-low-power event camera system that enables natural hand gesture control for smart glasses, dramatically improving user experience. While hand gesture…

Co-speech gesture generation is crucial for creating lifelike avatars and enhancing human-computer interactions by synchronizing gestures with speech. Despite recent advancements, existing methods struggle with accurately identifying the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pinxin Liu , Pengfei Zhang , Hyeongwoo Kim , Pablo Garrido , Ari Shapiro , Kyle Olszewski

Around-device interaction promises to extend the input space of mobile and wearable devices beyond the common but restricted touchscreen. So far, most around-device interaction approaches rely on instrumenting the device or the environment…

Human-Computer Interaction · Computer Science 2017-01-17 Jens Grubert , Eyal Ofek , Michel Pahud , Matthias Kranz , Dieter Schmalstieg

We present Playable Environments - a new representation for interactive video generation and manipulation in space and time. With a single image at inference time, our novel framework allows the user to move objects in 3D while generating a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Willi Menapace , Stéphane Lathuilière , Aliaksandr Siarohin , Christian Theobalt , Sergey Tulyakov , Vladislav Golyanik , Elisa Ricci

In recent years, there has been a considerable amount of research in the Gesture Recognition domain, mainly owing to the technological advancements in Computer Vision. Various new applications have been conceptualised and developed in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kshitij Deshpande , Varad Mashalkar , Kaustubh Mhaisekar , Amaan Naikwadi , Archana Ghotkar

Recent advancements in eye tracking technology are driving the adoption of gaze-assisted interaction as a rich and accessible human-computer interaction paradigm. Gaze-assisted interaction serves as a contextual, non-invasive, and explicit…

Human-Computer Interaction · Computer Science 2018-03-14 Vijay Rajanna , Tracy Hammond

In multiplayer cooperative video games, players traditionally use individual controllers, inferring others' actions through on-screen visuals and their own movements. This indirect understanding limits truly collaborative gameplay. Research…

Human-Computer Interaction · Computer Science 2024-11-19 Kenta Hashiura , Kazuya Iida , Takeru Hashimoto , Youichi Kamiyama , Keita Watanabe , Kouta Minamizawa , Takuji Narumi

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying…

Human-Computer Interaction · Computer Science 2025-05-09 Xiyun Hu , Dizhi Ma , Fengming He , Zhengzhe Zhu , Shao-Kang Hsia , Chenfei Zhu , Ziyi Liu , Karthik Ramani

Creating physically realistic content in VR often requires complex modeling tools or predefined 3D models, textures, and animations, which present significant barriers for non-expert users. In this paper, we propose SketchPlay, a novel VR…

Human-Computer Interaction · Computer Science 2025-12-29 Xiangwen Zhang , Xiaowei Dai , Runnan Chen , Xiaoming Chen , Zeke Zexi Hu

Touch,face,voice recognition and movement sensors all are part of an emerging field of computing often called natural user interface, or NUI. Interacting with technology in these humanistic ways is no longer limited to high tech secret…

Human-Computer Interaction · Computer Science 2014-04-10 Dr Manju Kaushik , Rashmi Jain

Hand gesture recognition attracts great attention for interaction since it is intuitive and natural to perform. In this paper, we explore a novel method for interaction by using bone-conducted sound generated by finger movements while…

Human-Computer Interaction · Computer Science 2021-12-14 Bing Zhou , Matias Aiskovich , Sinem Guven

Computers today aren't just confined to laptops and desktops. Mobile gadgets like mobile phones and laptops also make use of it. However, one input device that hasn't changed in the last 50 years is the QWERTY keyboard. Users of virtual…

Human-Computer Interaction · Computer Science 2022-08-02 Pabbathi Sri Charan , Saksham Gupta , Satvik Agrawal , Gadupudi Sahithi Sindhu

Hand gesture recognition has become an important research area, driven by the growing demand for human-computer interaction in fields such as sign language recognition, virtual and augmented reality, and robotics. Despite the rapid growth…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Manousos Linardakis , Iraklis Varlamis , Georgios Th. Papadopoulos

In this paper, a computer-vision-assisted simulation method is proposed to address the issue of training dataset acquisition for wireless hand gesture recognition. In the existing literature, in order to classify gestures via the wireless…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Zhenyu Ren , Guoliang Li , Chenqing Ji , Chao Yu , Shuai Wang , Rui Wang

Mixed Reality (MR) and Virtual Reality (VR) simulations are hampered by requirements for hand controllers or attempts to perseverate in use of two-dimensional computer interface paradigms from the 1980s. From our efforts to produce more…

Human-Computer Interaction · Computer Science 2023-08-16 Thomas B Talbot , Chinmay Chinara