English
Related papers

Related papers: Gesture Based Interaction NUI: An Overview

200 papers

IUIs aim to incorporate intelligent automated capabilities in human computer interaction, where the net impact is a human-computer interaction that improves performance or usability in critical ways. It also involves designing and…

Human-Computer Interaction · Computer Science 2017-02-20 Daniel Sonntag

Hand gestures play a significant role in human interactions where non-verbal intentions, thoughts and commands are conveyed. In Human-Robot Interaction (HRI), hand gestures offer a similar and efficient medium for conveying clear and rapid…

Robotics · Computer Science 2024-04-11 Eran Bamani , Eden Nissinman , Inbar Meir , Lisa Koenigsberg , Avishai Sintov

Gestures are central to human communication, enriching interactions through non-verbal expression. Virtual avatars increasingly use AI-generated gestures to enhance life-likeness, yet evaluations have largely been confined to 2D. Virtual…

Human-Computer Interaction · Computer Science 2025-09-17 Axel Wiebe Werner , Jonas Beskow , Anna Deichler

The conventional GUI is more mechanical and does not recognize or communicate emotions. The modern GUIs are trying to infer the likely emotional state and personality of the user and communicate through a corresponding emotional state.…

Human-Computer Interaction · Computer Science 2014-04-29 Umakant Mishra

This paper presents a telepresence interaction framework based on touchscreen and telepresence-robot technologies. The core of the framework is a new user interface, Touchable live video Image based User Interface, called TIUI. The TIUI…

Human-Computer Interaction · Computer Science 2016-08-23 Yunde Jia , Bin Xu , Jiajun Shen , Mintao Pei , Zhen Dong , Jingyi Hou , Min Yang

Physical human-robot interactions (pHRI) are less efficient and communicative than human-human interactions, and a key reason is a lack of informative sense of touch in robotic systems. Interpreting human touch gestures is a nuanced,…

Robotics · Computer Science 2024-12-24 Bibit Bianchini , Prateek Verma , Kenneth Salisbury

This chapter gives an overview of interaction techniques for mixed reality including augmented and virtual reality (AR/VR). Various modalities for input and output are discussed. Specifically, techniques for tangible and surface-based…

Human-Computer Interaction · Computer Science 2021-03-11 Jens Grubert

The hand gestures are one of the typical methods used in sign language. It is very difficult for the hearing-impaired people to communicate with the world. This project presents a solution that will not only automatically recognize the hand…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 K. Manikandan , Ayush Patidar , Pallav Walia , Aneek Barman Roy

The goal of this work is the identification of humans based on motion data in the form of natural hand gestures. In this paper, the identification problem is formulated as classification with classes corresponding to persons' identities,…

Human-Computer Interaction · Computer Science 2013-03-20 Michał Romaszewski , Przemysław Głomb , Piotr Gawron

Human interactions are characterized by explicit as well as implicit channels of communication. While the explicit channel transmits overt messages, the implicit ones transmit hidden messages about the communicator (e.g., his/her intentions…

Human-Computer Interaction · Computer Science 2017-07-12 Katie Hoemann , Behnaz Rezaei , Stacy C. Marsella , Sarah Ostadabbas

This paper proposes an interactive system for mobile devices controlled by hand gestures aimed at helping people with visual impairments. This system allows the user to interact with the device by making simple static and dynamic hand…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Samer Alashhab , Antonio Javier Gallego , Miguel Ángel Lozano

Self-touch gestures (e.g., nuanced facial touches and subtle finger scratches) provide rich insights into human behaviors, from hygiene practices to health monitoring. However, existing approaches fall short in detecting such micro gestures…

Human-Computer Interaction · Computer Science 2026-02-25 Siyuan Wang , Ke Li , Jingyuan Huang , Jike Wang , Cheng Zhang , Alanson Sample , Dongyao Chen

Hand gesture recognition attracts great attention for interaction since it is intuitive and natural to perform. In this paper, we explore a novel method for interaction by using bone-conducted sound generated by finger movements while…

Human-Computer Interaction · Computer Science 2021-12-14 Bing Zhou , Matias Aiskovich , Sinem Guven

Hand gesture recognition allows humans to interact with machines non-verbally, which has a huge application in underwater exploration using autonomous underwater vehicles. Recently, a new gesture-based language called CADDIAN has been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Sandipan Sarma , Gundameedi Sai Ram Mohan , Hariansh Sehgal , Arijit Sur

Hand gesture is one of the most important means of touchless communication between human and machines. There is a great interest for commanding electronic equipment in surgery rooms by hand gesture for reducing the time of surgery and the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Ebrahim Nasr-Esfahani , Nader Karimi , S. M. Reza Soroushmehr , M. Hossein Jafari , M. Amin Khorsandi , Shadrokh Samavi , Kayvan Najarian

Gestures form an important medium of communication between humans and machines. An overwhelming majority of existing gesture recognition methods are tailored to a scenario where humans and machines are located very close to each other. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Shubhang Bhatnagar , Sharath Gopal , Narendra Ahuja , Liu Ren

We propose a set of communicative gestures and develop a gesture recognition system with the aim of facilitating more intuitive Human-Robot Interaction (HRI) through gestures. First, we propose a set of commands commonly used for…

Robotics · Computer Science 2021-09-22 Jia Chuan A. Tan , Wesley P. Chan , Nicole L. Robinson , Elizabeth A. Croft , Dana Kulic

People communicate using both speech and non-verbal signals such as gestures, face expression or body pose. Non-verbal signals impact the meaning of the spoken utterance in an abundance of ways. An absence of non-verbal signals impoverishes…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Manuel Rebol , Christian Gütl , Krzysztof Pietroszek

Modern mobile applications rely on hidden interactions--gestures without visual cues like long presses and swipes--to provide functionality without cluttering interfaces. While experienced users may discover these interactions through prior…

Human-Computer Interaction · Computer Science 2026-01-28 Minkyu Kweon , Seokhyeon Park , Soohyun Lee , You Been Lee , Jeongmin Rhee , Jinwook Seo

The Human-Machine Interaction (HMI) research field is an important topic in machine learning that has been deeply investigated thanks to the rise of computing power in the last years. The first time, it is possible to use machine learning…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Jonas Bokstaller , Costanza Maria Improta