English
Related papers

Related papers: Gesture Based Interaction NUI: An Overview

200 papers

Interacting with pedestrians understandably and efficiently is one of the toughest challenges faced by autonomous vehicles (AVs) due to the limitations of current algorithms and external human-machine interfaces (eHMIs). In this paper, we…

Human-Computer Interaction · Computer Science 2024-02-23 Xiang Chang , Zihe Chen , Xiaoyan Dong , Yuxin Cai , Tingmin Yan , Haolin Cai , Zherui Zhou , Guyue Zhou , Jiangtao Gong

Automotive User Interface (AutoUI) is relatively a new discipline in the context of both Transportation Engineering and Human Machine Interaction (HMI). It covers various HMI aspects both inside and outside vehicle ranging from operating…

Human-Computer Interaction · Computer Science 2021-06-01 Gowdham Prabhakar , Pradipta Biswas

The creation of virtual humans increasingly leverages automated synthesis of speech and gestures, enabling expressive, adaptable agents that effectively engage users. However, the independent development of voice and gesture generation…

Graphics · Computer Science 2025-07-02 Haoyang Du , Kiran Chhatre , Christopher Peters , Brian Keegan , Rachel McDonnell , Cathy Ennis

Online recognition of gestures is critical for intuitive human-robot interaction (HRI) and further push collaborative robotics into the market, making robots accessible to more people. The problem is that it is difficult to achieve accurate…

Robotics · Computer Science 2023-04-17 M. A. Simão , O. Gibaru , P. Neto

Automated hand gesture recognition has been a focus of the AI community for decades. Traditionally, work in this domain revolved largely around scenarios assuming the availability of the flow of images of the user hands. This has partly…

Machine Learning · Computer Science 2023-05-15 Ying Liu , Liucheng Guo , Valeri A. Makarov , Yuxiang Huang , Alexander Gorban , Evgeny Mirkes , Ivan Y. Tyukin

Emotion recognition technology is crucial in providing a personalized user experience. It is especially important in virtual reality(VR) to assess the user's emotions to enhance their sense of immersion. We propose an emotion recognition…

Human-Computer Interaction · Computer Science 2019-12-04 Jaehyun Nam , Hyesun Chung , Young ah Seong , Honggu Lee

With the rising interest in Virtual Reality and the fast development and improvement of available devices, new features of interactions are becoming available. One of them that is becoming very popular is hand tracking, as the idea to…

Human-Computer Interaction · Computer Science 2020-04-28 Jan-Niklas Voigt-Antons , Tanja Kojić , Danish Ali , Sebastian Möller

Humans inhabit a world defined by interactions -- with other humans, objects, and environments. These interactive movements not only convey our relationships with our surroundings but also demonstrate how we perceive and communicate with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Kewei Sui , Anindita Ghosh , Inwoo Hwang , Bing Zhou , Jian Wang , Chuan Guo

Extended Reality (XR), including virtual, augmented, and mixed reality, provides immersive and interactive experiences across diverse applications, from VR-based education to AR-based assistance and MR-based training. However, widespread XR…

Human-Computer Interaction · Computer Science 2026-01-23 Mingyu Zhu , Jiangong Chen , Bin Li

Tactile gesture recognition systems play a crucial role in Human-Robot Interaction (HRI) by enabling intuitive communication between humans and robots. The literature mainly addresses this problem by applying machine learning techniques to…

Robotics · Computer Science 2025-08-07 Shaohong Zhong , Alessandro Albini , Giammarco Caroleo , Giorgio Cannata , Perla Maiolino

This paper proposes an idea of building an interface to merge the existing technologies like Image processing, Internet of Things, Sixth sense, etc. at one place to reduce the hardware restrictions imposed on a user and improve the…

Human-Computer Interaction · Computer Science 2024-09-05 Shubhankar Mohan , Aditi Chaudhary , Prachie Gupta , Ritu Tiwari

Natural interaction with virtual objects in AR/VR environments makes for a smooth user experience. Gestures are a natural extension from real world to augmented space to achieve these interactions. Finding discriminating spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Tejo Chalasani , Jan Ondrej , Aljosa Smolic

Human-to-Robot handovers are useful for many Human-Robot Interaction scenarios. It is important to recognize when a human intends to initiate handovers, so that the robot does not try to take objects from humans when a handover is not…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jun Kwan , Chinkye Tan , Akansel Cosgun

Text prompt is the most common way for human-generative AI (GenAI) communication. Though convenient, it is challenging to convey fine-grained and referential intent. One promising solution is to combine text prompts with precise GUI…

Human-Computer Interaction · Computer Science 2026-02-25 Leixian Shen , Yifang Wang , Huamin Qu , Xing Xie , Haotian Li

Hand-over-face gestures can provide important implicit interactions during conversations, such as frustration or excitement. However, in situations where interlocutors are not visible, such as phone calls or textual communication, the…

Human-Computer Interaction · Computer Science 2024-03-28 Mengxi Liu , Hymalai Bello , Bo Zhou , Paul Lukowicz , Jakob Karolus

We are concerned with a novel sensor-based gesture input/instruction technology which enables human beings to interact with computers conveniently. The human being wears an emitter on the finger or holds a digital pen that generates a time…

Classical Physics · Physics 2017-05-23 Yukun Guo , Jingzhi Li , Hongyu Liu , Xianchao Wang

Like the prehistoric twig and stone, tangible user interfaces (TUIs) are objects manipulated by humans. TUI success will depend on how well they exploit spatiality, the intuitive spatial skills humans have with the objects they use. In this…

Human-Computer Interaction · Computer Science 2025-07-18 Ehud Sharlin , Benjamin Watson , Yoshifumi Kitamura , Fumio Kishino , Yuichi Itoh

Advances in artificial intelligence have transformed the paradigm of human-computer interaction, with the development of conversational AI systems playing a pivotal role. These systems employ technologies such as natural language processing…

Human-Computer Interaction · Computer Science 2024-11-14 Atieh Taheri , Purav Bhardwaj , Arthur Caetano , Alice Zhong , Misha Sra

Lately, there has been an increasing interest in hand gesture analysis systems. Recent works have employed pattern recognition techniques and have focused on the development of systems with more natural user interfaces. These systems may…

Human-Computer Interaction · Computer Science 2013-12-18 Renata Cristina Barros Madeo , Priscilla Koch Wagner , Sarajane Marques Peres

In an era where user interaction with technology is ubiquitous, the importance of user interface (UI) design cannot be overstated. A well-designed UI not only enhances usability but also fosters more natural, intuitive, and emotionally…

Human-Computer Interaction · Computer Science 2024-11-12 Shiyu Duan , Ziyi Wang , Shixiao Wang , Mengmeng Chen , Runsheng Zhang