English
Related papers

Related papers: Augmenting Mobile Phone Interaction with Face-Enga…

200 papers

With the rise of natural user interfaces, immersive analytics applications often focus on novel forms of interaction modalities such as mid-air gestures, gaze or tangible interaction utilizing input devices such as depth-sensors, touch…

Human-Computer Interaction · Computer Science 2020-09-08 Jens Grubert , Eyal Ofek , Michel Pahud , Per Ola Kristensson

Digital technologies are reshaping how people experience their surroundings, often pulling focus toward virtual spaces and making it harder to stay present and engaged. Wearable augmented reality (AR), by embedding digital information into…

Human-Computer Interaction · Computer Science 2025-03-05 Tram Thi Minh Tran

Finger pose offers promising opportunities to expand human computer interaction capability of touchscreen devices. Existing finger pose estimation algorithms that can be implemented in portable devices predominantly rely on capacitive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Xiongjun Guan , Zhiyu Pan , Jianjiang Feng , Jie Zhou

Enhancing user engagement through interactions plays an essential role in socially-driven dialogues. While prior works have optimized models to reason over relevant knowledge or plan a dialogue act flow, the relationship between user…

Computation and Language · Computer Science 2025-06-27 Jiashuo Wang , Kaitao Song , Chunpu Xu , Changhe Song , Yang Xiao , Dongsheng Li , Lili Qiu , Wenjie Li

Humans inhabit a world defined by interactions -- with other humans, objects, and environments. These interactive movements not only convey our relationships with our surroundings but also demonstrate how we perceive and communicate with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Kewei Sui , Anindita Ghosh , Inwoo Hwang , Bing Zhou , Jian Wang , Chuan Guo

We propose augmenting immersive telepresence by adding a virtual body, representing the user's own arm motions, as realized through a head-mounted display and a 360-degree camera. Previous research has shown the effectiveness of having a…

3D hand-object pose estimation is the key to the success of many computer vision applications. The main focus of this task is to effectively model the interaction between the hand and an object. To this end, existing works either rely on…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Rong Wang , Wei Mao , Hongdong Li

This study mainly explores the application of natural gesture recognition based on computer vision in human-computer interaction, aiming to improve the fluency and naturalness of human-computer interaction through gesture recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Fenghua Shao , Tong Zhang , Shang Gao , Qi Sun , Liuqingqing Yang

We present a dual-pathway approach for recognizing fine-grained interactions from videos. We build on the success of prior dual-stream approaches, but make a distinction between the static and dynamic representations of objects and their…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tae Soo Kim , Jonathan Jones , Gregory D. Hager

Static and dynamic hand movements are basic way for human-machine interactions. To recognize and classify these movements, first these movements are captured by the cameras mounted on the augmented reality (AR) or virtual reality (VR)…

Human-Computer Interaction · Computer Science 2020-04-03 Nizamuddin Maitlo , Yanbo Wang , Chao Ping Chen , Lantian Mi , Wenbo Zhang

Interaction plays a vital role during visual network exploration as users need to engage with both elements in the view (e.g., nodes, links) and interface controls (e.g., sliders, dropdown menus). Particularly as the size and complexity of…

Human-Computer Interaction · Computer Science 2020-05-01 Ayshwarya Saktheeswaran , Arjun Srinivasan , John Stasko

We introduce a multi-stage framework that uses mean curvature on a hand surface and focuses on learning interaction between hand and object by analyzing hand grasp type for hand action recognition in egocentric videos. The proposed method…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Sangpil Kim , Jihyun Bae , Hyunggun Chi , Sunghee Hong , Byoung Soo Koh , Karthik Ramani

Interaction design for Augmented Reality (AR) is gaining increasing attention from both academia and industry. This survey discusses 260 articles (68.8% of articles published between 2015 - 2019) to review the field of human interaction in…

Human-Computer Interaction · Computer Science 2021-05-26 Lik Hang Lee , Tristan Braud , Simo Hosio , Pan Hui

Three-dimensional (3D) applications have come to every corner of life. We present 3DTouch, a novel 3D wearable input device worn on the fingertip for interacting with 3D applications. 3DTouch is self-contained, and designed to universally…

Human-Computer Interaction · Computer Science 2017-06-02 Anh Nguyen

Human-machine interaction has been around for several decades now, with new applications emerging every day. One of the major goals that remain to be achieved is designing an interaction similar to how a human interacts with another human.…

Human-Computer Interaction · Computer Science 2022-12-27 Tauheed Khan Mohd , Nicole Nguyen , Ahmad Y Javaid

Facial motion capture in mixed reality headsets enables real-time avatar animation, allowing users to convey non-verbal cues during virtual interactions. However, as facial motion data constitutes a behavioral biometric, its use raises…

Cryptography and Security · Computer Science 2025-07-16 Adriano Castro , Simon Hanisch , Matin Fallahi , Thorsten Strufe

Augmented Reality (AR) and Mobile Augmented Reality (MAR) applications have gained much research and industry attention these days. The mobile nature of MAR applications limits users' interaction capabilities such as inputs, and haptic…

Human-Computer Interaction · Computer Science 2017-09-13 Carlos Bermejo , Pan Hui

Nowadays, cars offer many possibilities to explore the world around you by providing location-based information displayed on a 2D-Map. However, this information is often only available to front-seat passengers while being restricted to…

Human-Computer Interaction · Computer Science 2023-07-13 Robin Connor Schramm , Markus Sasalovici , Axel Hildebrand , Ulrich Schwanecke

Gesture recognition is mainly apprehensive on analyzing the functionality of human wits. The main goal of gesture recognition is to create a system which can recognize specific human gestures and use them to convey information or for device…

Artificial Intelligence · Computer Science 2010-12-02 Harshith C , Karthik R. Shastry , Manoj Ravindran , M. V. V. N. S. Srikanth , Naveen Lakshmikhanth

The trend towards mobile devices usage has put more than ever the Web as a ubiquitous platform where users perform all kind of tasks. In some cases, users access the Web with 'native' mobile applications developed for well-known sites, such…

Human-Computer Interaction · Computer Science 2019-06-05 Gabriela Bosetti , Sergio Firmenich , Silvia Gordillo , Gustavo Rossi , Marco Winckler