English
Related papers

Related papers: SwEYEpinch: Exploring Intuitive, Efficient Text En…

200 papers

With the ubiquity of mobile touchscreen devices like smartphones, two widely used text entry methods have emerged: small touch-based keyboards and speech recognition. Although speech recognition has been available on desktop computers for…

Human-Computer Interaction · Computer Science 2018-01-18 Sherry Ruan , Jacob O. Wobbrock , Kenny Liou , Andrew Ng , James Landay

We present HeadText, a hands-free technique on a smart earpiece for text entry by motion sensing. Users input text utilizing only 7 head gestures for key selection, word selection, word commitment and word cancelling tasks. Head gesture…

Human-Computer Interaction · Computer Science 2022-05-24 Songlin Xu , Guanjie Wang , Ziyuan Fang , Guangwei Zhang , Guangzhu Shang , Rongde Lu , Liqun He

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without…

Human-Computer Interaction · Computer Science 2022-07-05 Alexander Schäfer , Gerd Reis , Didier Stricker

Text entry with word-gesture keyboards (WGK) is emerging as a popular method and becoming a key interaction for Extended Reality (XR). However, the diversity of interaction modes, keyboard sizes, and visual feedback in these environments…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Junxiao Shen , Khadija Khaldi , Enmin Zhou , Hemant Bhaskar Surale , Amy Karlson

Given the ubiquity of SmartTVs and head-mounted-display-based virtual environments, recent research has explored techniques to support eyes-free text entry using touchscreen devices. However, proposed techniques, leveraging lexicons, limit…

Human-Computer Interaction · Computer Science 2025-03-05 Damien Masson , Zhe Liu , Charles Xu

We present HandOver, an extended reality (XR) interaction technique designed to unify the precision of traditional mouse input for object selection with the expressiveness of hand-tracking for object manipulation. With HandOver, the mouse…

Human-Computer Interaction · Computer Science 2025-08-04 Esen K. Tütüncü , Mar Gonzalez-Franco , Eric J. Gonzalez

Assistive technologies have been developed to enhance blind users' typing performance, focusing on speed, accuracy, and effort reduction. One such technology is word prediction software, designed to minimize keystrokes required for text…

Human-Computer Interaction · Computer Science 2024-12-02 Mrim M. Alnfiai , Muhammad Ashad Kabir

Computers today aren't just confined to laptops and desktops. Mobile gadgets like mobile phones and laptops also make use of it. However, one input device that hasn't changed in the last 50 years is the QWERTY keyboard. Users of virtual…

Human-Computer Interaction · Computer Science 2022-08-02 Pabbathi Sri Charan , Saksham Gupta , Satvik Agrawal , Gadupudi Sahithi Sindhu

Vision based text entry systems aim to help disabled people achieve text communication using eye movement. Most previous methods have employed an existing eye tracker to predict gaze direction and design an input method based upon that.…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Chi Zhang , Rui Yao , Jinpeng Cai

Existing touchscreen software keyboards prevent users from resting their hands, forcing slow and fatiguing index-finger tapping ("chicken typing") instead of familiar hands-down ten-finger typing. We present KeySense, a purely software…

Human-Computer Interaction · Computer Science 2026-02-16 Tony Li , Yan Ma , Zhuojun Li , Chun Yu , IV Ramakrishnan , Xiaojun Bi

Text entry for extended reality (XR) is far from perfect, and a variety of text entry techniques (TETs) have been proposed to fit various contexts of use. However, comparing between TETs remains challenging due to the lack of a consolidated…

Human-Computer Interaction · Computer Science 2025-03-17 Arpit Bhatia , Moaaz Hudhud Mughrabi , Diar Abdlkarim , Massimiliano Di Luca , Mar Gonzalez-Franco , Karan Ahuja , Hasti Seifi

Alphanumeric text entry is a challenge for Virtual Reality (VR) applications. VR enables new capabilities, impossible in the real world, such as an unobstructed view of the keyboard, without occlusion by the user's physical hands. Several…

Human-Computer Interaction · Computer Science 2018-02-05 Jens Grubert , Lukas Witzani , Eyal Ofek , Michel Pahud , Matthias Kranz , Per Ola Kristensson

Grabbing virtual objects is one of the essential tasks for Augmented, Virtual, and Mixed Reality applications. Modern applications usually use a simple pinch gesture for grabbing and moving objects. However, picking up objects by pinching…

Human-Computer Interaction · Computer Science 2022-02-23 Alexander Schäfer , Gerd Reis , Didier Stricker

As virtual reality (VR) continues to evolve, traditional input methods such as handheld controllers and gesture systems often face challenges with precision, social accessibility, and user fatigue. These limitations motivate the exploration…

Human-Computer Interaction · Computer Science 2025-09-15 Xiang Li , Wei He , Per Ola Kristensson

Text entry in Virtual Reality (VR) is challenging, even when accounting for the use of controllers. Prior work has tackled this challenge head-on, improving the efficiency of input methods. These techniques have the advantage of allowing…

Human-Computer Interaction · Computer Science 2025-12-15 Ziming Li , Joffrey Guilmet , Suzanne Sorli , Hai-Ning Liang , Diego Monteiro

Virtual Reality (VR) emphasizes immersive experiences, while text entry often requires hands or visual attention, which may disrupt the interaction flows in VR. We present AnkleType, a hand- and eye-free text-entry technique that leverages…

Human-Computer Interaction · Computer Science 2026-03-24 Xiyun Luo , Weirong Luo , Kening Zhu , Taizhou Chen

As virtual reality (VR) becomes more widely adopted, secure and efficient text entry is an increasingly critical need. In this paper, we identify a vulnerability in a state-of-the-art secure VR text entry method and introduce a novel…

Human-Computer Interaction · Computer Science 2026-01-12 Yuxuan Huang , Qiao Jin , Tongyu Nie , Victoria Interrante , Evan Suma Rosenberg

We introduce LowKeyEMG, a real-time human-computer interface that enables efficient text entry using only 7 gesture classes decoded from surface electromyography (sEMG). Prior work has attempted full-alphabet decoding from sEMG, but…

Human-Computer Interaction · Computer Science 2025-07-29 Johannes Y. Lee , Derek Xiao , Shreyas Kaasyap , Nima R. Hadidi , John L. Zhou , Jacob Cunningham , Rakshith R. Gore , Deniz O. Eren , Jonathan C. Kao

Language learners should regularly engage in reading challenging materials as part of their study routine. Nevertheless, constantly referring to dictionaries is time-consuming and distracting. This paper presents a novel gaze-driven…

Computation and Language · Computer Science 2023-10-03 Taichi Higasa , Keitaro Tanaka , Qi Feng , Shigeo Morishima

Virtual-reality (VR) and augmented-reality (AR) technology is increasingly combined with eye-tracking. This combination broadens both fields and opens up new areas of application, in which visual perception and related cognitive processes…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Lena Stubbemann , Dominik Dürrschnabel , Robert Refflinghaus