English
Related papers

Related papers: PinchCatcher: Enabling Multi-selection for Gaze+Pi…

200 papers

Interacting with multiple objects simultaneously makes us fast. A pre-step to this interaction is to select the objects, i.e., multi-object selection, which is enabled through two steps: (1) toggling multi-selection mode -- mode-switching…

Human-Computer Interaction · Computer Science 2026-02-16 Mohammad Raihanul Bashar , Aunnoy K Mutasim , Ken Pfeuffer , Anil Ufuk Batmaz

Despite steady progress, text entry in Extended Reality (XR) often remains slower and more effortful than typing on a physical keyboard or touchscreen. We explore a simple idea: use gaze to swipe through a virtual keyboard for the fast,…

Human-Computer Interaction · Computer Science 2026-04-07 Ziheng "Leo" Li , Xichen He , Mengyuan "Millie" Wu , Zeyi Tong , Haowen Wei , Benjamin Yang , Steven Feiner , Paul Sajda

Gaze-based interaction techniques have created significant interest in the field of spatial interaction. Many of these methods require additional input modalities, such as hand gestures (e.g., gaze coupled with pinch). Those can be…

Human-Computer Interaction · Computer Science 2025-01-22 Tim Rolff , Jenny Gabel , Lauren Zerbin , Niklas Hypki , Susanne Schmidt , Markus Lappe , Frank Steinicke

As extended reality (XR) technologies rapidly become as ubiquitous as today's mobile devices, supporting one-handed interaction becomes essential for XR. However, the prevalent Gaze + Pinch interaction model partially supports unimanual…

Human-Computer Interaction · Computer Science 2026-03-20 Min-yung Kim , Jinwook Kim , Ken Pfeuffer , Sang Ho Yoon

The potential of gaze for hands-free mobile interaction is increasingly evident. While each gaze input technique presents distinct advantages and limitations, a combination can amplify strengths and mitigate challenges. We report on the…

Human-Computer Interaction · Computer Science 2026-01-14 Omar Namnakani , Yasmeen Abdrabou , Jonathan Grizou , Mohamed Khamis

Smartwatches offer powerful features, but their small touchscreens limit the expressiveness of the input that can be achieved. To address this issue, we present, and open-source, the first sonar-based around-device input on an unmodified…

Human-Computer Interaction · Computer Science 2026-02-26 Jiwan Kim , Jiwan Son , Ian Oakley

The gaze-and-pinch framework offers a high-fidelity interaction modality for spatial computing in virtual reality (VR), yet it remains vulnerable to coordination errors--timing misalignments between gaze fixation and pinch gestures. These…

Human-Computer Interaction · Computer Science 2026-03-30 Jazmin Collins , Prasanthi Gurumurthy , Eric J. Gonzalez , Mar Gonzalez-Franco

Human-computer interactions based on gaze-tracking have spread during the last few years. Video games, applications in health, trading, market research, and many other fields have started to use this new technology that seems invisible to…

Human-Computer Interaction · Computer Science 2025-04-22 Sébastien Riou , Didier Schwab , François Bérard

Many XR devices use bare-hand gestures to reduce the need for handheld controllers. Such gestures, however, lead to false positive and false negative recognition errors, which detract from the user experience. While mediation techniques…

Human-Computer Interaction · Computer Science 2023-09-21 Tica Lin , Ben Lafreniere , Yan Xu , Tovi Grossman , Daniel Wigdor , Michael Glueck

We present HandOver, an extended reality (XR) interaction technique designed to unify the precision of traditional mouse input for object selection with the expressiveness of hand-tracking for object manipulation. With HandOver, the mouse…

Human-Computer Interaction · Computer Science 2025-08-04 Esen K. Tütüncü , Mar Gonzalez-Franco , Eric J. Gonzalez

Text selection is a common and essential activity during text interaction in all interactive systems. As Augmented Reality (AR) head-mounted displays (HMDs) become more widespread, they will need to provide effective interaction techniques…

Human-Computer Interaction · Computer Science 2023-01-02 Xinyi Liu , Xuanru Meng , Becky Spittle , Wenge Xu , BoYu Gao , Hai-Ning Liang

Object selection is essential in virtual reality (VR) head-mounted displays (HMDs). Prior work mainly focuses on enhancing and evaluating techniques for selecting a single object in VR, leaving a gap in the techniques for multi-object…

Human-Computer Interaction · Computer Science 2024-10-23 Rongkai Shi , Yushi Wei , Xuning Hu , Yu Liu , Yong Yue , Lingyun Yu , Hai-Ning Liang

Existing text selection techniques on touchscreen focus on improving the control for moving the carets. Coarse-grained text selection on word and phrase levels has not received much support beyond word-snapping and entity recognition. We…

Human-Computer Interaction · Computer Science 2023-10-27 Peiling Jiang , Li Feng , Fuling Sun , Parakrant Sarkar , Haijun Xia , Can Liu

In order to avoid the "Midas Touch" problem, gaze-based interfaces for selection often introduce a dwell time: a fixed amount of time the user must fixate upon an object before it is selected. Past interfaces have used a uniform dwell time…

Human-Computer Interaction · Computer Science 2022-09-07 Zhaokang Chen , Bertram E. Shi

Enabling gaze interaction in real-time on handheld mobile devices has attracted significant attention in recent years. An increasing number of research projects have focused on sophisticated appearance-based deep learning models to enhance…

Human-Computer Interaction · Computer Science 2023-04-20 Yaxiong Lei , Yuheng Wang , Tyler Caslin , Alexander Wisowaty , Xu Zhu , Mohamed Khamis , Juan Ye

Gaze input, as a modality inherently conveying user intent, offers intuitive and immersive experiences in extended reality (XR). With eye-tracking now being a standard feature in modern XR headsets, gaze has been extensively applied to…

Human-Computer Interaction · Computer Science 2025-10-09 Yichuan Zhang , Liangyuting Zhang , Xuning Hu , Yong Yue , Hai-Ning Liang

Recent advancements in eye tracking technology are driving the adoption of gaze-assisted interaction as a rich and accessible human-computer interaction paradigm. Gaze-assisted interaction serves as a contextual, non-invasive, and explicit…

Human-Computer Interaction · Computer Science 2018-03-14 Vijay Rajanna , Tracy Hammond

Gaze-based selection in XR requires visual confirmation due to eye-tracking limitations and target ambiguity in 3D contexts. Current designs for wide-FOV displays use world-locked, central overlays, which are not conducive to always-on AR…

Human-Computer Interaction · Computer Science 2026-03-20 Yutong Ren , Arnav Reddy , Michael Nebeling

Accuracy and speed are pivotal when typing. Mixed reality typing is typically performed by typing on a midair keyboard with your index fingers. This deprives users of both the tactile feedback available on physical devices and the ability…

Human-Computer Interaction · Computer Science 2025-07-30 Cecilia Schmitz , Joshua Reynolds , Scott Kuhl , Keith Vertanen

Mid-air gestures in Extended Reality (XR) often cause fatigue and imprecision. Surface-based interactions offer improved accuracy and comfort, but current egocentric vision methods struggle due to hand tracking challenges and unreliable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Vasco Xu , Brian Chen , Eric J. Gonzalez , Andrea Colaço , Henry Hoffmann , Mar Gonzalez-Franco , Karan Ahuja
‹ Prev 1 2 3 10 Next ›