English
Related papers

Related papers: Automated Testing of Prevalent 3D User Interaction…

200 papers

ECG is an attractive option to assess stress in serious Virtual Reality (VR) applications due to its non-invasive nature. However, the existing Machine Learning (ML) models perform poorly. Moreover, existing studies only perform a binary…

Machine Learning · Computer Science 2021-07-12 Zeeshan Ahmad , Suha Rabbani , Muhammad Rehman Zafar , Syem Ishaque , Sridhar Krishnan , Naimul Khan

Virtual reality enables users to experience real-life situations in immersive environments. Interaction methods significantly shape user experience, particularly in high fidelity simulations mimicking real world tasks. This study evaluates…

Human-Computer Interaction · Computer Science 2025-02-10 Francesco Vona , Julia Schorlemmer , Jessica Stemann , Sebastian Fischer , Jan-Niklas Voigt-Antons

While large language models (LLMs) have accelerated 2D software development through intent-driven "vibe coding", prototyping intelligent Extended Reality (XR) experiences remains a major challenge. The fundamental barrier is not just the…

One of the main challenges of advancing task-oriented learning such as visual task planning and reinforcement learning is the lack of realistic and standardized environments for training and testing AI agents. Previously, researchers often…

Human-Computer Interaction · Computer Science 2019-03-15 Xiaofeng Gao , Ran Gong , Tianmin Shu , Xu Xie , Shu Wang , Song-Chun Zhu

Virtual reality (VR) is not a new technology but has been in development for decades, driven by advances in computer technology. Currently, VR technology is increasingly being used in applications to enable immersive, yet controlled…

Human-Computer Interaction · Computer Science 2022-11-24 Hong Gao

Flawed planning from VLM-driven embodied agents poses significant safety hazards, hindering their deployment in real-world household tasks. However, existing static, non-interactive evaluation paradigms fail to adequately assess risks…

Artificial Intelligence · Computer Science 2025-12-08 Xiaoya Lu , Zeren Chen , Xuhao Hu , Yijin Zhou , Weichen Zhang , Dongrui Liu , Lu Sheng , Jing Shao

The advent of immersive Virtual Reality applications has transformed various domains, yet their integration with advanced artificial intelligence technologies like Visual Language Models remains underexplored. This study introduces a…

Robotics · Computer Science 2024-08-06 Mikhail Konenkov , Artem Lykov , Daria Trinitatova , Dzmitry Tsetserukou

Service robots in public spaces require real-time understanding of human behavioral intentions for natural interaction. We present a practical multimodal framework for frame-accurate human-robot interaction intent detection that fuses…

Robotics · Computer Science 2025-12-23 Farida Mohsen , Ali Safa

When collaborating face-to-face, people commonly use the surfaces and spaces around them to perform sensemaking tasks, such as spatially organising documents, notes or images. However, when people collaborate remotely using desktop…

Human-Computer Interaction · Computer Science 2022-10-17 Ying Yang , Tim Dwyer , Michael Wybrow , Benjamin Lee , Maxime Cordeil , Mark Billinghurst , Bruce H. Thomas

Over the past decade, Extended Reality (XR), including Virtual, Augmented, and Mixed Reality, gained attention as a research instrument in human-robot interaction studies, but remains underexplored in empirical investigations of social…

Robotics · Computer Science 2026-02-20 André Helgert , Carolin Straßmann , Sabrina C. Eimler

Robot apps are becoming more automated, complex and diverse. An app usually consists of many functions, interacting with each other and the environment. This allows robots to conduct various tasks. However, it also opens a new door for…

Cryptography and Security · Computer Science 2021-03-24 Yuan Xu , Tianwei Zhang , Yungang Bao

Using touch devices to navigate in virtual 3D environments such as computer assisted design (CAD) models or geographical information systems (GIS) is inherently difficult for humans, as the 3D operations have to be performed by the user on…

Machine Learning · Computer Science 2019-08-29 Quentin Debard , Jilles Steeve Dibangoye , Stéphane Canu , Christian Wolf

Virtual Reality (VR) is inaccessible to blind people. While research has investigated many techniques to enhance VR accessibility, they require additional developer effort to integrate. As such, most mainstream VR apps remain inaccessible…

Human-Computer Interaction · Computer Science 2025-08-06 Daniel Killough , Justin Feng , Zheng Xue "ZX" Ching , Daniel Wang , Rithvik Dyava , Yapeng Tian , Yuhang Zhao

This publication reports on a research project in which we set out to explore the advantages and disadvantages augmented reality (AR) technology has for visual data analytics. We developed a prototype of an AR data analytics application,…

Human-Computer Interaction · Computer Science 2020-10-15 Wanze Xie , Yining Liang , Janet Johnson , Andrea Mower , Samuel Burns , Colleen Chelini , Paul D Alessandro , Nadir Weibel , Jürgen P. Schulze

The design of intuitive three-dimensional user interfaces is vital for interaction in virtual reality, allowing to effectively close the loop between a human user and the virtual environment. The utilization of 3D gestural input allows for…

Human-Computer Interaction · Computer Science 2024-01-17 Nico Reski , Aris Alissandrakis , Andreas Kerren

Virtual reality (VR) is an imminent trend in games, education, entertainment, military, and health applications, as the use of head-mounted displays is becoming accessible to the mass market. Virtual reality provides immersive experiences…

Human-Computer Interaction · Computer Science 2020-06-30 Thiago Porcino , Esteban Clua , Daniela Trevisan , Érick Rodrigues , Alexandre Silva

Over the past decade, the value and potential of VR applications in manufacturing have gained significant attention in accordance with the rise of Industry 4.0 and beyond. Its efficacy in layout planning, virtual design reviews, and…

Human-Computer Interaction · Computer Science 2024-01-01 Huizhong Cao , Henrik Söderlund , Mélanie Despeisse , Francisco Garcia Rivera , Björn Johansson

Virtual reality (VR) has seen increased use for training and instruction. Designers can enable VR users to gain insights into their own performance by visualizing telemetry data from their actions in VR. Our ability to detect patterns and…

Human-Computer Interaction · Computer Science 2021-12-16 Andreas Bueckle , Kilian Buehling , Patrick C. Shih , Katy Borner

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost- and time-efficient solution for developing…

Human-Computer Interaction · Computer Science 2024-09-17 Jan Hendrik Plümer , Kevin Yu , Ulrich Eck , Denis Kalkofen , Philipp Steininger , Nassir Navab , Markus Tatzgern

Virtual Reality (VR) co-manipulation enables multiple users to collaboratively interact with shared virtual objects. However, existing research treats objects as monolithic entities, overlooking scenarios where users need to manipulate…

Human-Computer Interaction · Computer Science 2026-03-31 Xian Wang , Xuanru Cheng , Rongkai Shi , Lei Chen , Jingyao Zheng , Hai-Ning Liang , Lik-Hang Lee