English
Related papers

Related papers: AI-Powered Interfaces for Extended Reality to supp…

200 papers

AI-driven multimodal interfaces have the potential to revolutionize industrial 3D CAD modeling by improving workflow efficiency and user experience. However, the integration of these technologies remains challenging due to software…

Human-Computer Interaction · Computer Science 2025-03-24 Jiin Choi , Yugyeong Jang , Kyung Hoon Hyun

Wearable devices, such as smartwatches and head-mounted displays, are increasingly used for prolonged tasks like remote learning and work, but sustained interaction often leads to user fatigue, reducing efficiency and engagement. This study…

Machine Learning · Computer Science 2025-06-17 Yikan Wang

Mixed Reality aims to merge the digital and physical worlds to create immersive human-computer interactions. Despite notable advancements, the absence of realistic haptic feedback often breaks the immersive experience by creating a…

Human-Computer Interaction · Computer Science 2024-06-12 Haoyu Wang

Assistive devices for indivuals with upper-limb movement often lack controllability and intuitiveness, in particular for grasping function. In this work, we introduce a novel user interface for grasping movement control in which the user…

Quantitative Methods · Quantitative Biology 2023-06-28 Etienne Moullet , François Bailly , Justin Carpentier , Christine Azevedo Coste

The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with no technical background. Still, it is often difficult to…

Human-Computer Interaction · Computer Science 2023-05-01 Chao Wang , Anna Belardinelli , Stephan Hasler , Theodoros Stouraitis , Daniel Tanneberg , Michael Gienger

Mobile devices have the potential to facilitate remote tasks through Augmented Reality (AR) solutions by integrating digital information into the real world. Although prior studies have explored Mobile Augmented Reality (MAR) for co-located…

Human-Computer Interaction · Computer Science 2025-11-04 Nelusha Nugegoda , Marium-E- Jannat , Khalad Hasan , Patricia Lasserre

Mixed Reality (MR) and Artificial Intelligence (AI) are increasingly becoming integral parts of our daily lives. Their applications range in fields from healthcare to education to entertainment. MR has opened a new frontier for such fields…

Human-Computer Interaction · Computer Science 2024-02-14 Ramez Yousri , Zeyad Essam , Yehia Kareem , Youstina Sherief , Sherry Gamil , Soha Safwat

Recent advancements in eye tracking technology are driving the adoption of gaze-assisted interaction as a rich and accessible human-computer interaction paradigm. Gaze-assisted interaction serves as a contextual, non-invasive, and explicit…

Human-Computer Interaction · Computer Science 2018-03-14 Vijay Rajanna , Tracy Hammond

Adhering to current HRI paradigms, all of the sensors, visualisation and legibility of actions and motions are borne by the robot or its working cell. This necessarily makes robots more complex or confines them into specialised, structured…

Robotics · Computer Science 2020-12-11 David Puljiz , Björn Hein

AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences-yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a…

Artificial Intelligence · Computer Science 2025-07-16 Daniel Platnick , Matti Gruener , Marjan Alirezaie , Kent Larson , Dava J. Newman , Hossein Rahnama

The development of ubiquitous computing and sensing devices has brought about novel interaction scenarios such as mixed reality and IoT (e.g., smart home), which pose new demands for the next generation of natural user interfaces (NUI).…

Human-Computer Interaction · Computer Science 2023-08-29 Chen Liang

Assistive robotic systems have shown growing potential to improve the quality of life of those with disabilities. As researchers explore the automation of various caregiving tasks, considerations for how the technology can still preserve…

Designing for situational awareness could lead to better solutions for disabled people, likewise, exploring the needs of disabled people could lead to innovations that can address situational impairments. This in turn can create…

Human-Computer Interaction · Computer Science 2019-04-15 Tigmanshu Bhatnagar , Youngjun Cho , Nicolai Marquardt , Catherine Holloway

While current personal smart devices excel in digital domains, they fall short in assisting users during human environment interaction. This paper proposes Heads Up eXperience (HUX), an AI system designed to bridge this gap, serving as a…

Human-Computer Interaction · Computer Science 2024-07-30 Sukanth K , Sudhiksha Kandavel Rajan , Rajashekhar V S , Gowdham Prabhakar

Seamless integration of physical objects as interactive digital entities remains a challenge for spatial computing. This paper explores Augmented Object Intelligence (AOI) in the context of XR, an interaction paradigm that aims to blur the…

Human-Computer Interaction · Computer Science 2025-05-19 Mustafa Doga Dogan , Eric J. Gonzalez , Karan Ahuja , Ruofei Du , Andrea Colaço , Johnny Lee , Mar Gonzalez-Franco , David Kim

Aligning AI systems with human values fundamentally relies on effective human feedback. While significant research has addressed training algorithms, the role of user interface is often overlooked and only treated as an implementation…

Human-Computer Interaction · Computer Science 2026-02-13 Danqing Shi

Compared to current AI or robotic systems, humans navigate their environment with ease, making tasks such as data collection trivial. However, humans find it harder to model complex relationships hidden in the data. AI systems, especially…

Artificial Intelligence · Computer Science 2022-06-17 Ryan Nguyen , Rahul Rai

Human-robot collaboration (HRC) has become increasingly relevant in industrial, household, and commercial settings. However, the effectiveness of such collaborations is highly dependent on the human and robots' situational awareness of the…

Robotics · Computer Science 2023-05-09 Chelsea Zou , Kishan Chandan , Yan Ding , Shiqi Zhang

Dexterous manipulation with anthropomorphic robot hands remains a challenging problem in robotics because of the high-dimensional state and action spaces and complex contacts. Nevertheless, skillful closed-loop manipulation is required to…

Robotics · Computer Science 2022-12-06 Malte Mosbach , Kara Moraw , Sven Behnke

Haptic feedback is an important component of creating an immersive mixed reality experience. Traditionally, haptic forces are rendered in response to the user's interactions with the virtual environment. In this work, we explore the idea of…

Robotics · Computer Science 2023-03-01 Niall L. Williams , Nicholas Rewkowski , Jiasheng Li , Ming C. Lin