English
Related papers

Related papers: Augmented Conversation with Embedded Speech-Driven…

200 papers

Augmented Reality (AR) is transforming the way we interact with virtual information in the physical world. By overlaying digital content in real-world environments, AR enables new forms of immersive and engaging experiences. However,…

Human-Computer Interaction · Computer Science 2025-04-24 Julian Rasch , Florian Müller , Francesco Chiossi

Virtual and augmented reality communication platforms are seen as promising modalities for next-generation remote face-to-face interactions. Our study attempts to explore non-verbal communication features in relation to their conversation…

Human-Computer Interaction · Computer Science 2019-04-10 Mohammad Keshavarzi , Michael Wu , Michael N. Chin , Robert N. Chin , Allen Y. Yang

The concept of augmented reality (AR) assistants has captured the human imagination for decades, becoming a staple of modern science fiction. To pursue this goal, it is necessary to develop artificial intelligence (AI)-based methods that…

Asynchronous communication has become increasingly essential in the context of extended reality (XR), enabling users to interact and share information immersively without the constraints of simultaneous engagement. However, current XR…

Human-Computer Interaction · Computer Science 2025-02-28 Akos Nagy , Yannis Spyridis , Gregory Mills , Vasileios Argyriou

The visible orientation of human eyes creates some transparency about people's spatial attention and other mental states. This leads to a dual role of the eyes as a means of sensing and communication. Accordingly, artificial eye models are…

Human-Computer Interaction · Computer Science 2026-01-30 Matti Krüger , Yutaka Oshima , Yu Fang

Wearable augmented reality (AR) offers new ways for supporting the interaction between autonomous vehicles (AVs) and pedestrians due to its ability to integrate timely and contextually relevant data into the user's field of view. This…

Human-Computer Interaction · Computer Science 2024-03-13 Tram Thi Minh Tran , Callum Parker , Yiyuan Wang , Martin Tomitsch

We introduce Memento, a conversational AR assistant that permanently captures and memorizes user's verbal queries alongside their spatiotemporal and activity contexts. By storing these "memories," Memento discovers connections between…

Human-Computer Interaction · Computer Science 2026-05-08 Yoonsang Kim , Yalong Yang , Arie E. Kaufman

Augmented reality (AR) is emerging in visual search tasks for increasingly immersive interactions with virtual objects. We propose an AR approach providing visual and audio hints along with gaze-assisted instant post-task feedback for…

Human-Computer Interaction · Computer Science 2023-11-15 Yuchong Zhang , Adam Nowak , Yueming Xuan , Andrzej Romanowski , Morten Fjeld

Digital technologies are reshaping how people experience their surroundings, often pulling focus toward virtual spaces and making it harder to stay present and engaged. Wearable augmented reality (AR), by embedding digital information into…

Human-Computer Interaction · Computer Science 2025-03-05 Tram Thi Minh Tran

Due to the increase of interest in Augmented Reality (AR), the potential uses of AR are increasing also. It can benefit the user in various fields such as education, business, medicine, and other. Augmented Reality supports the real…

The rapid evolution of lightweight consumer augmented reality (AR) smart glasses (a.k.a. optical see-through head-mounted displays) offers novel opportunities for learning, particularly through their unique capability to deliver multimodal…

Human-Computer Interaction · Computer Science 2025-07-22 Nuwan Janaka , Shengdong Zhao , Ashwin Ram , Ruoxin Sun , Sherisse Tan Jing Wen , Danae Li , David Hsu

Deaf and hard of hearing (DHH) students often experience communication barriers in higher education, which are particularly acute in experiential learning environments such as laboratories. Traditional accessibility services, such as…

Human-Computer Interaction · Computer Science 2026-04-02 Roshan Mathew , Roshan L. Peiris

Text selection is a common and essential activity during text interaction in all interactive systems. As Augmented Reality (AR) head-mounted displays (HMDs) become more widespread, they will need to provide effective interaction techniques…

Human-Computer Interaction · Computer Science 2023-01-02 Xinyi Liu , Xuanru Meng , Becky Spittle , Wenge Xu , BoYu Gao , Hai-Ning Liang

Interacting with a significant number of individuals on a daily basis is commonplace for many professionals, which can lead to challenges in recalling specific details: Who is this person? What did we talk about last time? The advant of…

Human-Computer Interaction · Computer Science 2025-05-20 Raphaël A. El Haddad , Zeyu Wang , Yeonsu Shin , Ranyi Liu , Yuntao Wang , Chun Yu

We present a user interface (UI) based on augmented reality (AR) with head-mounted display (HMD) for improving situational awareness during critical operation and improve human efficiency on operations. The UI displays contextual…

Human-Computer Interaction · Computer Science 2021-03-29 Dany Naser Addin , Benoit Ozell

Selection of occluded objects is a challenging problem in virtual reality, even more so if multiple objects are involved. With the advent of new artificial intelligence technologies, we explore the possibility of leveraging large language…

Human-Computer Interaction · Computer Science 2024-10-29 Junlong Chen , Jens Grubert , Per Ola Kristensson

In face-to-face interaction, we use multiple modalities, including speech and gestures, to communicate information and resolve references to objects. However, how representational co-speech gestures refer to objects remains understudied…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Esam Ghaleb , Bulat Khaertdinov , Aslı Özyürek , Raquel Fernández

Augmented reality (AR) offers immersive interaction but remains inaccessible for users with motor impairments or limited dexterity due to reliance on precise input methods. This study proposes a gesture-based interaction system for AR…

Human-Computer Interaction · Computer Science 2025-06-19 Yikan Wang

This paper presents a design space of interaction techniques to engage with visualizations that are printed on paper and augmented through Augmented Reality. Paper sheets are widely used to deploy visualizations and provide a rich set of…

Human-Computer Interaction · Computer Science 2022-08-24 Wai Tong , Zhutian Chen , Meng Xia , Leo Yu-Ho Lo , Linping Yuan , Benjamin Bach , Huamin Qu

Delivering intelligent and adaptive navigation assistance in augmented reality (AR) requires more than visual cues, as it demands systems capable of interpreting flexible user intent and reasoning over both spatial and semantic context.…

Human-Computer Interaction · Computer Science 2025-08-26 Hsuan-Kung Yang , Tsu-Ching Hsiao , Ryoichiro Oka , Ryuya Nishino , Satoko Tofukuji , Norimasa Kobori