English
Related papers

Related papers: SituationAdapt: Contextual UI Optimization in Mixe…

200 papers

The interaction context (or environment) is key to any HCI task and especially to adaptive user interfaces (AUIs), since it represents the conditions under which users interact with computers. Unfortunately, there are currently no formal…

Human-Computer Interaction · Computer Science 2022-04-01 Mateusz Dubiel , Bereket Abera Yilma , Kayhan Latifzadeh , Luis A. Leiva

Mixed Reality (MR) is a powerful interactive technology that yields new types of user experience. We present a semantic based interactive MR framework that exceeds the current geometry level approaches, a step change in generating…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Long Chen , Wen Tang , Nigel John , Tao Ruan Wan , Jian Jun Zhang

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

Human-Computer Interaction · Computer Science 2020-12-21 Darshana Rathnayake , Ashen de Silva , Dasun Puwakdandawa , Lakmal Meegahapola , Archan Misra , Indika Perera

In-context learning (ICL) involves reasoning from given contextual examples. As more modalities comes, this procedure is becoming more challenging as the interleaved input modalities convolutes the understanding process. This is exemplified…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yixin Chen , Shuai Zhang , Boran Han , Jiaya Jia

Seamless integration of virtual and physical worlds in augmented reality benefits from the system semantically "understanding" the physical environment. AR research has long focused on the potential of context awareness, demonstrating novel…

Human-Computer Interaction · Computer Science 2024-10-08 Chengyuan Xu , Radha Kumaran , Noah Stier , Kangyou Yu , Tobias Höllerer

Emotion recognition in dynamic social contexts requires an understanding of the complex interaction between facial expressions and situational cues. This paper presents a salience-adjusted framework for context-aware emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Bin Han , Jonathan Gratch

In remote and hybrid work contexts, the integration of physical and digital environments is revolutionizing spatial experiences, collaboration, and interpersonal interactions. This study examines three fundamental spatial conditions: the…

Learning-based model predictive control has been widely applied in autonomous racing to improve the closed-loop behaviour of vehicles in a data-driven manner. When environmental conditions change, e.g., due to rain, often only the…

Actual applications (mostly component based) requirements cannot be expressed without a ubiquitous and mobile part for end-users as well as for M2M applications (Machine to Machine). Such an evolution implies context management in order to…

Software Engineering · Computer Science 2009-09-14 Marc Dalmau , Philippe Roose , Sophie Laplace

To facilitate high quality interaction during the regular use of computing systems, it is essential that the user interface (UI) deliver content and components in an appropriate manner. Although extended reality (XR) is emerging as a new…

Human-Computer Interaction · Computer Science 2023-09-11 Kashyap Todi , Tanya R. Jonker

Recent advances in Large Language Models (LLMs) have propelled intelligent agents from reactive responses to proactive support. While promising, existing proactive agents either rely exclusively on observations from enclosed environments…

Artificial Intelligence · Computer Science 2025-10-28 Bufang Yang , Lilin Xu , Liekang Zeng , Kaiwei Liu , Siyang Jiang , Wenrui Lu , Hongkai Chen , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

In this paper, we introduce a novel situation aware approach to improve a context based recommender system. To build situation aware user profiles, we rely on evidence issued from retrieval situations. A retrieval situation refers to the…

Information Retrieval · Computer Science 2014-04-01 Djallel Bouneffouf

With the rapid advancement of large language models (LLMs), intelligent conversational assistants have demonstrated remarkable capabilities across various domains. However, they still mainly rely on explicit textual input and do not know…

Human-Computer Interaction · Computer Science 2025-12-29 Ziyan Zhang , Nan Gao , Zhiqiang Nie , Shantanu Pal , Haining Zhang

Integrating mixed reality (MR) with artificial intelligence (AI) technologies, including vision, language, audio, reasoning, and planning, enables the AI-powered MR assistant [1] to substantially elevate human efficiency. This enhancement…

Human-Computer Interaction · Computer Science 2024-05-10 Yan-Ming Chiou , Bob Price , Chien-Chung Shen , Syed Ali Asif

Mixed Reality (MR) allows users to interact with digital objects in a physical environment, but several limitations have hampered widespread adoption. Physiologically adaptive systems detecting user's states can drive interaction and…

Human-Computer Interaction · Computer Science 2023-04-03 Francesco Chiossi , Sven Mayer

The mixed multinomial logit model assumes constant preference parameters of a decision-maker throughout different choice situations, which may be considered too strong for certain choice modelling applications. This paper proposes an…

Machine Learning · Statistics 2023-03-30 Mirosława Łukawska , Anders Fjendbo Jensen , Filipe Rodrigues

This work presents a novel architecture for context-aware interactions within smart environments, leveraging Large Language Models (LLMs) to enhance user experiences. Our system integrates user location data obtained through UWB tags and…

Computation and Language · Computer Science 2025-02-21 Aurora Polo-Rodríguez , Laura Fiorini , Erika Rovini , Filippo Cavallo , Javier Medina-Quero

Vision-based Interfaces (VIs) are pivotal in advancing Human-Computer Interaction (HCI), particularly in enhancing context awareness. However, there are significant opportunities for these interfaces due to rapid advancements in multimodal…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Wen Hu , Aaron Quigley

Beyond conventional productivity metrics, human interaction and collaboration dynamics merit careful consideration in our increasingly digital workspace. This research proposes a conjectural neuro-adaptive room that enhances group…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Adán Flores-Ramírez , Ángel Mario Alarcón-López , Sofía Vaca-Narvaja , Daniela Leo-Orozco

Medical AI, including clinical language models, vision-language models, and multimodal health record models, already summarizes notes, answers questions, and supports decisions. Their adaptation to new populations, specialties, or care…

Artificial Intelligence · Computer Science 2025-12-01 Michelle M. Li , Ben Y. Reis , Adam Rodman , Tianxi Cai , Noa Dagan , Ran D. Balicer , Joseph Loscalzo , Isaac S. Kohane , Marinka Zitnik