English
Related papers

Related papers: Seeing Eye to Eye: Enabling Cognitive Alignment Th…

200 papers

Current AI alignment through RLHF follows a single directional paradigm that AI conforms to human preferences while treating human cognition as fixed. We propose a shift to co-alignment through Bidirectional Cognitive Alignment (BiCA),…

Artificial Intelligence · Computer Science 2025-11-19 Yubo Li , Weiyi Song

We present See-Through Face Display, an eye-contact display system designed to enhance gaze awareness in both human-to-human and human-to-avatar communication. The system addresses the limitations of existing gaze correction methods by…

Human-Computer Interaction · Computer Science 2024-10-23 Kazuya Izumi , Ryosuke Hyakuta , Ippei Suzuki , Yoichi Ochiai

Modern AI enables a high-level, declarative form of interaction: Users describe the intended outcome they wish an AI to produce, but do not actually create the outcome themselves. In contrast, in traditional user interfaces, users invoke…

Human-Computer Interaction · Computer Science 2024-09-18 Michael Terry , Chinmay Kulkarni , Martin Wattenberg , Lucas Dixon , Meredith Ringel Morris

Human-robot collaboration (HRC) has become increasingly relevant in industrial, household, and commercial settings. However, the effectiveness of such collaborations is highly dependent on the human and robots' situational awareness of the…

Robotics · Computer Science 2023-05-09 Chelsea Zou , Kishan Chandan , Yan Ding , Shiqi Zhang

Recently, large language models (LLMs) have shown strong potential in facilitating human-robotic interaction and collaboration. However, existing LLM-based systems often overlook the misalignment between human and robot perceptions, which…

Robotics · Computer Science 2024-09-25 Yixin Chen , Guoxi Zhang , Yaowei Zhang , Hongming Xu , Peiyuan Zhi , Qing Li , Siyuan Huang

Aligning AI systems with human values fundamentally relies on effective human feedback. While significant research has addressed training algorithms, the role of user interface is often overlooked and only treated as an implementation…

Human-Computer Interaction · Computer Science 2026-02-13 Danqing Shi

The integration of Artificial Intelligence (AI) into high-stakes domains such as healthcare, finance, and autonomous systems is often constrained by concerns over transparency, interpretability, and trust. While Human-Centered AI (HCAI)…

Human-Computer Interaction · Computer Science 2025-04-29 Chameera De Silva , Thilina Halloluwa , Dhaval Vyas

Intensive Care Units (ICUs) are critical environments characterized by high-stakes monitoring and complex data management. However, current practices often rely on manual data transcription and fragmented information systems, introducing…

Human-Computer Interaction · Computer Science 2025-12-11 Yibowen Zhao , Yiming Cao , Zhiqi Shen , Juan Du , Yonghui Xu , Lizhen Cui , Cyril Leung

Human eye gaze plays a significant role in many virtual and augmented reality (VR/AR) applications, such as gaze-contingent rendering, gaze-based interaction, or eye-based activity recognition. However, prior works on gaze analysis and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Zhiming Hu , Jiahui Xu , Syn Schmitt , Andreas Bulling

Eye-tracking data reveals valuable insights into users' cognitive states but is difficult to analyze due to its structured, non-linguistic nature. While large language models (LLMs) excel at reasoning over text, they struggle with temporal…

Human-Computer Interaction · Computer Science 2025-07-25 Dongyang Guo , Yasmeen Abdrabou , Enkeleda Thaqi , Enkelejda Kasneci

AI support of collaborative interactions entails mediating potential misalignment between interlocutor beliefs. Common preference alignment methods like DPO excel in static settings, but struggle in dynamic collaborative tasks where the…

Computation and Language · Computer Science 2025-05-27 Abhijnan Nath , Carine Graff , Andrei Bachinin , Nikhil Krishnaswamy

This study examines the role of vagueness in the design process and its strategic management for the effective human-AI interaction. While vagueness in the generation of design ideas promotes diverse interpretations and prevents fixation,…

Human-Computer Interaction · Computer Science 2024-11-14 Myungjin Kim , Bogoan Kim , Kyungsik Han

Knowledge can't be disentangled from people. As AI knowledge systems mine vast volumes of work-related data, the knowledge that's being extracted and surfaced is intrinsically linked to the people who create and use it. When predictive…

Computers and Society · Computer Science 2025-03-04 Karina Cortiñas-Lorenzo , Siân Lindley , Ida Larsen-Ledet , Bhaskar Mitra

The ultimate goal of artificial intelligence (AI) is to achieve Artificial General Intelligence (AGI). Embodied Artificial Intelligence (EAI), which involves intelligent systems with physical presence and real-time interaction with the…

Artificial Intelligence · Computer Science 2025-05-13 Jinhao Jiang , Changlin Chen , Shile Feng , Wanru Geng , Zesheng Zhou , Ni Wang , Shuai Li , Feng-Qi Cui , Erbao Dong

Effective human-AI collaboration for physical task completion has significant potential in both everyday activities and professional domains. AI agents equipped with informative guidance can enhance human performance, but evaluating such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Filippos Bellos , Yayuan Li , Cary Shu , Ruey Day , Jeffrey M. Siskind , Jason J. Corso

An embodied AI assistant operating on egocentric video must integrate spatial cues across time - for instance, determining where an object A, glimpsed a few moments ago lies relative to an object B encountered later. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Sahithya Ravi , Gabriel Sarch , Vibhav Vineet , Andrew D. Wilson , Balasaravanan Thoravi Kumaravel

Human communication often relies on visual cues to resolve ambiguity. While humans can intuitively integrate these cues, AI systems often find it challenging to engage in sophisticated multimodal reasoning. We introduce VAGUE, a benchmark…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Heejeong Nam , Jinwoo Ahn , Keummin Ka , Jiwan Chung , Youngjae Yu

Large language models (LLMs), due to their advanced natural language capabilities, have seen significant success in applications where the user interface is usually a conversational artificial intelligence (AI) agent and engages the user…

Computation and Language · Computer Science 2025-03-10 Fei Wei , Yaliang Li , Bolin Ding

As AI becomes more deeply embedded in knowledge work, building assistants that support human creativity and expertise becomes more important. Yet achieving synergy in human-AI collaboration is not easy. Providing AI with detailed…

Human-Computer Interaction · Computer Science 2026-04-22 Sean Kelley , David De Cremer , Christoph Riedl

Currently, there exists a fundamental divide between the "cognitive black box" (implicit intuition) of human experts and the "computational black box" (untrustworthy decision-making) of artificial intelligence (AI). This paper proposes a…

Artificial Intelligence · Computer Science 2025-12-10 Yiming Lu