English
Related papers

Related papers: "She was useful, but a bit too optimistic": Augmen…

200 papers

Recent advances in Large Language Models (LLMs) have significantly improved natural language understanding and generation, enhancing Human-Computer Interaction (HCI). However, LLMs are limited to unimodal text processing and lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Chenxi Li

Large language models (LLMs) enable conversational agents (CAs) to express distinctive personalities, raising new questions about how such designs shape user perceptions. This study investigates how personality expression levels and…

Human-Computer Interaction · Computer Science 2026-04-30 Hasibur Rahman , Smit Desai

Large language models (LLMs) are increasingly used to simulate human opinions and survey responses, but their ability to reproduce population responses across cultures remains limited. Existing persona-based prompting methods typically rely…

Computation and Language · Computer Science 2026-05-18 Axel Abels , Elias Fernandez Domingos , Apurva Shah , Tom Lenaerts

Existing benchmarks do not test Large Multimodal Models (LMMs) on their interactive intelligence with human users, which is vital for developing general-purpose AI assistants. We design InterFeedback, an interactive framework, which can be…

Computation and Language · Computer Science 2025-11-10 Henry Hengyuan Zhao , Wenqi Pei , Yifei Tao , Haiyang Mei , Mike Zheng Shou

People increasingly use multiple Multimodal Large Language Models (MLLMs) concurrently, selecting each based on its perceived strengths. This cross-platform practice creates coordination challenges: adapting prompts to different interfaces,…

Human-Computer Interaction · Computer Science 2026-03-30 Seunghwa Pyo , Donggun Lee , Jungwoo Rhee , Soobin Park , Youn-kyung Lim

Mental health is a growing global concern, prompting interest in AI-driven solutions to expand access to psychosocial support. \emph{Peer support}, grounded in lived experience, offers a valuable complement to professional care. However,…

Human-Computer Interaction · Computer Science 2026-04-10 Kellie Yu Hui Sim , Roy Ka-Wei Lee , Kenny Tsu Wei Choo

To explore a more scalable path for adding multimodal capabilities to existing LLMs, this paper addresses a fundamental question: Can a unimodal LLM, relying solely on text, reason about its own informational needs and provide effective…

Computation and Language · Computer Science 2026-01-13 Sazia Tabasum Mim , Jack Morris , Manish Dhakal , Yanming Xiu , Maria Gorlatova , Yi Ding

Generating interdisciplinary research ideas requires diverse domain expertise, but access to timely feedback is often limited by the availability of experts. In this paper, we introduce PersonaFlow, a novel system designed to provide…

Human-Computer Interaction · Computer Science 2025-07-10 Yiren Liu , Pranav Sharma , Mehul Jitendra Oswal , Haijun Xia , Yun Huang

User interface (UI) design is an iterative process in which designers progressively refine their work with design software such as Figma or Sketch. Recent advances in vision language models (VLMs) with tool invocation suggest these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Daeheon Jeong , Seoyeon Byun , Kihoon Son , Dae Hyun Kim , Juho Kim

Prompting-based user interfaces (UIs) shift the task of defining and accessing relevant functions from developers to users. However, how UIs shape this flexibility has not yet been investigated explicitly. We explored interaction with Large…

Human-Computer Interaction · Computer Science 2024-10-15 Florian Lehmann , Daniel Buschek

In human-centered design, developing a comprehensive and in-depth understanding of user experiences, i.e., empathic understanding, is paramount for designing products that truly meet human needs. Nevertheless, accurately comprehending the…

Human-Computer Interaction · Computer Science 2024-03-21 Qihao Zhu , Leah Chong , Maria Yang , Jianxi Luo

Human-like Agents with diverse and dynamic personalities could serve as an essential design probe in the process of user-centered design, thereby enabling designers to enhance the user experience of interactive applications. In this…

Human-Computer Interaction · Computer Science 2024-06-18 Jiale Li , Jiayang Li , Jiahao Chen , Yifan Li , Shijie Wang , Hugo Zhou , Minjun Ye , Yunsheng Su

Interfaces for interacting with large language models (LLMs) are often designed to mimic human conversations, typically presenting a single response to user queries. This design choice can obscure the probabilistic and predictive nature of…

Human-Computer Interaction · Computer Science 2025-03-21 Chelse Swoopes , Tyler Holloway , Elena L. Glassman

A considerable part of the success experienced by Voice-controlled virtual assistants (VVA) is due to the emotional and personalized experience they deliver, with humor being a key component in providing an engaging interaction. In this…

Machine Learning · Computer Science 2019-12-09 Alejandro Mottini , Amber Roy Chowdhury

The human-computer interaction (HCI) research community has a longstanding interest in exploring the mismatch between users' actual experiences and expectation toward new technologies, for instance, large language models (LLMs). In this…

Human-Computer Interaction · Computer Science 2024-10-08 Siyi Wu , Julie Y. A. Cachia , Feixue Han , Bingsheng Yao , Tianyi Xie , Xuan Zhao , Dakuo Wang

Large Language Model-based Voice Assistants (LLM-VAs) are increasingly deployed in assistive settings for older adults, yet little is known about how an agent's personality shapes user perceptions of its explanations. This paper presents a…

Human-Computer Interaction · Computer Science 2026-04-30 Niharika Mathur , Hasibur Rahman , Smit Desai

Metaphors play a critical role in shaping user experiences with Voice User Interfaces (VUIs), yet existing designs often rely on static, human-centric metaphors that fail to adapt to diverse contexts and user needs. This paper introduces…

Human-Computer Interaction · Computer Science 2025-10-24 Smit Desai , Jessie Chin , Dakuo Wang , Benjamin Cowan , Michael Twidale

Personalized AI agents are becoming central to modern information retrieval, yet most evaluation methodologies remain static, relying on fixed benchmarks and one-off metrics that fail to reflect how users' needs evolve over time. These…

Information Retrieval · Computer Science 2025-10-07 Kirandeep Kaur , Preetam Prabhu Srikar Dammu , Hideo Joho , Chirag Shah

Makeup plays a vital role in self-expression, identity, and confidence - yet remains an underexplored domain for assistive technology, especially for people with vision impairments. While existing tools support isolated tasks such as color…

Human-Computer Interaction · Computer Science 2025-07-08 Franklin Mingzhe Li , Akihiko Oharazawa , Chloe Qingyu Zhu , Misty Fan , Daisuke Sato , Chieko Asakawa , Patrick Carrington

Large language models have enabled agentic systems that reason, plan, and interact with tools and environments to accomplish complex tasks. As these agents operate over extended interaction horizons, their effectiveness increasingly depends…

Artificial Intelligence · Computer Science 2026-03-17 Yue Xu , Qian Chen , Zizhan Ma , Dongrui Liu , Wenxuan Wang , Xiting Wang , Li Xiong , Wenjie Wang