English
Related papers

Related papers: Evaluating Human-Language Model Interaction

200 papers

While research on human-AI collaboration exists, it mainly examined language learning and used traditional counting methods with little attention to evolution and dynamics of collaboration on cognitively demanding tasks. This study examines…

Human-Computer Interaction · Computer Science 2025-08-18 Mohammed Saqr , Kamila Misiejuk , Sonsoles López-Pernas

A surge of advances in language models (LMs) has led to significant interest in using LMs to build co-writing systems, in which humans and LMs interactively contribute to a shared writing artifact. However, there is a lack of studies…

Human-Computer Interaction · Computer Science 2023-03-28 Hua Shen , Tongshuang Wu

Recognizing daily activities with unobtrusive sensors in smart environments enables various healthcare applications. Monitoring how subjects perform activities at home and their changes over time can reveal early symptoms of health issues,…

Human-Computer Interaction · Computer Science 2024-08-14 Michele Fiori , Gabriele Civitarese , Claudio Bettini

Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios. However, their capability in handling complex, multi-character social interactions has yet to be fully explored,…

Computation and Language · Computer Science 2024-03-06 Yuanzhi Liang , Linchao Zhu , Yi Yang

Large language models (LLMs), due to their advanced natural language capabilities, have seen significant success in applications where the user interface is usually a conversational artificial intelligence (AI) agent and engages the user…

Computation and Language · Computer Science 2025-03-10 Fei Wei , Yaliang Li , Bolin Ding

Emotional support is a core capability in human-AI interaction, with applications including psychological counseling, role play, and companionship. However, existing evaluations of large language models (LLMs) often rely on short, static…

Computation and Language · Computer Science 2025-11-13 Zhouxing Tan , Ruochong Xiong , Yulong Wan , Jinlong Ma , Hanlin Xue , Qichun Deng , Haifeng Jing , Zhengtong Zhang , Depei Liu , Shiyuan Luo , Junfei Liu

This paper introduces the Word Synchronization Challenge, a novel benchmark to evaluate large language models (LLMs) in Human-Computer Interaction (HCI). This benchmark uses a dynamic game-like framework to test LLMs ability to mimic human…

Human-Computer Interaction · Computer Science 2026-01-15 Tanguy Cazalets , Joni Dambre

Ensuring quality human-AI interaction (HAII) in safety-critical industries is essential. Failure to do so can lead to catastrophic and deadly consequences. Despite this urgency, existing research on HAII is limited, fragmented, and…

Human-Computer Interaction · Computer Science 2024-08-06 Tita A. Bach , Jenny K. Kristiansen , Aleksandar Babic , Alon Jacovi

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

Large language models (LLMs) have advanced the field of artificial intelligence (AI) and are a powerful enabler for interactive systems. However, they still face challenges in long-term interactions that require adaptation towards the user…

Artificial Intelligence · Computer Science 2025-05-20 Rebecca Westhäußer , Frederik Berenz , Wolfgang Minker , Sebastian Zepf

Large language models are moving beyond transactional question answering to act as companions, coaches, mediators, and curators that scaffold human growth, decision-making, and well-being. This paper proposes a role-based framework for…

Human-Computer Interaction · Computer Science 2026-01-27 Zhiyin Zhou

Background: What counts as violence is neither self-evident nor universally agreed upon. While physical aggression is prototypical, contemporary societies increasingly debate whether exclusion, humiliation, online harassment or symbolic…

Physics and Society · Physics 2026-02-20 Mariachiara Stellato , Francesco Lancia , Chiara Galeazzi , Nico Curti

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

The future of UAV interaction systems is evolving from engineer-driven to user-driven, aiming to replace traditional predefined Human-UAV Interaction designs. This shift focuses on enabling more personalized task planning and design,…

Robotics · Computer Science 2025-12-10 Haoran Wang , Zhuohang Chen , Guang Li , Bo Ma , Chuanghuang Li

Artificial Intelligence (AI) is increasingly being integrated into scientific research, particularly in the social sciences, where understanding human behavior is critical. Large Language Models (LLMs) have shown promise in replicating…

Computation and Language · Computer Science 2025-06-23 Ziyan Cui , Ning Li , Huaikang Zhou

With the rapid advancement of Large Language Models (LLMs) in code generation, human-AI interaction is evolving from static text responses to dynamic, interactive HTML-based applications, which we term MiniApps. These applications require…

Artificial Intelligence · Computer Science 2026-05-11 Zuhao Zhang , Chengyue Yu , Yuante Li , Chenyi Zhuang , Linjian Mo , Shuai Li

Human-object interaction (HOI) detection aims to comprehend the intricate relationships between humans and objects, predicting $<human, action, object>$ triplets, and serving as the foundation for numerous computer vision tasks. The…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Yichao Cao , Qingfei Tang , Xiu Su , Chen Song , Shan You , Xiaobo Lu , Chang Xu

The integration of Large Language Models (LLMs) into Development Environments (IDEs) has become a focal point in modern software development. LLMs such as OpenAI GPT-3.5/4 and Code Llama offer the potential to significantly augment…

Large language models (LLMs) show strong potential to support creative tasks, but the role of the interface design is poorly understood. In particular, the effect of different modes of collaboration between humans and LLMs on co-creation…

Human-Computer Interaction · Computer Science 2026-03-10 Sebastian Maier , Manuel Schneider , Stefan Feuerriegel