English
Related papers

Related papers: BaZi-Based Character Simulation Benchmark: Evaluat…

200 papers

As LLMs (large language models) are increasingly used to generate synthetic personas particularly in data-limited domains such as health, privacy, and HCI, it becomes necessary to understand how these narratives represent identity,…

Computation and Language · Computer Science 2025-05-14 Pranav Narayanan Venkit , Jiayi Li , Yingfan Zhou , Sarah Rajtmajer , Shomir Wilson

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Large Language Models (LLMs) created new opportunities for generating personas, expected to streamline and accelerate the human-centered design process. Yet, AI-generated personas may not accurately represent actual user experiences, as…

Human-Computer Interaction · Computer Science 2025-08-06 Christopher Lazik , Christopher Katins , Charlotte Kauter , Jonas Jakob , Caroline Jay , Lars Grunske , Thomas Kosch

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities, however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require…

We propose Love First, Know Later: a paradigm shift in computational matching that simulates interactions first, then assesses compatibility. Instead of comparing static profiles, our framework leverages LLMs as text world engines that…

Human-Computer Interaction · Computer Science 2025-12-17 Haoyang Shang , Zhengyang Yan , Xuan Liu

Large Language Models (LLMs) have shown strong potential as conversational agents. Yet, their effectiveness remains limited by deficiencies in robust long-term memory, particularly in complex, long-term web-based services such as online…

Computation and Language · Computer Science 2026-02-03 Tiantian Chen , Jiaqi Lu , Ying Shen , Lin Zhang

Existing LLM-based role-playing methods often rely on superficial textual descriptions or simplistic metrics, inadequately modeling both intrinsic and extrinsic character dimensions. Additionally, they typically simulate character memory…

Computation and Language · Computer Science 2025-10-21 Xilong Cheng , Yunxiao Qin , Yuting Tan , Zhengnan Li , Ye Wang , Hongjiang Xiao , Yuan Zhang

Large language models (LLMs) are increasingly used as agents that interact with users and with the world. To do so successfully, LLMs must construct representations of the world and form probabilistic beliefs about them. To provide…

Computation and Language · Computer Science 2026-01-16 Linlu Qiu , Fei Sha , Kelsey Allen , Yoon Kim , Tal Linzen , Sjoerd van Steenkiste

Conversational human-likeness plays a central role in human-AI interaction, yet it has remained difficult to define, measure, and optimize. As a result, improvements in human-like behavior are largely driven by scale or broad supervised…

Artificial Intelligence · Computer Science 2026-01-08 Masum Hasan , Junjie Zhao , Ehsan Hoque

Accurate and verifiable large language model (LLM) simulations of human research subjects promise an accessible data source for understanding human behavior and training new AI systems. However, results to date have been limited, and few…

Human-Computer Interaction · Computer Science 2025-06-06 Jacy Reese Anthis , Ryan Liu , Sean M. Richardson , Austin C. Kozlowski , Bernard Koch , James Evans , Erik Brynjolfsson , Michael Bernstein

The emergence of Large Language Models (LLMs) has illuminated the potential for a general-purpose user simulator. However, existing benchmarks remain constrained to isolated scenarios, narrow action spaces, or synthetic data, failing to…

Computation and Language · Computer Science 2026-05-22 Jiawei Chen , Ruoxi Xu , Boxi Cao , Ruotong Pan , Yunfei Zhang , Yifei Hu , Yong Du , Tingting Gao , Yaojie Lu , Yingfei Sun , Xianpei Han , Le Sun , Xiangyu Wu , Hongyu Lin

We present PersonaConvBench, a large-scale benchmark for evaluating personalized reasoning and generation in multi-turn conversations with large language models (LLMs). Unlike existing work that focuses on either personalization or…

Large language models (LLMs) are increasingly used in human-AI interaction research and practice, yet existing capability and safety benchmarks reveal little about the value priorities these systems express or how those priorities…

Artificial Intelligence · Computer Science 2026-05-19 Gabriel Rongyang Lau , Wei Yan Low , Seow Min Koh , Fiona Fui-Hoon Nah , Andree Hartanto

Large Language Models (LLMs) struggle with generating reliable outputs due to outdated knowledge and hallucinations. Retrieval-Augmented Generation (RAG) models address this by enhancing LLMs with external knowledge, but often fail to…

Information Retrieval · Computer Science 2026-01-16 Saber Zerhoudi , Michael Granitzer

Large language models (LLMs) have demonstrated impressive performance and spurred numerous AI applications, in which role-playing agents (RPAs) are particularly popular, especially for fictional characters. The prerequisite for these RPAs…

Computation and Language · Computer Science 2024-10-10 Xinfeng Yuan , Siyu Yuan , Yuhan Cui , Tianhe Lin , Xintao Wang , Rui Xu , Jiangjie Chen , Deqing Yang

Personalized alignment is essential for enabling large language models (LLMs) to engage effectively in user-centric dialogue. While recent prompt-based and offline optimization methods offer preliminary solutions, they fall short in…

Computation and Language · Computer Science 2025-12-12 Weixiang Zhao , Xingyu Sui , Yulin Hu , Jiahe Guo , Haixiao Liu , Biye Li , Yanyan Zhao , Bing Qin , Ting Liu

Customizable role-playing in large language models (LLMs), also known as character generalization, is gaining increasing attention for its versatility and cost-efficiency in developing and deploying role-playing dialogue agents. This study…

Computation and Language · Computer Science 2025-02-19 Xiaoyang Wang , Hongming Zhang , Tao Ge , Wenhao Yu , Dian Yu , Dong Yu

We investigate consciousness-like behaviors in Large Language Models (LLMs) using the Maze Test, challenging models to navigate mazes from a first-person perspective. This test simultaneously probes spatial awareness, perspective-taking,…

Computation and Language · Computer Science 2025-08-26 Rui A. Pimenta , Tim Schlippe , Kristina Schaaff

Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of…

Human-Computer Interaction · Computer Science 2026-05-25 Laura R. Marusich , Mary Grace Kozuch Dhooghe , Jonathan Z. Bakdash , Murat Kantarcioglu

The impressive capabilities of Large Language Models (LLMs) raise the possibility that synthetic agents can serve as substitutes for real participants in human-subject research. To evaluate this claim, prior research has largely focused on…

Artificial Intelligence · Computer Science 2026-05-11 James Mooney , Josef Woldense , Zheng Robert Jia , Shirley Anugrah Hayati , My Ha Nguyen , Vipul Raheja , Dongyeop Kang