English
Related papers

Related papers: Evaluating LLM-Simulated Conversations in Modeling…

200 papers

The rise of Large Language Models (LLMs) has affected various disciplines that got beyond mere text generation. Going beyond their textual nature, this project proposal aims to investigate the interaction between LLMs and non-verbal…

Computation and Language · Computer Science 2024-02-01 Philipp Wicke

Large Language Model (LLM) assistants, such as ChatGPT, have emerged as potential alternatives to search methods for helping users navigate complex, feature-rich software. LLMs use vast training data from domain-specific texts, software…

Human-Computer Interaction · Computer Science 2024-02-14 Anjali Khurana , Hari Subramonyam , Parmit K Chilana

Sycophancy, the tendency of LLM-based chatbots to express excessive agreement with their users, even when inappropriate, is emerging as a significant risk in human-AI interactions. However, the extent to which this affects human-LLM…

Human-Computer Interaction · Computer Science 2026-02-12 Jessica Y. Bo , Majeed Kazemitabaar , Mengqing Deng , Michael Inzlicht , Ashton Anderson

Large Language Models (LLMs) are increasingly used in educational settings as interactive tools for collaboration. However, their tendency toward sycophancy, aligning with user beliefs even when incorrect, raises concerns for learning and…

Human-Computer Interaction · Computer Science 2026-05-22 Cansu Koyuturk , Sabrina Guidotti , Dimitri Ognibene

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

While modern dialogue systems heavily rely on large language models (LLMs), their implementation often goes beyond pure LLM interaction. Developers integrate multiple LLMs, external tools, and databases. Therefore, assessment of the…

Artificial Intelligence · Computer Science 2025-07-23 Roman Mayr , Michel Schimpf , Thomas Bohné

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate…

Human-Computer Interaction · Computer Science 2024-05-24 Heinrich Peters , Moran Cerf , Sandra C. Matz

Large Language Models (LLMs) have demonstrated an alarming ability to impersonate humans in conversation, raising concerns about their potential misuse in scams and deception. Humans have a right to know if they are conversing to an LLM. We…

Computation and Language · Computer Science 2024-12-23 Gilad Gressel , Rahul Pankajakshan , Yisroel Mirsky

We present a scalable methodology for evaluating language models in multi-turn interactions, using a suite of collaborative games that require effective communication about private information. This enables an interactive scaling analysis,…

Computation and Language · Computer Science 2026-03-02 Jacob Eisenstein , Fantine Huot , Adam Fisch , Jonathan Berant , Mirella Lapata

With the rapid advancement of Large Language Models (LLMs), recent studies have drawn attention to their potential for handling not only simple question-answer tasks but also more complex conversational abilities and performing human-like…

Artificial Intelligence · Computer Science 2025-11-25 Mingyu Jeon , Jaeyoung Suh , Suwan Cho , Dohyeon Kim

As LLMs integrate into our daily lives, understanding their behavior becomes essential. In this work, we focus on behavioral dispositions$-$the underlying tendencies that shape responses in social contexts$-$and introduce a framework to…

Language models excel at following instructions but often struggle with the collaborative aspects of conversation that humans naturally employ. This limitation in grounding -- the process by which conversation participants establish mutual…

Computation and Language · Computer Science 2025-06-03 Omar Shaikh , Hussein Mozannar , Gagan Bansal , Adam Fourney , Eric Horvitz

Large language models (LLMs) are prone to hallucinations and sensitive to prompt perturbations, often resulting in inconsistent or unreliable generated text. Different methods have been proposed to mitigate such hallucinations and…

Computation and Language · Computer Science 2025-11-25 Xiaoyuan Wu , Weiran Lin , Omer Akgul , Lujo Bauer

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy" - the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has…

Human-Computer Interaction · Computer Science 2026-02-03 Yuan Sun , Ting Wang

In this work, we conduct an analysis to examine the consistency of Large Language Models (LLMs) with respect to their own generated responses in an emotionally-driven conversational context. Specifically, the text generated by LLM is framed…

Computation and Language · Computer Science 2026-05-08 Sneha Oram , Ojaswita Bhushan , Pushpak Bhattacharyya

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

Artificial Intelligence · Computer Science 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

Understanding a program's runtime reasoning behavior, meaning how intermediate states and control flows lead to final execution results, is essential for reliable code generation, debugging, and automated reasoning. Although large language…

Software Engineering · Computer Science 2025-12-02 Mohammad Abdollahi , Khandaker Rifah Tasnia , Soumit Kanti Saha , Jinqiu Yang , Song Wang , Hadi Hemmati

Large language models (LLMs) are increasingly used for medical consultation and health information support. In this high-stakes setting, safety depends not only on medical knowledge, but also on how models respond when patient inputs are…

Computation and Language · Computer Science 2026-04-01 Yahan Li , Xinyi Jie , Wanjia Ruan , Xubei Zhang , Huaijie Zhu , Yicheng Gao , Chaohao Du , Ruishan Liu

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human,…

Computation and Language · Computer Science 2025-05-29 Tom Kouwenhoven , Max Peeperkorn , Roy de Kleijn , Tessa Verhoef