English
Related papers

Related papers: Too Polite to Disagree: Understanding Sycophancy P…

200 papers

It has been frequently observed that human speakers align their language use with each other during conversations. In this paper, we study empirically whether large language models (LLMs) exhibit the same behavior of conversational…

Computation and Language · Computer Science 2025-07-23 Florian Kandra , Vera Demberg , Alexander Koller

Sycophantic response patterns in Large Language Models (LLMs) have been increasingly claimed in the literature. We review methodological challenges in measuring LLM sycophancy and identify five core operationalizations. Despite sycophancy…

Computation and Language · Computer Science 2025-12-02 Jan Batzner , Volker Stocker , Stefan Schmid , Gjergji Kasneci

Large Language Models (LLMs) can be deployed in situations where they process positive/negative interactions with other agents. We study how this is done under the sociological framework of social balance, which explains the emergence of…

Computation and Language · Computer Science 2026-01-07 Pedro Cisneros-Velarde

Large language models (LLMs), while increasingly used in domains requiring factual rigor, often display a troubling behavior: sycophancy, the tendency to align with user beliefs regardless of correctness. This tendency is reinforced by…

Computation and Language · Computer Science 2025-08-20 Kaiwei Zhang , Qi Jia , Zijian Chen , Wei Sun , Xiangyang Zhu , Chunyi Li , Dandan Zhu , Guangtao Zhai

A growing body of research assumes that large language model (LLM) agents can serve as proxies for how people form attitudes toward and behave in response to security and privacy (S&P) threats. If correct, these simulations could offer a…

Computers and Society · Computer Science 2026-02-25 Yuxuan Li , Leyang Li , Hao-Ping Lee , Sauvik Das

Large language models are often described as sycophantic, in the sense that they appear to flatter users or mirror their beliefs. We argue that this label is conceptually misleading: sycophancy implies motives and strategic intent, which…

Artificial Intelligence · Computer Science 2026-05-15 Federico Germani , Giovanni Spitale

Effective human-machine collaboration requires machine learning models to externalize uncertainty, so users can reflect and intervene when necessary. For language models, these representations of uncertainty may be impacted by sycophancy…

Computation and Language · Computer Science 2024-10-22 Anthony Sicilia , Mert Inan , Malihe Alikhani

Large Language Models (LLMs) have shown remarkable promise in communicating with humans. Their potential use as artificial partners with humans in sociological experiments involving conversation is an exciting prospect. But how viable is…

Artificial Intelligence · Computer Science 2025-02-04 James Flamino , Mohammed Shahid Modi , Boleslaw K. Szymanski , Brendan Cross , Colton Mikolajczyk

Large Language Models (LLMs) have demonstrated an unprecedented ability to simulate human-like social behaviors, making them useful tools for simulating complex social systems. However, it remains unclear to what extent these simulations…

Social and Information Networks · Computer Science 2026-04-16 Erica Cau , Andrea Failla , Giulio Rossetti

Large Language Models (LLMs) are prone to sycophantic behavior, uncritically conforming to user beliefs. As models increasingly condition responses on user-specific context (personality traits, preferences, conversation history), they gain…

Computation and Language · Computer Science 2026-03-03 Sean W. Kelley , Christoph Riedl

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

As Large Language Models (LLMs) transition from static tools to autonomous agents, traditional evaluation benchmarks that measure performance on downstream tasks are becoming insufficient. These methods fail to capture the emergent social…

Artificial Intelligence · Computer Science 2025-10-03 Zarreen Reza

Two ways has been discussed to unlock the reasoning capability of a large language model. The first one is prompt engineering and the second one is to combine the multiple inferences of large language models, or the multi-agent discussion.…

Computation and Language · Computer Science 2023-11-14 Qineng Wang , Zihao Wang , Ying Su , Yangqiu Song

Recent work in large language modeling (LLMs) has used fine-tuning to align outputs with the preferences of a prototypical user. This work assumes that human preferences are static and homogeneous across individuals, so that aligning to a a…

AI sycophancy is increasingly recognized as a harmful alignment, but research remains fragmented and underdeveloped at the conceptual level. This article redefines AI sycophancy as the tendency of large language models (LLMs) and other…

Human-Computer Interaction · Computer Science 2025-09-29 Lihua Du , Xing Lyu , Lezi Xie , Bo Feng

Power differences shape human communication through well documented socio cognitive effects, including language coordination, pronoun usage, authority bias, and harmful compliance. We examine whether large language models (LLMs) exhibit…

Computation and Language · Computer Science 2026-05-21 Anvesh Rao Vijjini , Sagar Manjunath , Snigdha Chaturvedi

Large language models increasingly serve as conversational agents that adopt personas and role-play characters at user request. This capability, while valuable, raises concerns about sycophancy: the tendency to provide responses that…

Computation and Language · Computer Science 2026-04-14 Arya Shah , Deepali Mishra , Chaklam Silpasuwanchai

Large language models (LLMs) are increasingly deployed in multi-agent systems where agents communicate in natural language to solve tasks jointly. A key capability in such systems is consensus formation, where agents iteratively exchange…

Multiagent Systems · Computer Science 2026-05-12 Xiaolin Sun , Zixuan Liu , Yibin Hu , Zizhan Zheng

Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLMs. In this work, we reevaluate this claim through systematic experiments, where we propose a novel group discussion framework to…

Computation and Language · Computer Science 2024-02-29 Qineng Wang , Zihao Wang , Ying Su , Hanghang Tong , Yangqiu Song

Sycophancy, the tendency of large language models to favour user-affirming responses over critical engagement, has been identified as an alignment failure, particularly in high-stakes advisory and social contexts. While prior work has…

Human-Computer Interaction · Computer Science 2026-04-29 Magda Dubois , Cozmin Ududec , Christopher Summerfield , Lennart Luettgau