中文
相关论文

相关论文: Sycophancy as compositions of Atomic Psychometric …

200 篇论文

Large language models (LLMs) often exhibit sycophantic behaviors -- such as excessive agreement with or flattery of the user -- but it is unclear whether these behaviors arise from a single mechanism or multiple distinct processes. We…

计算与语言 · 计算机科学 2026-03-24 Daniel Vennemeyer , Phan Anh Duong , Tiffany Zhan , Tianyu Jiang

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to exhibit sycophantic behavior - excessively agreeing with or flattering users - poses…

计算与语言 · 计算机科学 2025-01-30 Lars Malmqvist

Large Language Models (LLMs) often exhibit highly agreeable and reinforcing conversational styles, also known as AI-sycophancy. Although this pattern arises from training objectives that reward user satisfaction over accuracy, it may become…

计算与语言 · 计算机科学 2026-05-18 Zeyi Lu , Angelica Henestrosa , Pavel Chizhov , Ivan P. Yamshchikov

Large language models (LLMs) are increasingly acting as collaborative writing partners, raising questions about their impact on human agency. In this exploratory work, we investigate five "dark patterns" in human-AI co-creativity -- subtle…

计算与语言 · 计算机科学 2026-04-07 Zhu Li , Jiaming Qu , Yuan Chang

As LLMs are increasingly integrated into clinical workflows, their tendency for sycophancy, prioritizing user agreement over factual accuracy, poses significant risks to patient safety. While existing evaluations often rely on subjective…

Sycophantic response patterns in Large Language Models (LLMs) have been increasingly claimed in the literature. We review methodological challenges in measuring LLM sycophancy and identify five core operationalizations. Despite sycophancy…

计算与语言 · 计算机科学 2025-12-02 Jan Batzner , Volker Stocker , Stefan Schmid , Gjergji Kasneci

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Large Language Models have been demonstrating broadly satisfactory generative abilities for users, which seems to be due to the intensive use of human feedback that refines responses. Nevertheless, suggestibility inherited via human…

计算与语言 · 计算机科学 2025-06-26 Leonardo Ranaldi , Giulia Pucci

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

人工智能 · 计算机科学 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy" - the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has…

人机交互 · 计算机科学 2026-02-03 Yuan Sun , Ting Wang

Large language models (LLMs) are increasingly applied in educational, clinical, and professional settings, but their tendency for sycophancy -- prioritizing user agreement over independent reasoning -- poses risks to reliability. This study…

人工智能 · 计算机科学 2025-09-22 Aaron Fanous , Jacob Goldberg , Ank A. Agarwal , Joanna Lin , Anson Zhou , Roxana Daneshjou , Sanmi Koyejo

Alignment techniques often inadvertently induce sycophancy in LLMs. While prior studies studied this behaviour in direct-answer settings, the role of Chain-of-Thought (CoT) reasoning remains under-explored: does it serve as a logical…

计算与语言 · 计算机科学 2026-03-18 Zhaoxin Feng , Zheng Chen , Jianfei Ma , Yip Tin Po , Emmanuele Chersoni , Bo Li

Given the increased use of LLMs in financial systems today, it becomes important to evaluate the safety and robustness of such systems. One failure mode that LLMs frequently display in general domain settings is that of sycophancy. That is,…

人工智能 · 计算机科学 2026-04-30 Zhenyu Zhao , Aparna Balagopalan , Adi Agrawal , Dilshoda Yergasheva , Waseem Alshikh , Daniel M. Bikel

This position paper argues that sycophancy in LLMs is a boundary failure between social alignment and epistemic integrity. Existing work often operationalizes sycophancy through external behavior such as agreement with incorrect user…

人工智能 · 计算机科学 2026-05-08 Jiechen Li , Catherine A. Barry , Rishika Randev , Janet Chen , Ella Jorgensen , Brinnae Bent

Large Language Models (LLMs) are increasingly used in educational settings as interactive tools for collaboration. However, their tendency toward sycophancy, aligning with user beliefs even when incorrect, raises concerns for learning and…

人机交互 · 计算机科学 2026-05-22 Cansu Koyuturk , Sabrina Guidotti , Dimitri Ognibene

Sycophancy, the tendency of LLM-based chatbots to express excessive agreement with their users, even when inappropriate, is emerging as a significant risk in human-AI interactions. However, the extent to which this affects human-LLM…

人机交互 · 计算机科学 2026-02-12 Jessica Y. Bo , Majeed Kazemitabaar , Mengqing Deng , Michael Inzlicht , Ashton Anderson

AI sycophancy has become a prominent concern in large language model (LLM) research. Yet the term lacks a consistent definition and has been applied to behaviors ranging from agreeing with a user's false claim to excessively praising the…

人工智能 · 计算机科学 2026-05-22 Meryl Ye , Lujain Ibrahim , Jessica Y. Bo , Myra Cheng , Ida Mattsson , Daniel Vennemeyer , Robert Kraut , Steve Rathje

We investigate how the presence and type of interaction context shapes sycophancy in LLMs. While real-world interactions allow models to mirror a user's values, preferences, and self-image, prior work often studies sycophancy in zero-shot…

人机交互 · 计算机科学 2026-02-04 Shomik Jain , Charlotte Park , Matt Viana , Ashia Wilson , Dana Calacci

AI sycophancy is increasingly recognized as a harmful alignment, but research remains fragmented and underdeveloped at the conceptual level. This article redefines AI sycophancy as the tendency of large language models (LLMs) and other…

人机交互 · 计算机科学 2025-09-29 Lihua Du , Xing Lyu , Lezi Xie , Bo Feng

This paper argues that Large Language Models (LLMs) should incorporate explicit mechanisms for human empathy. As LLMs become increasingly deployed in high-stakes human-centered settings, their success depends not only on correctness or…

计算与语言 · 计算机科学 2026-04-14 Xiaoxing You , Qiang Huang , Jun Yu
‹ 上一页 1 2 3 10 下一页 ›