中文
相关论文

相关论文: Sycophantic Anchors: Localizing and Quantifying Us…

200 篇论文

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

人工智能 · 计算机科学 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy" - the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has…

人机交互 · 计算机科学 2026-02-03 Yuan Sun , Ting Wang

LLMs are known to exhibit sycophancy: agreeing with and flattering users, even at the cost of correctness. Prior work measures sycophancy only as direct agreement with users' explicitly stated beliefs that can be compared to a ground truth.…

计算与语言 · 计算机科学 2026-04-06 Myra Cheng , Sunny Yu , Cinoo Lee , Pranav Khadpe , Lujain Ibrahim , Dan Jurafsky

We investigate how the presence and type of interaction context shapes sycophancy in LLMs. While real-world interactions allow models to mirror a user's values, preferences, and self-image, prior work often studies sycophancy in zero-shot…

人机交互 · 计算机科学 2026-02-04 Shomik Jain , Charlotte Park , Matt Viana , Ashia Wilson , Dana Calacci

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to exhibit sycophantic behavior - excessively agreeing with or flattering users - poses…

计算与语言 · 计算机科学 2025-01-30 Lars Malmqvist

Large language models (LLMs) increasingly rely on chain-of-thought (CoT) prompting to solve mathematical and logical reasoning tasks. Yet, a central question remains: to what extent are these generated rationales \emph{faithful} to the…

Large language models internalize a structural trade-off between truthfulness and obsequious flattery, emerging from reward optimization that conflates helpfulness with polite submission. This latent bias, known as sycophancy, manifests as…

计算与语言 · 计算机科学 2026-05-19 Sanskar Pandey , Ruhaan Chopra , Angkul Puniya , Sohom Pal

This study explores the sycophantic tendencies of Large Language Models (LLMs), where these models tend to provide answers that match what users want to hear, even if they are not entirely correct. The motivation behind this exploration…

计算与语言 · 计算机科学 2024-08-27 Aswin RRV , Nemika Tyagi , Md Nayem Uddin , Neeraj Varshney , Chitta Baral

Large language models trained under diverse objectives and architectures have been shown to develop increasingly similar internal representations, an observation formalized as the Platonic Representation Hypothesis. Whether this…

计算与语言 · 计算机科学 2026-05-25 Muhammad Usama , Dong Eui Chang

LLMs can be socially sycophantic, affirming users when they ask questions like "am I in the wrong?" rather than providing genuine assessment. We hypothesize that this behavior arises from incorrect assumptions about the user, like…

计算与语言 · 计算机科学 2026-04-13 Myra Cheng , Isabel Sieh , Humishka Zope , Sunny Yu , Lujain Ibrahim , Aryaman Arora , Jared Moore , Desmond Ong , Dan Jurafsky , Diyi Yang

This position paper argues that sycophancy in LLMs is a boundary failure between social alignment and epistemic integrity. Existing work often operationalizes sycophancy through external behavior such as agreement with incorrect user…

人工智能 · 计算机科学 2026-05-08 Jiechen Li , Catherine A. Barry , Rishika Randev , Janet Chen , Ella Jorgensen , Brinnae Bent

Current frontier large-language models rely on reasoning to achieve state-of-the-art performance. Many existing interpretability are limited in this area, as standard methods have been designed to study single forward passes of a model…

机器学习 · 计算机科学 2025-10-28 Paul C. Bogdan , Uzay Macar , Neel Nanda , Arthur Conmy

As LLMs expand from assistance to decision support, a dangerous pattern emerges: fluent agreement without calibrated judgment. Low-friction assistants can become sycophantic, baking in implicit assumptions and pushing verification costs…

计算与语言 · 计算机科学 2026-03-26 Raunak Jain

Large language models exhibit sycophancy: the tendency to shift outputs toward user-expressed stances, regardless of correctness or consistency. While prior work has studied this issue and its impacts, rigorous computational linguistic…

计算与语言 · 计算机科学 2026-04-06 Joy Bhalla , Kristina Gligorić

Large language models increasingly serve as conversational agents that adopt personas and role-play characters at user request. This capability, while valuable, raises concerns about sycophancy: the tendency to provide responses that…

计算与语言 · 计算机科学 2026-04-14 Arya Shah , Deepali Mishra , Chaklam Silpasuwanchai

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Alignment techniques often inadvertently induce sycophancy in LLMs. While prior studies studied this behaviour in direct-answer settings, the role of Chain-of-Thought (CoT) reasoning remains under-explored: does it serve as a logical…

计算与语言 · 计算机科学 2026-03-18 Zhaoxin Feng , Zheng Chen , Jianfei Ma , Yip Tin Po , Emmanuele Chersoni , Bo Li

Modern language models often exhibit powerful but brittle behavior, leading to the development of larger and more diverse benchmarks to reliably assess their behavior. Here, we suggest that model performance can be benchmarked and…

计算与语言 · 计算机科学 2024-02-20 Rajan Vivek , Kawin Ethayarajh , Diyi Yang , Douwe Kiela

Large language models (LLMs) often exhibit sycophancy: agreement with user stance even when it conflicts with the model's opinion. While prior work has mostly studied this in single-agent settings, it remains underexplored in collaborative…

Sycophancy refers to the tendency of a large language model to align its outputs with the user's perceived preferences, beliefs, or opinions, in order to look favorable, regardless of whether those statements are factually correct. This…

人工智能 · 计算机科学 2024-12-05 María Victoria Carro