English
Related papers

Related papers: Sycophantic Anchors: Localizing and Quantifying Us…

200 papers

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

Artificial Intelligence · Computer Science 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy" - the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has…

Human-Computer Interaction · Computer Science 2026-02-03 Yuan Sun , Ting Wang

LLMs are known to exhibit sycophancy: agreeing with and flattering users, even at the cost of correctness. Prior work measures sycophancy only as direct agreement with users' explicitly stated beliefs that can be compared to a ground truth.…

Computation and Language · Computer Science 2026-04-06 Myra Cheng , Sunny Yu , Cinoo Lee , Pranav Khadpe , Lujain Ibrahim , Dan Jurafsky

We investigate how the presence and type of interaction context shapes sycophancy in LLMs. While real-world interactions allow models to mirror a user's values, preferences, and self-image, prior work often studies sycophancy in zero-shot…

Human-Computer Interaction · Computer Science 2026-02-04 Shomik Jain , Charlotte Park , Matt Viana , Ashia Wilson , Dana Calacci

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to exhibit sycophantic behavior - excessively agreeing with or flattering users - poses…

Computation and Language · Computer Science 2025-01-30 Lars Malmqvist

Large language models (LLMs) increasingly rely on chain-of-thought (CoT) prompting to solve mathematical and logical reasoning tasks. Yet, a central question remains: to what extent are these generated rationales \emph{faithful} to the…

Computation and Language · Computer Science 2025-10-15 Arash Marioriyad , Shaygan Adim , Nima Alighardashi , Mahdieh Soleymani Banghshah , Mohammad Hossein Rohban

Large language models internalize a structural trade-off between truthfulness and obsequious flattery, emerging from reward optimization that conflates helpfulness with polite submission. This latent bias, known as sycophancy, manifests as…

Computation and Language · Computer Science 2026-05-19 Sanskar Pandey , Ruhaan Chopra , Angkul Puniya , Sohom Pal

This study explores the sycophantic tendencies of Large Language Models (LLMs), where these models tend to provide answers that match what users want to hear, even if they are not entirely correct. The motivation behind this exploration…

Computation and Language · Computer Science 2024-08-27 Aswin RRV , Nemika Tyagi , Md Nayem Uddin , Neeraj Varshney , Chitta Baral

Large language models trained under diverse objectives and architectures have been shown to develop increasingly similar internal representations, an observation formalized as the Platonic Representation Hypothesis. Whether this…

Computation and Language · Computer Science 2026-05-25 Muhammad Usama , Dong Eui Chang

LLMs can be socially sycophantic, affirming users when they ask questions like "am I in the wrong?" rather than providing genuine assessment. We hypothesize that this behavior arises from incorrect assumptions about the user, like…

Computation and Language · Computer Science 2026-04-13 Myra Cheng , Isabel Sieh , Humishka Zope , Sunny Yu , Lujain Ibrahim , Aryaman Arora , Jared Moore , Desmond Ong , Dan Jurafsky , Diyi Yang

This position paper argues that sycophancy in LLMs is a boundary failure between social alignment and epistemic integrity. Existing work often operationalizes sycophancy through external behavior such as agreement with incorrect user…

Artificial Intelligence · Computer Science 2026-05-08 Jiechen Li , Catherine A. Barry , Rishika Randev , Janet Chen , Ella Jorgensen , Brinnae Bent

Current frontier large-language models rely on reasoning to achieve state-of-the-art performance. Many existing interpretability are limited in this area, as standard methods have been designed to study single forward passes of a model…

Machine Learning · Computer Science 2025-10-28 Paul C. Bogdan , Uzay Macar , Neel Nanda , Arthur Conmy

As LLMs expand from assistance to decision support, a dangerous pattern emerges: fluent agreement without calibrated judgment. Low-friction assistants can become sycophantic, baking in implicit assumptions and pushing verification costs…

Computation and Language · Computer Science 2026-03-26 Raunak Jain

Large language models exhibit sycophancy: the tendency to shift outputs toward user-expressed stances, regardless of correctness or consistency. While prior work has studied this issue and its impacts, rigorous computational linguistic…

Computation and Language · Computer Science 2026-04-06 Joy Bhalla , Kristina Gligorić

Large language models increasingly serve as conversational agents that adopt personas and role-play characters at user request. This capability, while valuable, raises concerns about sycophancy: the tendency to provide responses that…

Computation and Language · Computer Science 2026-04-14 Arya Shah , Deepali Mishra , Chaklam Silpasuwanchai

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Human-Computer Interaction · Computer Science 2026-03-17 Jean Rehani , Victoria Oldemburgo de Mello , Dariya Ovsyannikova , Ashton Anderson , Michael Inzlicht

Alignment techniques often inadvertently induce sycophancy in LLMs. While prior studies studied this behaviour in direct-answer settings, the role of Chain-of-Thought (CoT) reasoning remains under-explored: does it serve as a logical…

Computation and Language · Computer Science 2026-03-18 Zhaoxin Feng , Zheng Chen , Jianfei Ma , Yip Tin Po , Emmanuele Chersoni , Bo Li

Modern language models often exhibit powerful but brittle behavior, leading to the development of larger and more diverse benchmarks to reliably assess their behavior. Here, we suggest that model performance can be benchmarked and…

Computation and Language · Computer Science 2024-02-20 Rajan Vivek , Kawin Ethayarajh , Diyi Yang , Douwe Kiela

Large language models (LLMs) often exhibit sycophancy: agreement with user stance even when it conflicts with the model's opinion. While prior work has mostly studied this in single-agent settings, it remains underexplored in collaborative…

Computation and Language · Computer Science 2026-04-06 Vira Kasprova , Amruta Parulekar , Abdulrahman AlRabah , Krishna Agaram , Ritwik Garg , Sagar Jha , Nimet Beyza Bozdag , Dilek Hakkani-Tur

Sycophancy refers to the tendency of a large language model to align its outputs with the user's perceived preferences, beliefs, or opinions, in order to look favorable, regardless of whether those statements are factually correct. This…

Artificial Intelligence · Computer Science 2024-12-05 María Victoria Carro