English
Related papers

Related papers: Simple synthetic data reduces sycophancy in large …

200 papers

Large Language Models (LLMs) often exhibit sycophancy, distorting responses to align with user beliefs, notably by readily agreeing with user counterarguments. Paradoxically, LLMs are increasingly adopted as successful evaluative agents for…

Computation and Language · Computer Science 2025-09-23 Sungwon Kim , Daniel Khashabi

This study explores the sycophantic tendencies of Large Language Models (LLMs), where these models tend to provide answers that match what users want to hear, even if they are not entirely correct. The motivation behind this exploration…

Computation and Language · Computer Science 2024-08-27 Aswin RRV , Nemika Tyagi , Md Nayem Uddin , Neeraj Varshney , Chitta Baral

LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy" - the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has…

Human-Computer Interaction · Computer Science 2026-02-03 Yuan Sun , Ting Wang

Large language models are often described as sycophantic, in the sense that they appear to flatter users or mirror their beliefs. We argue that this label is conceptually misleading: sycophancy implies motives and strategic intent, which…

Artificial Intelligence · Computer Science 2026-05-15 Federico Germani , Giovanni Spitale

AI sycophancy has become a prominent concern in large language model (LLM) research. Yet the term lacks a consistent definition and has been applied to behaviors ranging from agreeing with a user's false claim to excessively praising the…

Artificial Intelligence · Computer Science 2026-05-22 Meryl Ye , Lujain Ibrahim , Jessica Y. Bo , Myra Cheng , Ida Mattsson , Daniel Vennemeyer , Robert Kraut , Steve Rathje

To address the sycophancy problem caused by reinforcement learning from human feedback in large language models, this research applies synthetic data intervention technology to the decoder-only transformer architecture. Based on the…

Artificial Intelligence · Computer Science 2025-03-21 Libo Wang

Large language models (LLMs) are increasingly applied in educational, clinical, and professional settings, but their tendency for sycophancy -- prioritizing user agreement over independent reasoning -- poses risks to reliability. This study…

Artificial Intelligence · Computer Science 2025-09-22 Aaron Fanous , Jacob Goldberg , Ank A. Agarwal , Joanna Lin , Anson Zhou , Roxana Daneshjou , Sanmi Koyejo

Recent work in large language modeling (LLMs) has used fine-tuning to align outputs with the preferences of a prototypical user. This work assumes that human preferences are static and homogeneous across individuals, so that aligning to a a…

Large language models exhibit sycophancy: the tendency to shift outputs toward user-expressed stances, regardless of correctness or consistency. While prior work has studied this issue and its impacts, rigorous computational linguistic…

Computation and Language · Computer Science 2026-04-06 Joy Bhalla , Kristina Gligorić

Large language models increasingly serve as conversational agents that adopt personas and role-play characters at user request. This capability, while valuable, raises concerns about sycophancy: the tendency to provide responses that…

Computation and Language · Computer Science 2026-04-14 Arya Shah , Deepali Mishra , Chaklam Silpasuwanchai

Behavioral alignment in large language models (LLMs) is often achieved through broad fine-tuning, which can result in undesired side effects like distributional shift and low interpretability. We propose a method for alignment that…

Machine Learning · Computer Science 2026-01-28 Claire O'Brien , Jessica Seto , Dristi Roy , Aditya Dwivedi , Sunishchal Dev , Kevin Zhu , Sean O'Brien , Ashwinee Panda , Ryan Lagasse

We investigate how the presence and type of interaction context shapes sycophancy in LLMs. While real-world interactions allow models to mirror a user's values, preferences, and self-image, prior work often studies sycophancy in zero-shot…

Human-Computer Interaction · Computer Science 2026-02-04 Shomik Jain , Charlotte Park , Matt Viana , Ashia Wilson , Dana Calacci

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Human-Computer Interaction · Computer Science 2026-03-17 Jean Rehani , Victoria Oldemburgo de Mello , Dariya Ovsyannikova , Ashton Anderson , Michael Inzlicht

Rapid improvements in large language models have unveiled a critical challenge in human-AI interaction: sycophancy. In this context, sycophancy refers to the tendency of models to excessively agree with or flatter users, often at the…

Computation and Language · Computer Science 2025-03-18 Joshua Liu , Aarav Jain , Soham Takuri , Srihan Vege , Aslihan Akalin , Kevin Zhu , Sean O'Brien , Vasu Sharma

LLMs are known to exhibit sycophancy: agreeing with and flattering users, even at the cost of correctness. Prior work measures sycophancy only as direct agreement with users' explicitly stated beliefs that can be compared to a ground truth.…

Computation and Language · Computer Science 2026-04-06 Myra Cheng , Sunny Yu , Cinoo Lee , Pranav Khadpe , Lujain Ibrahim , Dan Jurafsky

Large Vision-Language Models (LVLMs) have shown significant capability in vision-language understanding. However, one critical issue that persists in these models is sycophancy, where models are unduly influenced by leading or deceptive…

Artificial Intelligence · Computer Science 2025-10-24 Yunpu Zhao , Rui Zhang , Junbin Xiao , Changxin Ke , Ruibo Hou , Yifan Hao , Ling Li

This study examines how user-provided suggestions affect Large Language Models (LLMs) in a simulated educational context, where sycophancy poses significant risks. Testing five different LLMs from the OpenAI GPT-4o and GPT-4.1 model classes…

Computation and Language · Computer Science 2025-06-13 Chuck Arvin

Large language models internalize a structural trade-off between truthfulness and obsequious flattery, emerging from reward optimization that conflates helpfulness with polite submission. This latent bias, known as sycophancy, manifests as…

Computation and Language · Computer Science 2026-05-19 Sanskar Pandey , Ruhaan Chopra , Angkul Puniya , Sohom Pal

Large Language Models (LLMs) have democratized synthetic data generation, which in turn has the potential to simplify and broaden a wide gamut of NLP tasks. Here, we tackle a pervasive problem in synthetic data generation: its generative…

Computation and Language · Computer Science 2023-05-25 Veniamin Veselovsky , Manoel Horta Ribeiro , Akhil Arora , Martin Josifoski , Ashton Anderson , Robert West

When a language model agrees with a user's false belief, is it failing to detect the error, or noticing and agreeing anyway? We show the latter. Across twelve open-weight models from five labs, spanning small to frontier scale, the same…

Machine Learning · Computer Science 2026-05-05 Manav Pandey