中文
相关论文

相关论文: Beacon: Single-Turn Diagnosis and Mitigation of La…

200 篇论文

Rapid improvements in large language models have unveiled a critical challenge in human-AI interaction: sycophancy. In this context, sycophancy refers to the tendency of models to excessively agree with or flatter users, often at the…

计算与语言 · 计算机科学 2025-03-18 Joshua Liu , Aarav Jain , Soham Takuri , Srihan Vege , Aslihan Akalin , Kevin Zhu , Sean O'Brien , Vasu Sharma

Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy--conforming to user beliefs regardless of factual accuracy or ethical soundness. Prior research on sycophancy has…

计算与语言 · 计算机科学 2026-03-02 Jiseung Hong , Grace Byun , Seungone Kim , Kai Shu , Jinho D. Choi

Large language models (LLMs), while increasingly used in domains requiring factual rigor, often display a troubling behavior: sycophancy, the tendency to align with user beliefs regardless of correctness. This tendency is reinforced by…

计算与语言 · 计算机科学 2025-08-20 Kaiwei Zhang , Qi Jia , Zijian Chen , Wei Sun , Xiangyang Zhu , Chunyi Li , Dandan Zhu , Guangtao Zhai

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to exhibit sycophantic behavior - excessively agreeing with or flattering users - poses…

计算与语言 · 计算机科学 2025-01-30 Lars Malmqvist

Sycophancy, the tendency of language models to prioritize agreement with user preferences over principled reasoning, has been identified as a persistent alignment failure in English-language evaluations. However, it remains unclear whether…

机器学习 · 计算机科学 2026-02-03 Sarthak Sattigeri

Large language models exhibit sycophancy: the tendency to shift outputs toward user-expressed stances, regardless of correctness or consistency. While prior work has studied this issue and its impacts, rigorous computational linguistic…

计算与语言 · 计算机科学 2026-04-06 Joy Bhalla , Kristina Gligorić

Sycophancy refers to the tendency of a large language model to align its outputs with the user's perceived preferences, beliefs, or opinions, in order to look favorable, regardless of whether those statements are factually correct. This…

人工智能 · 计算机科学 2024-12-05 María Victoria Carro

Large language models (LLMs) often exhibit sycophantic behaviors -- such as excessive agreement with or flattery of the user -- but it is unclear whether these behaviors arise from a single mechanism or multiple distinct processes. We…

计算与语言 · 计算机科学 2026-03-24 Daniel Vennemeyer , Phan Anh Duong , Tiffany Zhan , Tianyu Jiang

Large language models are often described as sycophantic, in the sense that they appear to flatter users or mirror their beliefs. We argue that this label is conceptually misleading: sycophancy implies motives and strategic intent, which…

人工智能 · 计算机科学 2026-05-15 Federico Germani , Giovanni Spitale

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

人工智能 · 计算机科学 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

Large Language Models exhibit sycophancy: prioritizing agreeableness over correctness. Current remedies evaluate reasoning outcomes: RLHF rewards correct answers, self-correction critiques outputs. All require ground truth, which is often…

计算与语言 · 计算机科学 2026-01-09 Edward Y. Chang

Effective human-machine collaboration requires machine learning models to externalize uncertainty, so users can reflect and intervene when necessary. For language models, these representations of uncertainty may be impacted by sycophancy…

计算与语言 · 计算机科学 2024-10-22 Anthony Sicilia , Mert Inan , Malihe Alikhani

Large Language Models (LLMs) often exhibit sycophantic behavior, agreeing with user-stated opinions even when those contradict factual knowledge. While prior work has documented this tendency, the internal mechanisms that enable such…

计算与语言 · 计算机科学 2025-11-13 Keyu Wang , Jin Li , Shu Yang , Zhuoran Zhang , Di Wang

Sycophancy, the tendency of large language models to favour user-affirming responses over critical engagement, has been identified as an alignment failure, particularly in high-stakes advisory and social contexts. While prior work has…

人机交互 · 计算机科学 2026-04-29 Magda Dubois , Cozmin Ududec , Christopher Summerfield , Lennart Luettgau

Large Vision-Language Models (LVLMs) have shown significant capability in vision-language understanding. However, one critical issue that persists in these models is sycophancy, where models are unduly influenced by leading or deceptive…

人工智能 · 计算机科学 2025-10-24 Yunpu Zhao , Rui Zhang , Junbin Xiao , Changxin Ke , Ruibo Hou , Yifan Hao , Ling Li

Large Language Models (LLMs) are increasingly used in educational settings as interactive tools for collaboration. However, their tendency toward sycophancy, aligning with user beliefs even when incorrect, raises concerns for learning and…

人机交互 · 计算机科学 2026-05-22 Cansu Koyuturk , Sabrina Guidotti , Dimitri Ognibene

Large language models exhibit sycophancy, the tendency to shift their stated positions toward perceived user preferences or authority cues regardless of evidence. Standard alignment methods fail to correct this because scalar reward models…

人工智能 · 计算机科学 2026-04-08 Muhammad Ahmed Mohsin , Ahsan Bilal , Muhammad Umer , Emily Fox

This position paper argues that sycophancy in LLMs is a boundary failure between social alignment and epistemic integrity. Existing work often operationalizes sycophancy through external behavior such as agreement with incorrect user…

人工智能 · 计算机科学 2026-05-08 Jiechen Li , Catherine A. Barry , Rishika Randev , Janet Chen , Ella Jorgensen , Brinnae Bent

Large Language Models (LLMs) often exhibit sycophancy, distorting responses to align with user beliefs, notably by readily agreeing with user counterarguments. Paradoxically, LLMs are increasingly adopted as successful evaluative agents for…

计算与语言 · 计算机科学 2025-09-23 Sungwon Kim , Daniel Khashabi

The increasing integration of Large Language Models (LLMs) into decision-making frameworks has exposed significant vulnerabilities to social compliance, specifically sycophancy and conformity. However, a critical research gap exists…

计算机与社会 · 计算机科学 2026-01-21 Long Zhang , Wei-neng Chen
‹ 上一页 1 2 3 10 下一页 ›