中文
相关论文

相关论文: The Silicon Mirror: Dynamic Behavioral Gating for …

200 篇论文

Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy--conforming to user beliefs regardless of factual accuracy or ethical soundness. Prior research on sycophancy has…

计算与语言 · 计算机科学 2026-03-02 Jiseung Hong , Grace Byun , Seungone Kim , Kai Shu , Jinho D. Choi

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

人工智能 · 计算机科学 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

Large Language Models (LLMs) are increasingly used in educational settings as interactive tools for collaboration. However, their tendency toward sycophancy, aligning with user beliefs even when incorrect, raises concerns for learning and…

人机交互 · 计算机科学 2026-05-22 Cansu Koyuturk , Sabrina Guidotti , Dimitri Ognibene

Large Language Models (LLMs) often exhibit sycophancy, distorting responses to align with user beliefs, notably by readily agreeing with user counterarguments. Paradoxically, LLMs are increasingly adopted as successful evaluative agents for…

计算与语言 · 计算机科学 2025-09-23 Sungwon Kim , Daniel Khashabi

Large language models (LLMs) are increasingly applied in educational, clinical, and professional settings, but their tendency for sycophancy -- prioritizing user agreement over independent reasoning -- poses risks to reliability. This study…

人工智能 · 计算机科学 2025-09-22 Aaron Fanous , Jacob Goldberg , Ank A. Agarwal , Joanna Lin , Anson Zhou , Roxana Daneshjou , Sanmi Koyejo

LLM-powered conversational agents are increasingly influencing our decision-making, raising concerns about "sycophancy" - the tendency for LLMs to excessively agree with users even at the expense of truthfulness. While prior work has…

人机交互 · 计算机科学 2026-02-03 Yuan Sun , Ting Wang

We investigate how peer pressure influences the opinions of Large Language Model (LLM) agents across a spectrum of cognitive commitments by embedding them in social networks where they update opinions based on peer perspectives. Our…

计算机与社会 · 计算机科学 2025-10-23 Aliakbar Mehdizadeh , Martin Hilbert

Large language models (LLMs) can fluently generate student-like responses, making them attractive as simulated students for training and evaluating AI tutors and human educators. Yet such simulators are typically evaluated by output…

计算与语言 · 计算机科学 2026-05-14 Heejin Do , Shashank Sonkar , Mrinmaya Sachan

Large language models (LLMs) have achieved strong performance across a wide range of tasks, but they are also prone to sycophancy, the tendency to agree with user statements regardless of validity. Previous research has outlined both the…

计算与语言 · 计算机科学 2026-03-31 Bayan Abdullah Aldahlawi , A. B. M. Ashikur Rahman , Irfan Ahmad

Large language models (LLMs), while increasingly used in domains requiring factual rigor, often display a troubling behavior: sycophancy, the tendency to align with user beliefs regardless of correctness. This tendency is reinforced by…

计算与语言 · 计算机科学 2025-08-20 Kaiwei Zhang , Qi Jia , Zijian Chen , Wei Sun , Xiangyang Zhu , Chunyi Li , Dandan Zhu , Guangtao Zhai

Given the increased use of LLMs in financial systems today, it becomes important to evaluate the safety and robustness of such systems. One failure mode that LLMs frequently display in general domain settings is that of sycophancy. That is,…

人工智能 · 计算机科学 2026-04-30 Zhenyu Zhao , Aparna Balagopalan , Adi Agrawal , Dilshoda Yergasheva , Waseem Alshikh , Daniel M. Bikel

Telling an LLM to "be enthusiastic" raises its sycophancy rate from 30\% to 50\% on a lightly-aligned model, but has zero effect on a strongly-aligned one. We define this gap as the alignment floor,…

人机交互 · 计算机科学 2026-05-29 Xing Zhang , Guanghui Wang , Yanwei Cui , Wei Qiu , Ziyuan Li , Bing Zhu , Peiyang He

As LLMs expand from assistance to decision support, a dangerous pattern emerges: fluent agreement without calibrated judgment. Low-friction assistants can become sycophantic, baking in implicit assumptions and pushing verification costs…

计算与语言 · 计算机科学 2026-03-26 Raunak Jain

Large language models internalize a structural trade-off between truthfulness and obsequious flattery, emerging from reward optimization that conflates helpfulness with polite submission. This latent bias, known as sycophancy, manifests as…

计算与语言 · 计算机科学 2026-05-19 Sanskar Pandey , Ruhaan Chopra , Angkul Puniya , Sohom Pal

Large Language Models (LLMs) are rapidly transitioning from conversational assistants to autonomous agents embedded in critical organizational functions, including Security Operations Centers (SOCs), financial systems, and infrastructure…

密码学与安全 · 计算机科学 2026-01-06 Giuseppe Canale , Kashyap Thimmaraju

Multi-agent debate (MAD) aims to improve large language model (LLM) reasoning by letting multiple agents exchange answers and then aggregate their opinions. Yet recent studies reveal that agents are not neutral: they are prone to…

人工智能 · 计算机科学 2026-04-13 Hyeong Kyu Choi , Xiaojin Zhu , Sharon Li

Sycophancy, an excessive tendency of AI models to agree with user input at the expense of factual accuracy or in contradiction of visual evidence, poses a critical and underexplored challenge for multimodal large language models (MLLMs).…

人工智能 · 计算机科学 2025-12-23 A. B. M. Ashikur Rahman , Saeed Anwar , Muhammad Usman , Irfan Ahmad , Ajmal Mian

Large Vision-Language Models (LVLMs) have shown significant capability in vision-language understanding. However, one critical issue that persists in these models is sycophancy, where models are unduly influenced by leading or deceptive…

人工智能 · 计算机科学 2025-10-24 Yunpu Zhao , Rui Zhang , Junbin Xiao , Changxin Ke , Ruibo Hou , Yifan Hao , Ling Li

Large language models (LLMs) often exhibit sycophancy: agreement with user stance even when it conflicts with the model's opinion. While prior work has mostly studied this in single-agent settings, it remains underexplored in collaborative…

Sycophancy, the tendency of large language models to favour user-affirming responses over critical engagement, has been identified as an alignment failure, particularly in high-stakes advisory and social contexts. While prior work has…

人机交互 · 计算机科学 2026-04-29 Magda Dubois , Cozmin Ududec , Christopher Summerfield , Lennart Luettgau
‹ 上一页 1 2 3 10 下一页 ›