中文
相关论文

相关论文: Auditing Stealth Sycophancy in Mental-Health Dialo…

200 篇论文

Rapid improvements in large language models have unveiled a critical challenge in human-AI interaction: sycophancy. In this context, sycophancy refers to the tendency of models to excessively agree with or flatter users, often at the…

计算与语言 · 计算机科学 2025-03-18 Joshua Liu , Aarav Jain , Soham Takuri , Srihan Vege , Aslihan Akalin , Kevin Zhu , Sean O'Brien , Vasu Sharma

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Recent Audio Multimodal Large Language Models (Audio MLLMs) demonstrate impressive performance on speech benchmarks, yet it remains unclear whether these models genuinely process acoustic signals or rely on text-based semantic inference. To…

人工智能 · 计算机科学 2026-03-23 Jiaqi Xiong , Yunjia Qi , Qi Cao , Yu Zheng , Yutong Zhang , Ziteng Wang , Ruofan Liao , Weisheng Xu , Sichen Liu

Despite growing attention to LLM sycophancy from researchers and developers, users' own experiences of this behavior remain underexplored. We examine how everyday users experience AI sycophancy through Reddit discussions. Using our ODR…

人机交互 · 计算机科学 2026-05-06 Kazi Noshin , Syed Ishtiaque Ahmed , Sharifa Sultana

Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy--conforming to user beliefs regardless of factual accuracy or ethical soundness. Prior research on sycophancy has…

计算与语言 · 计算机科学 2026-03-02 Jiseung Hong , Grace Byun , Seungone Kim , Kai Shu , Jinho D. Choi

Recent benchmarks for medical Large Vision-Language Models (LVLMs) emphasize leaderboard accuracy, overlooking reliability and safety. We study sycophancy -- models' tendency to uncritically echo user-provided information -- in high-stakes…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Botai Yuan , Yutian Zhou , Yingjie Wang , Fushuo Huo , Yongcheng Jing , Li Shen , Ying Wei , Zhiqi Shen , Ziwei Liu , Tianwei Zhang , Jie Yang , Dacheng Tao

Large Language Models (LLMs) increasingly prioritize user validation over epistemic accuracy - a phenomenon known as sycophancy. We present The Silicon Mirror, an orchestration framework that dynamically detects user persuasion tactics and…

人工智能 · 计算机科学 2026-04-03 Harshee Jignesh Shah

This paper audits benchmark evaluation in clinical-interview depression detection through four complementary probes across DAIC/E-DAIC, CMDC, ANDROIDS, MODMA, and PDCH. First, we re-evaluate E-DAIC under strict subject-disjoint…

计算与语言 · 计算机科学 2026-05-26 Takehiro Ishikawa , Jon Duke

Dialogue safety remains a pervasive challenge in open-domain human-machine interaction. Existing approaches propose distinctive dialogue safety taxonomies and datasets for detecting explicitly harmful responses. However, these taxonomies…

计算与语言 · 计算机科学 2023-08-01 Huachuan Qiu , Tong Zhao , Anqi Li , Shuai Zhang , Hongliang He , Zhenzhong Lan

With the increasing use of large language models (LLMs) in medical decision-support, it is essential to evaluate not only their final answers but also the reliability of their reasoning. Two key risks are Chain-of-Thought (CoT) faithfulness…

计算机视觉与模式识别 · 计算机科学 2025-08-25 Kaiyuan Ji , Yijin Guo , Zicheng Zhang , Xiangyang Zhu , Yuan Tian , Ning Liu , Guangtao Zhai

Audio Language Models (ALMs) have recently shown strong capabilities in unified reasoning over speech, sound, and natural language; yet they inherit behavioral issues observed in Large Language Models, including sycophancy--the tendency to…

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Measuring collaborative problem solving (CPS) synergy remains challenging in learning analytics, as classical manual coding cannot capture emergent system-level dynamics. This study introduces a computational framework that integrates…

计算机与社会 · 计算机科学 2026-04-28 Jianjun Xiao , Cixiao Wang , Wenmei Zhang

Mental-health support is increasingly mediated by conversational systems (e.g., LLM-based tools), but users often lack structured ways to audit the quality and potential risks of the support they receive. We introduce CounselReflect, an…

Demand for mental health support through AI chatbots is surging, though current systems present several limitations, like sycophancy or overvalidation, and reinforcement of maladaptive beliefs. A core obstacle to the creation of better…

计算与语言 · 计算机科学 2025-12-08 José Pombal , Maya D'Eon , Nuno M. Guerreiro , Pedro Henrique Martins , António Farinhas , Ricardo Rei

The increasing integration of Large Language Models (LLMs) into decision-making frameworks has exposed significant vulnerabilities to social compliance, specifically sycophancy and conformity. However, a critical research gap exists…

计算机与社会 · 计算机科学 2026-01-21 Long Zhang , Wei-neng Chen

Large language models (LLMs), while increasingly used in domains requiring factual rigor, often display a troubling behavior: sycophancy, the tendency to align with user beliefs regardless of correctness. This tendency is reinforced by…

计算与语言 · 计算机科学 2025-08-20 Kaiwei Zhang , Qi Jia , Zijian Chen , Wei Sun , Xiangyang Zhu , Chunyi Li , Dandan Zhu , Guangtao Zhai

Large language models are increasingly deployed to simulate patients for clinical training, research, and mental health tools, yet population-level validity remains largely untested. We introduce PsychBench, the first epidemiological audit…

计算机与社会 · 计算机科学 2026-04-21 Patrick Keough

We introduce AuditBench, an alignment auditing benchmark. AuditBench consists of 56 language models with implanted hidden behaviors. Each model has one of 14 concerning behaviors--such as sycophantic deference, opposition to AI regulation,…

计算与语言 · 计算机科学 2026-03-11 Abhay Sheshadri , Aidan Ewart , Kai Fronsdal , Isha Gupta , Samuel R. Bowman , Sara Price , Samuel Marks , Rowan Wang

We present an overview of PsyDefDetect, the shared task on detecting levels of psychological defense mechanisms in emotional support dialogues, co-located with BioNLP@ACL 2026. Grounded in the clinically validated Defense Mechanism Rating…

计算与语言 · 计算机科学 2026-05-26 Hongbin Na , Zimu Wang , Zhaoming Chen , Yining Hua , Rena Gao , Kailai Yang , Ling Chen , Wei Wang , Shaoxiong Ji , John Torous , Sophia Ananiadou
‹ 上一页 1 2 3 10 下一页 ›