English
Related papers

Related papers: Gaslight, Gatekeep, V1-V3: Early Visual Cortex Ali…

200 papers

Sycophancy, an excessive tendency of AI models to agree with user input at the expense of factual accuracy or in contradiction of visual evidence, poses a critical and underexplored challenge for multimodal large language models (MLLMs).…

Artificial Intelligence · Computer Science 2025-12-23 A. B. M. Ashikur Rahman , Saeed Anwar , Muhammad Usman , Irfan Ahmad , Ajmal Mian

Data visualizations are powerful tools for communicating patterns in quantitative data. Yet understanding any data visualization is no small feat -- succeeding requires jointly making sense of visual, numerical, and linguistic inputs…

Human-Computer Interaction · Computer Science 2025-05-26 Arnav Verma , Kushin Mukherjee , Christopher Potts , Elisa Kreiss , Judith E. Fan

Large language models internalize a structural trade-off between truthfulness and obsequious flattery, emerging from reward optimization that conflates helpfulness with polite submission. This latent bias, known as sycophancy, manifests as…

Computation and Language · Computer Science 2026-05-19 Sanskar Pandey , Ruhaan Chopra , Angkul Puniya , Sohom Pal

Vision Language Models (VLMs) have demonstrated strong capabilities in understanding visual content, yet their ability to predict where humans look on user interfaces remains unexplored. We present UIGaze, a study investigating how closely…

Human-Computer Interaction · Computer Science 2026-04-30 Min Song , Yoonseong Lee , Yeonhu Seo

Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs could greatly benefit the analysis of human gaze and attention, a central task in human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hengfei Wang , Anshul Gupta , Pierre Vuillecard , Jean-Marc Odobez

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

In cognitive science and AI, a longstanding question is whether machines learn representations that align with those of the human mind. While current models show promise, it remains an open question whether this alignment is superficial or…

Neurons and Cognition · Quantitative Biology 2025-10-27 Craig Sanders , Billy Dickson , Sahaj Singh Maini , Robert Nosofsky , Zoran Tiganj

While exploring visual scenes, humans' scanpaths are driven by their underlying attention processes. Understanding visual scanpaths is essential for various applications. Traditional scanpath models predict the where and when of gaze shifts…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Xianyu Chen , Ming Jiang , Qi Zhao

Are current Vision Language Models (VLMs) ready to comprehend and reason about complex embodied interactions in 3D environments? We introduce Embodied3DBench, a robot-centric benchmark targeting low-level spatial intelligence in embodied 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Jiyao Zhang , Mingxu Zhang , Yitong Peng , Haoxuan Liu , Chenshuo Wang , Yuxing Long , Haoyang Huang , Dongjiang Li , Nan Duan , Hui Shen , Hao Dong

Large language models exhibit sycophancy, the tendency to shift their stated positions toward perceived user preferences or authority cues regardless of evidence. Standard alignment methods fail to correct this because scalar reward models…

Artificial Intelligence · Computer Science 2026-04-08 Muhammad Ahmed Mohsin , Ahsan Bilal , Muhammad Umer , Emily Fox

Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy--conforming to user beliefs regardless of factual accuracy or ethical soundness. Prior research on sycophancy has…

Computation and Language · Computer Science 2026-03-02 Jiseung Hong , Grace Byun , Seungone Kim , Kai Shu , Jinho D. Choi

Vision-Language Models (VLMs) empower embodied agents to execute complex instructions, yet they remain vulnerable to contextual safety risks where benign commands become hazardous due to subtle environmental states. Existing safeguards…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaoya Lu , Yijin Zhou , Zeren Chen , Ruocheng Wang , Bingrui Sima , Enshen Zhou , Lu Sheng , Dongrui Liu , Jing Shao

Vision-Language Models (VLMs) excel at complex visual tasks such as VQA and chart understanding, yet recent work suggests they struggle with simple perceptual tests. We present an evaluation of vision-language models' capacity for nonlocal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Shmuel Berman , Jia Deng

With the rapid improvement of machine learning (ML) models, cognitive scientists are increasingly asking about their alignment with how humans think. Here, we ask this question for computer vision models and human sensitivity to geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zekun Wang , Sashank Varma

Where someone looks is a nonverbal communication cue that children and adults readily use. How well can Vision-Language Models (VLMs) infer gaze targets? To construct evaluation stimuli, we captured 1,360 real-world photos of scenes in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zory Zhang , Pinyuan Feng , Bingyang Wang , Tianwei Zhao , Suyang Yu , Qingying Gao , Hokin Deng , Ziqiao Ma , Yijiang Li , Dezhi Luo

Large Language Models (LLMs) increasingly prioritize user validation over epistemic accuracy - a phenomenon known as sycophancy. We present The Silicon Mirror, an orchestration framework that dynamically detects user persuasion tactics and…

Artificial Intelligence · Computer Science 2026-04-03 Harshee Jignesh Shah

Alignment faking (AF) refers to a model strategically complying with a training objective to avoid behavioural modification while preserving its deployment preferences. Understanding when and why AF arises matters as models grow better at…

Artificial Intelligence · Computer Science 2026-05-28 Nathaniel Mitrani Hadida , Rhea Karty , David Williams-King , Alan Cooney

Vision-language models (VLMs) have advanced rapidly in processing multimodal information, but their ability to reconcile conflicting signals across modalities remains underexplored. This work investigates how VLMs process ASCII art, a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zhaochen Wang , Bryan Hooi , Yiwei Wang , Ming-Hsuan Yang , Zi Huang , Yujun Cai

Recent generative models have largely closed the gap on low-level artifacts - pixel fingerprints, frequency anomalies, upsampling traces - particularly in person-centric and partial-edit settings where the manipulated region is small and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jihyeon Kim , Sohee Kim , Soosan Lee , Souhwan Jung , James Matthew Rehg , Hyesong Choi

2D assembly diagrams are often abstract and hard to follow, creating a need for intelligent assistants that can monitor progress, detect errors, and provide step-by-step guidance. In mixed reality settings, such systems must recognize…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Zhuchenyang Liu , Yao Zhang , Yu Xiao