English
Related papers

Related papers: EgoNormia: Benchmarking Physical Social Norm Under…

200 papers

Video-LLMs face a fundamental tension in long-video reasoning: static, sparse frame sampling either dilutes evidence across task-irrelevant segments at significant cost or misses fine-grained temporal semantics altogether. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zheyu Fan , Jiateng Liu , Yuji Zhang , Zihan Wang , Yi R. Fung , Manling Li , Heng Ji

Generating long, coherent egocentric videos is difficult, as hand-object interactions and procedural tasks require reliable long-term memory. Existing autoregressive models suffer from content drift, where object identity and scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Liuzhou Zhang , Jiarui Ye , Yuanlei Wang , Ming Zhong , Mingju Cao , Wanke Xia , Bowen Zeng , Zeyu Zhang , Hao Tang

Reasoning VLMs can become more accurate while progressively losing visual grounding as they think. This creates task-conditional danger zones where low-entropy predictions are confident but ungrounded, a failure mode text-only monitoring…

Artificial Intelligence · Computer Science 2026-04-07 Suresh Raghu , Satwik Pandey

Large vision language models (VLMs) have demonstrated significant potential for integration into daily life, making it crucial for them to incorporate human values when making decisions in real-world situations. This paper introduces VIVA,…

Computation and Language · Computer Science 2024-10-11 Zhe Hu , Yixiao Ren , Jing Li , Yu Yin

As AR/VR technologies become integral to daily life, there's a growing need for AI that understands human social dynamics from an egocentric perspective. However, current LLMs often lack the social awareness to discern when to intervene as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xijun Wang , Tanay Sharma , Achin Kulshrestha , Abhimitra Meka , Aveek Purohit , Dinesh Manocha

Despite rapid advances in vision-language models (VLMs), current benchmarks for multimodal reasoning fall short in three key dimensions. First, they overwhelmingly rely on static images, failing to capture the temporal complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zikui Cai , Andrew Wang , Anirudh Satheesh , Ankit Nakhawa , Hyunwoo Jae , Keenan Powell , Minghui Liu , Neel Jay , Sungbin Oh , Xiyao Wang , Yongyuan Liang , Tom Goldstein , Furong Huang

Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across various tasks, existing benchmarks lack comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Fengji Zhang , Linquan Wu , Huiyu Bai , Guancheng Lin , Xiao Li , Xiao Yu , Yue Wang , Bei Chen , Jacky Keung

The advent of multi-modal large language models (MLLMs) has greatly advanced research on video fake news detection (VFND) tasks. Existing benchmarks typically focus on the detection accuracy, while failing to provide fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Cui Yakun , Peng Qi , Fushuo Huo , Hang Du , Weijie Shi , Juntao Dai , Zhenghao Zhu , Sirui Han , Yike Guo

Recently, Multimodal Large Language Models (MLLMs) have achieved exceptional performance across diverse tasks, continually surpassing previous expectations regarding their capabilities. Nevertheless, their proficiency in perceiving emotions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Daiqing Wu , Dongbao Yang , Sicheng Zhao , Can Ma , Yu Zhou

The advent of Multimodal Large Language Models (MLLMs) has expanded AI capabilities to visual modalities, yet existing evaluation benchmarks remain limited to single-video understanding, overlooking the critical need for multi-video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Tianhao Peng , Haochen Wang , Yuanxing Zhang , Zekun Wang , Zili Wang , Gavin Chang , Jian Yang , Shihao Li , Yanghai Wang , Xintao Wang , Houyi Li , Wei Ji , Pengfei Wan , Steven Huang , Zhaoxiang Zhang , Jiaheng Liu

Understanding freely moving animal behavior is central to neuroscience, where pose estimation and behavioral understanding form the foundation for linking neural activity to natural actions. Yet both tasks still depend heavily on human…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jingyang Ke , Weihan Li , Amartya Pradhan , Jeffrey Markowitz , Anqi Wu

As AI-powered compliance monitoring becomes increasingly important in public governance and industrial safety, the ability to provide verifiable evidence and traceable accountability signals is essential. However, existing video anomaly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruihao Xu , Xingming Shui , Jingxuan Niu , Yiqin Wang , Jilin Yu , Haoji Zhang , Yansong Tang

Multimodal Large Language Models (MLLMs) are increasingly deployed in human-facing roles where personality perception is critical, yet existing benchmarks evaluate this capability solely on numerical Big Five score prediction, leaving open…

Artificial Intelligence · Computer Science 2026-05-22 Caixin Kang , Tianyu Yan , Sitong Gong , Mingfang Zhang , Liangyang Ouyang , Ruicong Liu , Bo Zheng , Huchuan Lu , Kaipeng Zhang , Yoichi Sato , Yifei Huang

We present a scalable, bottom-up and intrinsically diverse data collection scheme that can be used for high-level reasoning with long and medium horizons and that has 2.2x higher throughput compared to traditional narrow top-down…

Egocentric video understanding is inherently complex due to the dynamic 4D nature of the environment, where camera motion and object displacements necessitate a continuous re-evaluation of spatial relations. In this work, we target a suite…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Fangrui Zhu , Yunfeng Xi , Jianmo Ni , Mu Cai , Boqing Gong , Long Zhao , Chen Qu , Ian Miao , Yi Li , Cheng Zhong , Huaizu Jiang , Shwetak Patel

Visual Language Models (VLMs) show remarkable performance in visual reasoning tasks, successfully tackling college-level challenges that require high-level understanding of images. However, some recent reports of VLMs struggling to reason…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Gene Tangtartharakul , Katherine R. Storrs

Vision-Language Models (VLMs) empower embodied agents to execute complex instructions, yet they remain vulnerable to contextual safety risks where benign commands become hazardous due to subtle environmental states. Existing safeguards…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaoya Lu , Yijin Zhou , Zeren Chen , Ruocheng Wang , Bingrui Sima , Enshen Zhou , Lu Sheng , Dongrui Liu , Jing Shao

This paper investigates visual analogical reasoning in large multimodal models (LMMs) compared to human adults and children. A "visual analogy" is an abstract rule inferred from one image and applied to another. While benchmarks exist for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Eunice Yiu , Maan Qraitem , Anisa Noor Majhi , Charlie Wong , Yutong Bai , Shiry Ginosar , Alison Gopnik , Kate Saenko

Human reasoning can be understood as a cooperation between the intuitive, associative "System-1" and the deliberative, logical "System-2". For existing System-1-like methods in visual activity understanding, it is crucial to integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoqian Wu , Yong-Lu Li , Jianhua Sun , Cewu Lu

Understanding social interactions requires reasoning over subtle non-verbal cues, yet current multimodal large language models (MLLMs) often fail to identify who interacts with whom in multi-person videos. We introduce GRASP, a large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Junho Kim , Xu Cao , Houze Yang , Bikram Boote , Ana Jojic , Fiona Ryan , Bolin Lai , Sangmin Lee , James M. Rehg