English
Related papers

Related papers: SOK-Bench: A Situated Video Reasoning Benchmark wi…

200 papers

Reasoning is central to a wide range of intellectual activities, and while the capabilities of large language models (LLMs) continue to advance, their performance in reasoning tasks remains limited. The processes and mechanisms underlying…

Artificial Intelligence · Computer Science 2024-10-07 Ippei Fujisawa , Sensho Nobe , Hiroki Seto , Rina Onda , Yoshiaki Uchida , Hiroki Ikoma , Pei-Chun Chien , Ryota Kanai

With the rapid progress of Multimodal LLMs, evaluating their mathematical reasoning capabilities has become an increasingly important research direction. In particular, visual-textual mathematical reasoning serves as a key indicator of an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hao Liang , Linzhuang Sun , Minxuan Zhou , Zirong Chen , Meiyi Qiang , Mingan Lin , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

Recent progress in text-to-video (T2V) generation has enabled the synthesis of visually compelling and temporally coherent videos from natural language. However, these models often fall short in basic physical commonsense, producing outputs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Enes Sanli , Baris Sarper Tezcan , Aykut Erdem , Erkut Erdem

We present VRBench, the first long narrative video benchmark crafted for evaluating large models' multi-step reasoning capabilities, addressing limitations in existing evaluations that overlook temporal reasoning and procedural validity. It…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiashuo Yu , Yue Wu , Meng Chu , Zhifei Ren , Zizheng Huang , Pei Chu , Ruijie Zhang , Yinan He , Qirui Li , Songze Li , Zhenxiang Li , Zhongying Tu , Conghui He , Yu Qiao , Yali Wang , Yi Wang , Limin Wang

Various human activities can be abstracted into a sequence of actions in natural text, i.e. cooking, repairing, manufacturing, etc. Such action sequences heavily depend on the executing order, while disorder in action sequences leads to…

Computation and Language · Computer Science 2023-06-08 Weizhi Wang , Hong Wang , Xifeng Yan

Estimating task progress requires reasoning over long-horizon dynamics rather than recognizing static visual content. While modern Vision-Language Models (VLMs) excel at describing what is visible, it remains unclear whether they can infer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Jianshu Zhang , Chengxuan Qian , Haosen Sun , Haoran Lu , Dingcheng Wang , Letian Xue , Han Liu

Explainable AI (XAI) has gained significant attention for providing insights into the decision-making processes of deep learning models, particularly for image classification tasks through visual explanations visualized by saliency maps.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifei Zhang , James Song , Siyi Gu , Tianxu Jiang , Bo Pan , Guangji Bai , Liang Zhao

Recent studies have raised significant concerns regarding the reliability of current mathematics benchmarks, highlighting issues such as simplistic design and potential data contamination. Consequently, developing a reliable benchmark that…

Computation and Language · Computer Science 2025-08-14 Zijin Hong , Hao Wu , Su Dong , Junnan Dong , Yilin Xiao , Yujing Zhang , Zhu Wang , Feiran Huang , Linyi Li , Hongxia Yang , Xiao Huang

The ability to distinguish subtle differences between visually similar images is essential for diverse domains such as industrial anomaly detection, medical imaging, and aerial surveillance. While comparative reasoning benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minkyu Kim , Sangheon Lee , Dongmin Park

Despite recent advances in video understanding, the capabilities of Large Video Language Models (LVLMs) to perform video-based causal reasoning remains underexplored, largely due to the absence of relevant and dedicated benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Pritam Sarkar , Ali Etemad

Recent advances in Video Large Language Models (Video-LLMs) have demonstrated their great potential in general-purpose video understanding. To verify the significance of these models, a number of benchmarks have been proposed to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ye Liu , Zongyang Ma , Zhongang Qi , Yang Wu , Ying Shan , Chang Wen Chen

Lightweight vision-language models perform competitively on standard benchmarks yet fail systematically in dense-scene reasoning, where multiple objects, attributes, and relations must be jointly grounded and resolved through multi-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xinrui Shi , Kai Liu , Ziqing Zhang , Jianze Li , Anqi Li , Yulun Zhang

Video-based numerical reasoning provides a premier arena for testing whether Vision-Language Models (VLMs) truly "understand" real-world dynamics, as accurate numerical deduction necessitates a profound grasp of temporal events, object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Shaoyang Cui , Lingbei Meng

Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiangyu Zhao , Peiyuan Zhang , Kexian Tang , Xiaorong Zhu , Hao Li , Wenhao Chai , Zicheng Zhang , Renqiu Xia , Guangtao Zhai , Junchi Yan , Hua Yang , Xue Yang , Haodong Duan

Understanding mid-level road semantics, which capture the structural and contextual cues that link low-level perception to high-level planning, is essential for reliable autonomous driving and digital map construction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiyan Liu , Han Wang , Yuhu Wang , Junjie Cai , Zhe Cao , Jianzhong Yang , Zhen Lu

Most existing video understanding benchmarks for multimodal large language models (MLLMs) focus only on short videos. The limited number of benchmarks for long video understanding often rely solely on multiple-choice questions (MCQs).…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Guo Chen , Yicheng Liu , Yifei Huang , Yuping He , Baoqi Pei , Jilan Xu , Yali Wang , Tong Lu , Limin Wang

Vision-Language Models (VLMs), exemplified by CLIP, have emerged as foundational for multimodal intelligence. However, their capacity for logical understanding remains significantly underexplored, resulting in critical ''logical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yuchen Zhou , Jiayu Tang , Shuo Yang , Xiaoyan Xiao , Yuqin Dai , Wenhao Yang , Chao Gou , Xiaobo Xia , Tat-Seng Chua

Emotions conveyed through voice and face shape engagement and context in human AI interaction. Despite rapid progress in omni modal large language models, the holistic evaluation of emotional reasoning with audiovisual cues remains limited.…

Understanding causal relationships across modalities is a core challenge for multimodal models operating in real-world environments. We introduce ISO-Bench, a benchmark for evaluating whether models can infer causal dependencies between…

Computation and Language · Computer Science 2025-08-01 Ananya Sadana , Yash Kumar Lal , Jiawei Zhou

Large Vision-Language Models (LVLMs) have made significant strides in the field of video understanding in recent times. Nevertheless, existing video benchmarks predominantly rely on text prompts for evaluation, which often require complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yiming Zhao , Yu Zeng , Yukun Qi , YaoYang Liu , Xikun Bao , Lin Chen , Zehui Chen , Qing Miao , Chenxi Liu , Jie Zhao , Feng Zhao