English
Related papers

Related papers: HumanVBench: Probing Human-Centric Video Understan…

200 papers

Generative diffusion models are developing rapidly and attracting increasing attention due to their wide range of applications. Image-to-Video (I2V) generation has become a major focus in the field of video synthesis. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ailing Zhang , Lina Lei , Dehong Kong , Zhixin Wang , Jiaqi Xu , Fenglong Song , Chun-Le Guo , Chang Liu , Fan Li , Jie Chen

Understanding of video creativity and content often varies among individuals, with differences in focal points and cognitive levels across different ages, experiences, and genders. There is currently a lack of research in this area, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Minghui Wu , Chenxu Zhao , Anyang Su , Donglin Di , Tianyu Fu , Da An , Min He , Ya Gao , Meng Ma , Kun Yan , Ping Wang

Cross-Video Reasoning (CVR) presents a significant challenge in video understanding, which requires simultaneous understanding of multiple videos to aggregate and compare information across groups of videos. Most existing video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jingyao Li , Jingyun Wang , Molin Tan , Haochen Wang , Cilin Yan , Likun Shi , Jiayin Cai , Xiaolong Jiang , Yao Hu

The sequential structure of videos poses a challenge to the ability of multimodal large language models (MLLMs) to locate multi-frame evidence and conduct multimodal reasoning. However, existing video benchmarks mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Kejian Zhu , Zhuoran Jin , Hongbang Yuan , Jiachun Li , Shangqing Tu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

The evaluation of Long Video Understanding (LVU) performance poses an important but challenging research problem. Despite previous efforts, the existing video understanding benchmarks are severely constrained by several issues, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Junjie Zhou , Yan Shu , Bo Zhao , Boya Wu , Zhengyang Liang , Shitao Xiao , Minghao Qin , Xi Yang , Yongping Xiong , Bo Zhang , Tiejun Huang , Zheng Liu

Multimodal Large Language Models (MLLMs) hold promise for accelerating scientific discovery by interpreting complex experimental procedures. However, their true capabilities are poorly understood, as existing benchmarks neglect the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yicheng Xu , Yue Wu , Jiashuo Yu , Ziang Yan , Tianxiang Jiang , Yinan He , Qingsong Zhao , Kai Chen , Yu Qiao , Limin Wang , Manabu Okumura , Yi Wang

Large language models have demonstrated impressive performance when integrated with vision models even enabling video understanding. However, evaluating video models presents its own unique challenges, for which several benchmarks have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Daniel Cores , Michael Dorkenwald , Manuel Mucientes , Cees G. M. Snoek , Yuki M. Asano

Current video benchmarks for multimodal large language models (MLLMs) focus on event recognition, temporal ordering, and long-context recall, but overlook a harder capability required for expert procedural judgment: tracking how ongoing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xiyang Huang , Jiawei Lin , Keying Wu , Jiaxin Huang , Kailai Yang , Renxiong Wei , Cheng zeng , Jiayi Xiang , Ziyan Kuang , Min Peng , Qianqian Xie , Sophia Ananiadou

Multimodal Large Language Models (MLLMs) have shown significant potential in medical image analysis. However, their capabilities in interpreting fundus images, a critical skill for ophthalmology, remain under-evaluated. Existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Qijie Wei , Kaiheng Qian , Xirong Li

Multimodal Large Language Models (MLLMs) have made significant strides in natural images and satellite remote sensing images. However, understanding low-altitude drone scenarios remains a challenge. Existing datasets primarily focus on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yang Zhan , Yuan Yuan

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Multimodal Language Language Models (MLLMs) demonstrate the emerging abilities of "world models" -- interpreting and reasoning about complex real-world dynamics. To assess these abilities, we posit videos are the ideal medium, as they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xuehai He , Weixi Feng , Kaizhi Zheng , Yujie Lu , Wanrong Zhu , Jiachen Li , Yue Fan , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Kevin Lin , William Yang Wang , Lijuan Wang , Xin Eric Wang

The goal of achieving Artificial General Intelligence (AGI) is to imitate humans and surpass them. Models such as OpenAI's o1, o3, and DeepSeek's R1 have demonstrated that large language models (LLMs) with human-like reasoning capabilities…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yansheng Qiu , Li Xiao , Zhaopan Xu , Pengfei Zhou , Zheng Wang , Kaipeng Zhang

Building robots that can perceive, reason, and act in dynamic, unstructured environments remains a core challenge. Recent embodied systems often adopt a dual-system paradigm, where System 2 handles high-level reasoning while System 1…

While Multimodal Large Language Models (MLLMs) have exhibited remarkable general intelligence across diverse domains, their potential in low-altitude applications dominated by Unmanned Aerial Vehicles (UAVs) remains largely underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shiqi Dai , Zizhi Ma , Zhicong Luo , Xuesong Yang , Yibin Huang , Wanyue Zhang , Chi Chen , Zonghao Guo , Wang Xu , Yufei Sun , Maosong Sun

Long video summarization presents significant challenges for current multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and producing summaries that are both semantically and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Alkesh Patel , Melis Ozyildirim , Ying-Chang Cheng , Ganesh Nagarajan

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

Previous multilingual benchmarks focus primarily on simple understanding tasks, but for large language models(LLMs), we emphasize proficiency in instruction following, reasoning, long context understanding, code generation, and so on.…

Computation and Language · Computer Science 2025-04-22 Xu Huang , Wenhao Zhu , Hanxu Hu , Conghui He , Lei Li , Shujian Huang , Fei Yuan

The rapid advancement of large vision-language models (LVLMs) has significantly propelled applications in document understanding, particularly in optical character recognition (OCR) and multilingual translation. However, current evaluations…

Machine Learning · Computer Science 2025-05-20 Zhanglin Wu , Tengfei Song , Ning Xie , Mengli Zhu , Weidong Zhang , Shuang Wu , Pengfei Li , Chong Li , Junhao Zhu , Hao Yang , Shiliang Sun

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in various tasks. However, effectively evaluating these MLLMs on face perception remains largely unexplored. To address this gap, we introduce FaceBench, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Xiaoqin Wang , Xusen Ma , Xianxu Hou , Meidan Ding , Yudong Li , Junliang Chen , Wenting Chen , Xiaoyang Peng , Linlin Shen
‹ Prev 1 8 9 10 Next ›