English
Related papers

Related papers: FoodMonitor: Benchmarking MLLMs for Explainable Co…

200 papers

Recent advances in video generation have enabled the synthesis of videos with strong temporal consistency and impressive visual quality, marking a crucial step toward vision foundation models. To evaluate these video generation models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Xuming He , Zehao Fan , Hengjia Li , Fan Zhuo , Hankun Xu , Senlin Cheng , Di Weng , Haifeng Liu , Can Ye , Boxi Wu

Most existing video understanding benchmarks for multimodal large language models (MLLMs) focus only on short videos. The limited number of benchmarks for long video understanding often rely solely on multiple-choice questions (MCQs).…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Guo Chen , Yicheng Liu , Yifei Huang , Yuping He , Baoqi Pei , Jilan Xu , Yali Wang , Tong Lu , Limin Wang

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in image understanding and generation. However, current benchmarks fail to accurately evaluate the chart comprehension of MLLMs due to limited chart types and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zhengzhuo Xu , Sinan Du , Yiyan Qi , Chengjin Xu , Chun Yuan , Jian Guo

Anomalous event detection in surveillance videos is a challenging and practical research problem among image and video processing community. Compared to the frame-level annotations of anomalous events, obtaining video-level annotations is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Muhammad Zaigham Zaheer , Arif Mahmood , Hochul Shin , Seung-Ik Lee

Real-world long video understanding requires models to perform continuous tracking, information integration and memory retention over massive temporal spans within extreme video durations. Mastering this intense cognitive load constitutes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Haichen He , Jiayi Zhou , Sifeng Shang , Yihan Hu , Yuanhan Zhang , Kaiyang Zhou

Recent advancements in Document Layout Analysis through Large Language Models and Multimodal Models have significantly improved layout detection. However, despite these improvements, challenges remain in addressing critical structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Inbum Heo , Taewook Hwang , Jeesu Jung , Sangkeun Jung

With the rising interest in research on Large Multi-modal Models (LMMs) for video understanding, many studies have emphasized general video comprehension capabilities, neglecting the systematic exploration into video quality understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zicheng Zhang , Ziheng Jia , Haoning Wu , Chunyi Li , Zijian Chen , Yingjie Zhou , Wei Sun , Xiaohong Liu , Xiongkuo Min , Weisi Lin , Guangtao Zhai

Anomaly detection in cloud environments remains both critical and challenging. Existing context-level benchmarks typically focus on either metrics or logs and often lack reliable annotation, while most detection methods emphasize point…

Artificial Intelligence · Computer Science 2025-10-07 Xinkai Zou , Xuan Jiang , Ruikai Huang , Haoze He , Parv Kapoor , Hongrui Wu , Yibo Wang , Jian Sha , Xiongbo Shi , Zixun Huang , Jinhua Zhao

We introduce the Lecture Video Visual Objects (LVVO) dataset, a new benchmark for visual object detection in educational video content. The dataset consists of 4,000 frames extracted from 245 lecture videos spanning biology, computer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Dipayan Biswas , Shishir Shah , Jaspal Subhlok

While aggregate leaderboard scores drive AI development, they contain substantial measurement noise whose sources and magnitudes remain unquantified, making it unclear when rankings reflect genuine capability differences versus evaluation…

Artificial Intelligence · Computer Science 2026-05-26 Michael Hardy , Anka Reuel , Lijin Zhang , Jodi M. Casabianca , Sang Truong , Yash Dave , Hansol Lee , Benjamin Domingue , Sanmi Koyejo

Real-world surveillance often renders faces and license plates unrecognizable in individual low-resolution (LR) frames, hindering reliable identification. To advance temporal recognition models, we present FANVID, a novel video-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Kavitha Viswanathan , Vrinda Goel , Shlesh Gholap , Devayan Ghosh , Madhav Gupta , Dhruvi Ganatra , Sanket Potdar , Amit Sethi

In this work, we introduce SPLICE, a human-curated benchmark derived from the COIN instructional video dataset, designed to probe event-based reasoning across multiple dimensions: temporal, causal, spatial, contextual, and general…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mohamad Ballout , Okajevo Wilfred , Seyedalireza Yaghoubi , Nohayr Muhammad Abdelmoneim , Julius Mayer , Elia Bruni

Recent advancements in video-based large language models (Video LLMs) have witnessed the emergence of diverse capabilities to reason and interpret dynamic visual content. Among them, gameplay videos stand out as a distinctive data source,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Meng Cao , Haoran Tang , Haoze Zhao , Hangyu Guo , Jiaheng Liu , Ge Zhang , Ruyang Liu , Qiang Sun , Ian Reid , Xiaodan Liang

The increasing deployment of Large Vision-Language Models (LVLMs) raises safety concerns under potential malicious inputs. However, existing multimodal safety evaluations primarily focus on model vulnerabilities exposed by static image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Xuannan Liu , Zekun Li , Zheqi He , Peipei Li , Shuhan Xia , Xing Cui , Huaibo Huang , Xi Yang , Ran He

Industrial anomaly detection is critical for manufacturing quality control, yet existing datasets mainly focus on static images or sparse views, which do not fully reflect continuous inspection processes in real industrial scenarios. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xiran Zhao , Jing Jin , Yan Bai , Zhongan Wang , Yifeng Sun , Yihang Lou , Xuanyu Zhu , Tao Feng , Yingna Wu

Online marketing faces formidable challenges in managing and interpreting immense volumes of data necessary for competitor analysis, content research, and strategic branding. It is impossible to review hundreds to thousands of transient…

Computers and Society · Computer Science 2024-12-11 Aleksandr Farseev , Qi Yang , Marlo Ongpin , Ilia Gossoudarev , Yu-Yi Chu-Farseeva , Sergey Nikolenko

The rise of Omni-modal Large Language Models (OLLMs), which integrate visual and auditory processing with text, necessitates robust safety evaluations to mitigate harmful outputs. However, no dedicated benchmarks currently exist for OLLMs,…

Computation and Language · Computer Science 2025-09-30 Leyi Pan , Zheyu Fu , Yunpeng Zhai , Shuchang Tao , Sheng Guan , Shiyu Huang , Lingzhe Zhang , Zhaoyang Liu , Bolin Ding , Felix Henry , Aiwei Liu , Lijie Wen

Recent advances in Video Large Language Models (Video-LLMs) have demonstrated their great potential in general-purpose video understanding. To verify the significance of these models, a number of benchmarks have been proposed to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ye Liu , Zongyang Ma , Zhongang Qi , Yang Wu , Ying Shan , Chang Wen Chen

Video-based large language models (Video-LLMs) have been recently introduced, targeting both fundamental improvements in perception and comprehension, and a diverse range of user inquiries. In pursuit of the ultimate goal of achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Munan Ning , Bin Zhu , Yujia Xie , Bin Lin , Jiaxi Cui , Lu Yuan , Dongdong Chen , Li Yuan

With the rapid advancement of generative AI, synthetic content across images, videos, and audio has become increasingly realistic, amplifying the risk of misinformation. Existing detection approaches predominantly focus on binary…

Machine Learning · Computer Science 2025-07-23 Xu Yang , Qi Zhang , Shuming Jiang , Yaowen Xu , Zhaofan Zou , Hao Sun , Xuelong Li