English
Related papers

Related papers: PAI-Bench: A Comprehensive Benchmark For Physical …

200 papers

With the rising interest in research on Large Multi-modal Models (LMMs) for video understanding, many studies have emphasized general video comprehension capabilities, neglecting the systematic exploration into video quality understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zicheng Zhang , Ziheng Jia , Haoning Wu , Chunyi Li , Zijian Chen , Yingjie Zhou , Wei Sun , Xiaohong Liu , Xiongkuo Min , Weisi Lin , Guangtao Zhai

The use of Multimodal Large Language Models (MLLMs) as an end-to-end solution for Embodied AI and Autonomous Driving has become a prevailing trend. While MLLMs have been extensively studied for visual semantic understanding tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yun Li , Yiming Zhang , Tao Lin , Xiangrui Liu , Wenxiao Cai , Zheng Liu , Bo Zhao

Vision-language models have shown impressive progress in recent years. However, existing models are largely limited to turn-based interactions, where each turn must be stepped (i.e., prompted) by the user. Open-ended, asynchronous…

Understanding long-form videos, such as movies and TV episodes ranging from tens of minutes to two hours, remains a significant challenge for multi-modal models. Existing benchmarks often fail to test the full range of cognitive skills…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kirolos Ataallah , Eslam Abdelrahman , Mahmoud Ahmed , Chenhui Gou , Khushbu Pahwa , Jian Ding , Mohamed Elhoseiny

The powerful reasoning of modern Vision Language Models open a new frontier for advanced personalization study. However, progress in this area is critically hampered by the lack of suitable benchmarks. To address this gap, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xia Hu , Honglei Zhuang , Brian Potetz , Alireza Fathi , Bo Hu , Babak Samari , Howard Zhou

Advances in generative AI point towards a new era of personalized applications that perform diverse tasks on behalf of users. While general AI assistants have yet to fully emerge, their potential to share personal data raises significant…

Artificial Intelligence · Computer Science 2024-09-24 Zhao Cheng , Diane Wan , Matthew Abueg , Sahra Ghalebikesabi , Ren Yi , Eugene Bagdasarian , Borja Balle , Stefan Mellem , Shawn O'Banion

Rapid advances in multimodal models demand benchmarks that rigorously evaluate understanding and reasoning in safety-critical, dynamic real-world settings. We present AccidentBench, a large-scale benchmark that combines vehicle accident…

Recent advancements in artificial intelligence have sparked interest in scientific assistants that could support researchers across the full spectrum of scientific workflows, from literature review to experimental design and data analysis.…

In the rapidly evolving field of artificial intelligence (AI), traditional benchmarks can fall short in attempting to capture the nuanced capabilities of AI models. We focus on the case of physical world modeling and propose a novel…

Artificial Intelligence · Computer Science 2025-09-08 Sasha Mitts

Modern science emerged from reasoning over repeatedly-observed planetary motions. We present Gravity-Bench-v1, an environment-based benchmark that challenges AI agents on tasks that parallel this historical development. Gravity-Bench-v1…

Artificial Intelligence · Computer Science 2025-05-30 Nolan Koblischke , Hyunseok Jang , Kristen Menou , Mohamad Ali-Dib

The emergence of Large Vision-Language Models (LVLMs) has significantly advanced video understanding capabilities. However, existing benchmarks focus predominantly on coarse-grained tasks such as action segmentation, classification,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Aditya Chetan , Eric Cai , Peeyush Kushwaha , Bharath Raj Nagoor Kani , Utkarsh Mall , Qianqian Wang , Noah Snavely , Bharath Hariharan

In recent years, vision language models (VLMs) have made significant advancements in video understanding. However, a crucial capability - fine-grained motion comprehension - remains under-explored in current benchmarks. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wenyi Hong , Yean Cheng , Zhuoyi Yang , Weihan Wang , Lefan Wang , Xiaotao Gu , Shiyu Huang , Yuxiao Dong , Jie Tang

AI models are increasingly prevalent in high-stakes environments, necessitating thorough assessment of their capabilities and risks. Benchmarks are popular for measuring these attributes and for comparing model performance, tracking…

Artificial Intelligence · Computer Science 2024-11-21 Anka Reuel , Amelia Hardy , Chandler Smith , Max Lamparth , Malcolm Hardy , Mykel J. Kochenderfer

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, including software development, education, and technical assistance. Among these, software development is one of the key areas where LLMs are…

Computation and Language · Computer Science 2026-01-07 Inpyo Song , Eunji Jeon , Jangwon Lee

Recent advances in large-scale video world models have enabled increasingly realistic future prediction, raising the prospect of using generated videos as scalable supervision for robot learning. However, for embodied manipulation,…

Video generation models have rapidly progressed, positioning themselves as video world models capable of supporting decision-making applications like robotics and autonomous driving. However, current benchmarks fail to rigorously evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dacheng Li , Yunhao Fang , Yukang Chen , Shuo Yang , Shiyi Cao , Justin Wong , Michael Luo , Xiaolong Wang , Hongxu Yin , Joseph E. Gonzalez , Ion Stoica , Song Han , Yao Lu

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

Understanding the physical world - governed by laws of motion, spatial relations, and causality - poses a fundamental challenge for multimodal large language models (MLLMs). While recent advances such as OpenAI o3 and GPT-4o demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Zhuobai Dong , Junchao Yi , Ziyuan Zheng , Haochen Han , Xiangxi Zheng , Alex Jinpeng Wang , Fangming Liu , Linjie Li

Video large language models (Video-LLMs) have made strong progress in general video understanding, but their ability to maintain temporal object consistency remains underexplored. Existing benchmarks often emphasize event recognition,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Junzhe Chen , Siyuan Meng , Yuxi Chen , Man Zhao , Wenyao Gui , Xiaojie Guo

Effective financial reasoning demands not only textual understanding but also the ability to interpret complex visual data such as charts, tables, and trend graphs. This paper introduces a new benchmark designed to evaluate how well AI…

Artificial Intelligence · Computer Science 2025-06-10 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Chunhou Liu , Ciprian Doru Giurcuaneanu , Jiamou Liu