English
Related papers

Related papers: 4DWorldBench: A Comprehensive Evaluation Framework…

200 papers

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Multimodal Large Language Models are primarily trained and evaluated on aligned image-text pairs, which leaves their ability to detect and resolve real-world inconsistencies largely unexplored. In open-domain applications visual and textual…

Generative video models are increasingly used in design animation tasks, yet no standardized evaluation framework exists for this domain. Unlike natural video generation, design animation imposes structured constraints: specific components…

Graphics · Computer Science 2026-05-18 Adrienne Deganutti , Dingning Cao , Jaejung Seol , Elad Hirsch , Purvanshi Mehta

Multimodal Language Language Models (MLLMs) demonstrate the emerging abilities of "world models" -- interpreting and reasoning about complex real-world dynamics. To assess these abilities, we posit videos are the ideal medium, as they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xuehai He , Weixi Feng , Kaizhi Zheng , Yujie Lu , Wanrong Zhu , Jiachen Li , Yue Fan , Jianfeng Wang , Linjie Li , Zhengyuan Yang , Kevin Lin , William Yang Wang , Lijuan Wang , Xin Eric Wang

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still struggle with handling diverse and complex image editing tasks that require implicit reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Yibin Wang , Chenglin Li , Zheming Liang , Dianyi Wang , Yang Jiao , Zhipeng Wei , Chao Gong , Cheng Jin , Jingjing Chen , Jiaqi Wang

Constructing a physically realistic and accurately scaled simulated 3D world is crucial for the training and evaluation of embodied intelligence tasks. The diversity, realism, low cost accessibility and affordability of 3D data assets are…

Robotics · Computer Science 2025-06-17 Xinjie Wang , Liu Liu , Yu Cao , Ruiqi Wu , Wenkang Qin , Dehui Wang , Wei Sui , Zhizhong Su

In recent years, large-scale models have achieved significant advancements, accompanied by the emergence of numerous high-quality benchmarks for evaluating various aspects of their comprehension abilities. However, most existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Kangning Li , Zheyang Jia , Anyu Ying

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xinqing Li , Xin He , Le Zhang , Min Wu , Xiaoli Li , Yun Liu

In different multimodal scenarios, it needs to integrate and utilize information across modalities in a specific way based on the demands of the task. Different integration ways between modalities are referred to as "multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yu Miao , Zequn Yang , Yake Wei , Ziheng Chen , Haotian Ni , Haodong Duan , Kai Chen , Di Hu

The evolution of video generation toward complex, multi-shot narratives has exposed a critical deficit in current evaluation methods. Existing benchmarks remain anchored to single-shot paradigms, lacking the comprehensive story assets and…

Multimedia · Computer Science 2026-03-02 Haoyuan Shi , Yunxin Li , Nanhao Deng , Zhenran Xu , Xinyu Chen , Longyue Wang , Baotian Hu , Min Zhang

The integration of visual understanding and generation into unified multimodal models represents a significant stride toward general-purpose AI. However, a fundamental question remains unanswered by existing benchmarks: does this…

Time series are ubiquitous in real-world scenarios and crucial for applications ranging from energy management to traffic control. Consequently, the ability to reason over time series is a fundamental skill for generalist models to solve…

Artificial Intelligence · Computer Science 2026-05-11 Fangxu Yu , Xingang Guo , Lingzhi Yuan , Haoqiang Kang , Hongyu Zhao , Lianhui Qin , Furong Huang , Bin Hu , Tianyi Zhou

Recent generative video world models aim to simulate visual environment evolution, allowing an observer to interactively explore the scene via camera control. However, they implicitly assume that the world only evolves within the observer's…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zicheng Duan , Jiatong Xia , Zeyu Zhang , Wenbo Zhang , Gengze Zhou , Chenhui Gou , Yefei He , Feng Chen , Xinyu Zhang , Lingqiao Liu

Evaluating code generation models for 3D spatial reasoning requires executing generated code in realistic environments and assessing outputs beyond surface-level correctness. We introduce a platform VoxelCode, for analyzing code generation…

Machine Learning · Computer Science 2026-04-06 Yan Zheng , Florian Bordes

Despite rapid advances in 3D content generation, quality assessment for the generated 3D assets remains challenging. Existing methods mainly rely on image-based metrics and operate solely at the object level, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yuhan Zhang , Long Zhuo , Ziyang Chu , Tong Wu , Zhibing Li , Liang Pan , Dahua Lin , Ziwei Liu

The advancement of 4D (i.e., sequential 3D) generation opens up new possibilities for lifelike experiences in various applications, where users can explore dynamic objects or characters from any viewpoint. Meanwhile, video generative models…

Graphics · Computer Science 2025-04-08 Yikai Wang , Guangce Liu , Xinzhou Wang , Zilong Chen , Jiafang Li , Xin Liang , Fuchun Sun , Jun Zhu

3D spatial reasoning is the ability to analyze and interpret the positions, orientations, and spatial relationships of objects within the 3D space. This allows models to develop a comprehensive understanding of the 3D scene, enabling their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Wufei Ma , Haoyu Chen , Guofeng Zhang , Yu-Cheng Chou , Jieneng Chen , Celso M de Melo , Alan Yuille

Layout-guided text-to-image models offer greater control over the generation process by explicitly conditioning image synthesis on the spatial arrangement of elements. As a result, their adoption has increased in many computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Elena Izzo , Luca Parolari , Davide Vezzaro , Lamberto Ballan

Existing evaluation frameworks for Multimodal Large Language Models (MLLMs) primarily focus on image reasoning or general video understanding tasks, largely overlooking the significant role of image context in video comprehension. To bridge…

‹ Prev 1 4 5 6 7 8 10 Next ›