English
Related papers

Related papers: 4DWorldBench: A Comprehensive Evaluation Framework…

200 papers

The awareness of multi-cultural human values is critical to the ability of language models (LMs) to generate safe and personalized responses. However, this awareness of LMs has been insufficiently studied, since the computer science…

Computation and Language · Computer Science 2024-04-26 Wenlong Zhao , Debanjan Mondal , Niket Tandon , Danica Dillion , Kurt Gray , Yuling Gu

Understanding how effectively large vision language models (VLMs) compare visual inputs is crucial across numerous applications, yet this fundamental capability remains insufficiently assessed. While VLMs are increasingly deployed for tasks…

Unified audio-visual generation is rapidly gaining industrial and creative relevance, enabling applications in virtual production and interactive media. However, when moving from general audio-video synthesis to music-dance co-generation,…

Recent techniques for text-to-4D generation synthesize dynamic 3D scenes using supervision from pre-trained text-to-video models. However, existing representations for motion, such as deformation models or time-dependent neural…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Sherwin Bahmani , Xian Liu , Wang Yifan , Ivan Skorokhodov , Victor Rong , Ziwei Liu , Xihui Liu , Jeong Joon Park , Sergey Tulyakov , Gordon Wetzstein , Andrea Tagliasacchi , David B. Lindell

Text-to-image (T2I) models have garnered significant attention for generating high-quality images aligned with text prompts. However, rapid T2I model advancements reveal limitations in early benchmarks, lacking comprehensive evaluations,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jingjing Chang , Yixiao Fang , Peng Xing , Shuhan Wu , Wei Cheng , Rui Wang , Xianfang Zeng , Gang Yu , Hai-Bao Chen

Recent advances in visual generative models have highlighted the promise of learning generative world models. However, most existing approaches frame world modeling as novel-view synthesis or future-frame prediction, emphasizing visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yifan Yin , Zehao Wen , Jieneng Chen , Zehan Zheng , Nanru Dai , Haojun Shi , Suyu Ye , Aydan Huang , Zheyuan Zhang , Alan Yuille , Jianwen Xie , Ayush Tewari , Tianmin Shu

Geometric problem solving constitutes a critical branch of mathematical reasoning, requiring precise analysis of shapes and spatial relationships. Current evaluations of geometric reasoning in vision-language models (VLMs) face limitations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yuan Feng , Yue Yang , Xiaohan He , Jiatong Zhao , Jianlong Chen , Zijun Chen , Daocheng Fu , Qi Liu , Renqiu Xia , Bo Zhang , Junchi Yan

The development of generative artificial intelligence for human motion generation has expanded rapidly, necessitating a unified evaluation framework. This paper presents a detailed review of eight evaluation metrics for human motion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Visual grounding, localizing objects from natural language descriptions, represents a critical bridge between language and vision understanding. While multimodal large language models (MLLMs) achieve impressive scores on existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Rang Li , Lei Li , Shuhuai Ren , Hao Tian , Shuhao Gu , Shicheng Li , Zihao Yue , Yudong Wang , Wenhan Ma , Zhe Yang , Jingyuan Ma , Zhifang Sui , Fuli Luo

The rapid evolution of Multi-modality Large Language Models (MLLMs) has catalyzed a shift in computer vision from specialized models to general-purpose foundation models. Nevertheless, there is still an inadequacy in assessing the abilities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Haoning Wu , Zicheng Zhang , Erli Zhang , Chaofeng Chen , Liang Liao , Annan Wang , Chunyi Li , Wenxiu Sun , Qiong Yan , Guangtao Zhai , Weisi Lin

3D visual grounding has made notable progress in localizing objects within complex 3D scenes. However, grounding referring expressions beyond objects in 3D scenes remains unexplored. In this paper, we introduce Anywhere3D-Bench, a holistic…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Tianxu Wang , Zhuofan Zhang , Ziyu Zhu , Yue Fan , Jing Xiong , Pengxiang Li , Xiaojian Ma , Qing Li

Real-world video editing demands not only expert knowledge of cinematic techniques but also multimodal reasoning to select, align, and combine footage into coherent narratives. While recent Large Multimodal Models (LMMs) have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Andong Deng , Dawei Du , Zhenfang Chen , Wen Zhong , Fan Chen , Guang Chen , Chia-Wen Kuo , Longyin Wen , Chen Chen , Sijie Zhu

Building robots that can perceive, reason, and act in dynamic, unstructured environments remains a core challenge. Recent embodied systems often adopt a dual-system paradigm, where System 2 handles high-level reasoning while System 1…

The rapid advancement of AIGC-based video generation has underscored the critical need for comprehensive evaluation frameworks that go beyond traditional generation quality metrics to encompass aesthetic appeal. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Longteng Jiang , DanDan Zheng , Qianqian Qiao , Heng Huang , Huaye Wang , Yihang Bo , Bao Peng , Jingdong Chen , Jun Zhou , Xin Jin

Video foundation models generate visually realistic and temporally coherent content, but their reliability as world simulators depends on whether they capture physical, logical, and spatial constraints. Existing metrics such as Frechet…

Computation and Language · Computer Science 2025-12-18 Zefan Cai , Haoyi Qiu , Tianyi Ma , Haozhe Zhao , Gengze Zhou , Kung-Hsiang Huang , Parisa Kordjamshidi , Minjia Zhang , Wen Xiao , Jiuxiang Gu , Nanyun Peng , Junjie Hu

The powerful reasoning of modern Vision Language Models open a new frontier for advanced personalization study. However, progress in this area is critically hampered by the lack of suitable benchmarks. To address this gap, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xia Hu , Honglei Zhuang , Brian Potetz , Alireza Fathi , Bo Hu , Babak Samari , Howard Zhou

Entity state tracking is a necessary component of world modeling that requires maintaining coherent representations of entities over time. Previous work has benchmarked entity tracking performance in purely text-based tasks. We introduce…

Computation and Language · Computer Science 2026-02-10 Vanya Cohen , Raymond Mooney

The popularity of multimodal large language models (MLLMs) has triggered a recent surge in research efforts dedicated to evaluating these models. Nevertheless, existing evaluation studies of MLLMs primarily focus on the comprehension and…

Computation and Language · Computer Science 2023-10-16 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

Emerging world models autoregressively generate video frames in response to actions, such as camera movements and text prompts, among other control signals. Due to limited temporal context window sizes, these models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Tong Wu , Shuai Yang , Ryan Po , Yinghao Xu , Ziwei Liu , Dahua Lin , Gordon Wetzstein
‹ Prev 1 8 9 10 Next ›